PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding
On the map: Multimodal LLMs / vision-language models → Visual token pruning and efficiency
Abstract (arXiv)
Large Vision-Language Models (LVLMs) map visual inputs into dense token sequences, imposing a quadratic computational bottleneck for inference. Elastic visual-token compression addresses this by training a single model that can run at multiple visual-token budgets. However, existing approaches struggle under aggressive compression. Spatial-only compression, as in nested pooling, behaves as an imperfect low-pass filter and induces spectral aliasing that obscures fine-grained detail. Query-only compression, as in nested query resampling, replaces explicit grid-aligned tokens with non-local summaries and substantially degrades spatial grounding. To resolve this representational conflict, we introduce PARCEL (Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding), a visual tokenization architecture that dynamically partitions the labor of feature extraction. PARCEL establishes spatial pool tokens as low-frequency layout anchors and conditions elastic query tokens on these anchors through Pool-Conditioned Query Resampling. This encourages query tokens to focus on complementary visual features rather than redundant spatial mapping. Extensive evaluations across 27 benchmarks show that PARCEL improves the performance-efficiency Pareto frontier, consistently outperforming existing matryoshka baselines across visual-token budgets while preserving the "train once, deploy anywhere" paradigm.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Visual token pruning and efficiency, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 84 of its 105 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
84 of 105 references.
Closest ancestors · 28
Same direction, newest first
- 2026ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning30 Mar
- 2026QMoP: Query Guided Mixture-of-Projector for Efficient Visual Token Compression22 Mar
- 2026Energy-Driven Adaptive Visual Token Pruning for Efficient Vision-Language Models6 Mar
- 2026When LLaVA Meets Objects: Token Composition for Vision-Language-Models4 Feb
- 2026N"uwa: Mending the Spatial Integrity Torn by VLM Token Pruning3 Feb
- 2025Delta-LLaVA: Base-then-Specialize Alignment for Token-Efficient Vision-Language Models21 Dec
- 2025Adaptive-VoCo: Complexity-Aware Visual Token Compression for Vision-Language Models20 Dec
- 2025Efficient Vision-Language Reasoning via Adaptive Token Pruning14 Dec
- 2025Hybrid Token Compression for Vision-Language Models9 Dec
- 2025VLM-Pruner: Buffering for Spatial Sparsity in an Efficient VLM Centrifugal Token Pruning Paradigm2 Dec
- 2025Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methods8 Oct
- 2025LLaVA-SP: Enhancing Visual Representation with Visual Spatial Tokens for MLLMs1 Jul
16 more
- 2025VScan: Rethinking Visual Token Reduction for Efficient Large Vision-Language Models28 May
- 2025Fwd2Bot: LVLM Visual Token Compression with Double Forward Bottleneck27 Mar
- 2025ToFu: Visual Tokens Reduction via Fusion for Multi-modal, Multi-patch, Multi-image Task6 Mar
- 2025DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Models4 Mar
- 2025Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?17 Feb
- 2024Feather the Throttle: Revisiting Visual Token Pruning for Vision-Language Model Acceleration17 Dec
- 2024AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning4 Dec
- 2024ATP-LLaVA: Adaptive Token Pruning for Large Vision Language Models30 Nov
- 2024Multi-Stage Vision Token Dropping: Towards Efficient Multimodal Large Language Model16 Nov
- 2024Inference Optimal VLMs Need Fewer Visual Tokens and More Parameters5 Nov
- 2024PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction22 Oct
- 2024Efficient Large Multi-modal Models via Visual Context Compression28 Jun
- 2024VoCo-LLaMA: Towards Vision Compression with Large Language Models18 Jun
- 2024Matryoshka Multimodal Models27 May
- 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models22 Mar
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models11 Mar
Other references · 56
- 2017Attention Is All You Needcited by 59,932
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2019Towards VQA Models That Can Readcited by 1,696
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
38 more
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
- 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 852
- 2016A Diagram Is Worth A Dozen Imagescited by 793
- 2017Dense-Captioning Events in Videoscited by 789
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 762
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
- 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
- 2018nocaps: novel object captioning at scalecited by 444
- 2021InfographicVQAcited by 430
- 2019VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Researchcited by 412
- 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
- 2019Making Convolutional Networks Shift-Invariant Againcited by 390
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
- 2019Scene Text Visual Question Answeringcited by 327
- 2022Matryoshka Representation Learningcited by 268
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 254
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2018Why do deep convolutional networks generalize so poorly to small image transformations?cited by 198
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
- 2023Honeybee: Locality-enhanced Projector for Multimodal LLMcited by 195
- 2021Visually Grounded Reasoning across Languages and Culturescited by 188
- 2023PaLI-3 Vision Language Models: Smaller, Faster, Strongercited by 125
- 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 119
- 2021GSPMD: General and Scalable Parallelization for ML Computation Graphscited by 109
- 2025FlexTok: Resampling Images into 1D Token Sequences of Flexible Lengthcited by 105
- 2022Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Datasetcited by 100
- 2022Better plain ViT baselines for ImageNet-1kcited by 97
- 2020Widget Captioning: Generating Natural Language Description for Mobile User Interface Elementscited by 94
- 2014Learning Ordered Representations with Nested Dropoutcited by 81
- 2023MatFormer: Nested Transformer for Elastic Inferencecited by 79
- 2021SciCap: Generating Captions for Scientific Figurescited by 76
- 2021xGQA: Cross-Lingual Visual Question Answeringcited by 72
- 2022All You May Need for VQA are Image Captionscited by 65
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Selection: Token Parameterization for Extreme Visual Token Compression
- 2025A Glimpse to Compress: Dynamic Visual Token Pruning for Large Vision-Language Models
- 2026Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospects
- 2026Foveated Compression: Selective High-Resolution Preservation for Token-Efficient VLMs
- 2026Reroute, Don't Remove: Recoverable Visual Token Routing for Vision-Language Models
- 2026CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models
- 2026ReToken: One Token to Improve Vision-Language Models for Visual Retrieval
- 2026LRCP: Low-Rank Compressibility Guided Visual Token Pruning for Efficient LVLMs