mlsanityData to 7 Oct 2026

PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding

arXiv 2605.30126 ↗First posted 28 May 2026cs.CV cs.AI cs.CLcited by 1

On the map: Multimodal LLMs / vision-language models → Visual token pruning and efficiency

Abstract (arXiv)

Large Vision-Language Models (LVLMs) map visual inputs into dense token sequences, imposing a quadratic computational bottleneck for inference. Elastic visual-token compression addresses this by training a single model that can run at multiple visual-token budgets. However, existing approaches struggle under aggressive compression. Spatial-only compression, as in nested pooling, behaves as an imperfect low-pass filter and induces spectral aliasing that obscures fine-grained detail. Query-only compression, as in nested query resampling, replaces explicit grid-aligned tokens with non-local summaries and substantially degrades spatial grounding. To resolve this representational conflict, we introduce PARCEL (Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding), a visual tokenization architecture that dynamically partitions the labor of feature extraction. PARCEL establishes spatial pool tokens as low-frequency layout anchors and conditions elastic query tokens on these anchors through Pool-Conditioned Query Resampling. This encourages query tokens to focus on complementary visual features rather than redundant spatial mapping. Extensive evaluations across 27 benchmarks show that PARCEL improves the performance-efficiency Pareto frontier, consistently outperforming existing matryoshka baselines across visual-token budgets while preserving the "train once, deploy anywhere" paradigm.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Visual token pruning and efficiency, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 84 of its 105 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

84 of 105 references.

Closest ancestors · 28

Same direction, newest first

  1. 2026ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning30 Mar
  2. 2026QMoP: Query Guided Mixture-of-Projector for Efficient Visual Token Compression22 Mar
  3. 2026Energy-Driven Adaptive Visual Token Pruning for Efficient Vision-Language Models6 Mar
  4. 2026When LLaVA Meets Objects: Token Composition for Vision-Language-Models4 Feb
  5. 2026N"uwa: Mending the Spatial Integrity Torn by VLM Token Pruning3 Feb
  6. 2025Delta-LLaVA: Base-then-Specialize Alignment for Token-Efficient Vision-Language Models21 Dec
  7. 2025Adaptive-VoCo: Complexity-Aware Visual Token Compression for Vision-Language Models20 Dec
  8. 2025Efficient Vision-Language Reasoning via Adaptive Token Pruning14 Dec
  9. 2025Hybrid Token Compression for Vision-Language Models9 Dec
  10. 2025VLM-Pruner: Buffering for Spatial Sparsity in an Efficient VLM Centrifugal Token Pruning Paradigm2 Dec
  11. 2025Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methods8 Oct
  12. 2025LLaVA-SP: Enhancing Visual Representation with Visual Spatial Tokens for MLLMs1 Jul
16 more
  1. 2025VScan: Rethinking Visual Token Reduction for Efficient Large Vision-Language Models28 May
  2. 2025Fwd2Bot: LVLM Visual Token Compression with Double Forward Bottleneck27 Mar
  3. 2025ToFu: Visual Tokens Reduction via Fusion for Multi-modal, Multi-patch, Multi-image Task6 Mar
  4. 2025DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Models4 Mar
  5. 2025Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?17 Feb
  6. 2024Feather the Throttle: Revisiting Visual Token Pruning for Vision-Language Model Acceleration17 Dec
  7. 2024AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning4 Dec
  8. 2024ATP-LLaVA: Adaptive Token Pruning for Large Vision Language Models30 Nov
  9. 2024Multi-Stage Vision Token Dropping: Towards Efficient Multimodal Large Language Model16 Nov
  10. 2024Inference Optimal VLMs Need Fewer Visual Tokens and More Parameters5 Nov
  11. 2024PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction22 Oct
  12. 2024Efficient Large Multi-modal Models via Visual Context Compression28 Jun
  13. 2024VoCo-LLaMA: Towards Vision Compression with Large Language Models18 Jun
  14. 2024Matryoshka Multimodal Models27 May
  15. 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models22 Mar
  16. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models11 Mar

Other references · 56

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  5. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  6. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  7. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  8. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  9. 2019Towards VQA Models That Can Readcited by 1,696
  10. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  11. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
  12. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
38 more
  1. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
  2. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
  3. 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 852
  4. 2016A Diagram Is Worth A Dozen Imagescited by 793
  5. 2017Dense-Captioning Events in Videoscited by 789
  6. 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 762
  7. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
  8. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  9. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
  10. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
  11. 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
  12. 2018nocaps: novel object captioning at scalecited by 444
  13. 2021InfographicVQAcited by 430
  14. 2019VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Researchcited by 412
  15. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
  16. 2019Making Convolutional Networks Shift-Invariant Againcited by 390
  17. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
  18. 2019Scene Text Visual Question Answeringcited by 327
  19. 2022Matryoshka Representation Learningcited by 268
  20. 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 254
  21. 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
  22. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
  23. 2018Why do deep convolutional networks generalize so poorly to small image transformations?cited by 198
  24. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
  25. 2023Honeybee: Locality-enhanced Projector for Multimodal LLMcited by 195
  26. 2021Visually Grounded Reasoning across Languages and Culturescited by 188
  27. 2023PaLI-3 Vision Language Models: Smaller, Faster, Strongercited by 125
  28. 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 119
  29. 2021GSPMD: General and Scalable Parallelization for ML Computation Graphscited by 109
  30. 2025FlexTok: Resampling Images into 1D Token Sequences of Flexible Lengthcited by 105
  31. 2022Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Datasetcited by 100
  32. 2022Better plain ViT baselines for ImageNet-1kcited by 97
  33. 2020Widget Captioning: Generating Natural Language Description for Mobile User Interface Elementscited by 94
  34. 2014Learning Ordered Representations with Nested Dropoutcited by 81
  35. 2023MatFormer: Nested Transformer for Elastic Inferencecited by 79
  36. 2021SciCap: Generating Captions for Scientific Figurescited by 76
  37. 2021xGQA: Cross-Lingual Visual Question Answeringcited by 72
  38. 2022All You May Need for VQA are Image Captionscited by 65

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Selection: Token Parameterization for Extreme Visual Token Compression
  2. 2025A Glimpse to Compress: Dynamic Visual Token Pruning for Large Vision-Language Models
  3. 2026Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospects
  4. 2026Foveated Compression: Selective High-Resolution Preservation for Token-Efficient VLMs
  5. 2026Reroute, Don't Remove: Recoverable Visual Token Routing for Vision-Language Models
  6. 2026CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models
  7. 2026ReToken: One Token to Improve Vision-Language Models for Visual Retrieval
  8. 2026LRCP: Low-Rank Compressibility Guided Visual Token Pruning for Efficient LVLMs