mlsanityData to 14 Oct 2026

Beyond Accuracy: Auditing Spatial Provenance in Visual Token Pruning for OCR-Critical MLLM Inference

arXiv 2608.00077 ↗First posted 29 Jul 2026cs.CVcited by 0

On the map: Efficient LLM inference and serving → Visual token pruning in multimodal models

Abstract (arXiv)

Visual-token pruning is usually judged by answer quality at a fixed retention budget. For text-rich multimodal large language models (MLLMs), this protocol can miss a distinct failure: an answer remains correct even when no retained token is locally traceable to the small OCR region that supports it. We turn this blind spot into an evidence-risk audit that couples answer behavior with geometric token-origin provenance, interventions, and realized cost; transparent training-free selectors isolate controlled operating points. On locked image-disjoint confirmation, Qwen Target at 30% retention has observed accuracy 0.786 versus 0.783 for Full (paired image-cluster difference +0.003, 95% CI [-0.014, +0.020]), yet same-budget Target, Random, and Grid retain sharply different positive-support coverage: 0.620, 0.270, and 0.318. Across Qwen3-VL-8B, LLaVA-1.5-7B, and InternVL3.5-8B, matched controls, interventions, detector tests, and external methods reveal model-specific quality-risk-traceability frontiers that accuracy alone does not expose. Materialized prefixes yield up to 4.32x batch-prefill speedup and 76.4% lower incremental peak memory; full-validation TextVQA and DocVQA further show that favorable target-verification points do not imply task-general compression. Visual-token pruning should therefore report surviving spatial provenance and realized cost alongside quality and compression.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Visual token pruning in multimodal models, one of 12 directions in Efficient LLM inference and serving. Builds on 27 of its 38 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

27 of 38 references.

Closest ancestors · 16

Same direction, newest first

  1. 2026AnchorPrune: Relevance-Anchored Contextual Expansion for Visual Token Pruning8 Jul
  2. 2026TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference25 Jun
  3. 2026RTPrune: Reading-Twice Inspired Token Pruning for Efficient DeepSeek-OCR Inference1 May
  4. 2026DocPrune:Efficient Document Question Answering via Background, Question, and Comprehension-aware Token Pruning24 Apr
  5. 2026When Does Visual Token Pruning Improve Calibration? The Role of Evidence Coverage in MLLMs13 Apr
  6. 2026IDPruner: Harmonizing Importance and Diversity in Visual Token Pruning for MLLMs10 Feb
  7. 2026N"uwa: Mending the Spatial Integrity Torn by VLM Token Pruning3 Feb
  8. 2025When Token Pruning is Worse than Random: Understanding Visual Token Information in VLLMs8 Dec
  9. 2025VLM-Pruner: Buffering for Spatial Sparsity in an Efficient VLM Centrifugal Token Pruning Paradigm2 Dec
  10. 2025SCOPE: Saliency-Coverage Oriented Token Pruning for Efficient Multimodel LLMs28 Oct
  11. 2025Grounding-Aware Token Pruning: Recovering from Drastic Performance Drops in Visual Grounding Caused by Pruning27 Jun
  12. 2025Beyond Attention or Similarity: Maximizing Conditional Diversity for Token Pruning in MLLMs12 Jun
4 more
  1. 2025CROP: Contextual Region-Oriented Visual Token Pruning27 May
  2. 2025Why 1 + 1 < 1 in Visual Token Pruning: Beyond Naive Integration via Multi-Objective Balanced Covering15 May
  3. 2025Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?17 Feb
  4. 2025What Kind of Visual Tokens Do We Need? Training-free Visual Token Pruning for Multi-modal Large Language Models from the Perspective of Graph4 Jan

Other references · 11

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  3. 2019Towards VQA Models That Can Readcited by 1,718
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  5. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  6. 2022Token Merging: Your ViT But Fastercited by 1,021
  7. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
  8. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 254
  9. 2024TokenPacker: Efficient Visual Projector for Multimodal LLMcited by 172
  10. 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 171
  11. 2026Focus, Don't Prune: Identifying Instruction-Relevant Regions for Information-Rich Image Understandingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ET-Prune: Evidence-Aware Dynamic Budgeting for Visual Token Pruning in Text-Rich MLLMs
  2. 2026S2Prune: Spatially Structured Visual Token Pruning for Multimodal Large Language Models
  3. 2026SinkPruner: Sink-Free Visual Token Pruning for Multimodal Large Language Models
  4. 2026Bifocal: Training-Free Mixed Granularity Visual Token Pruning for Multimodal LLMs
  5. 2026OccamToken: Efficient VLM Inference with Training-Free and Budget-Adaptive Token Pruning
  6. 2026TwinPrune: Density-Aware Two-Phase Token Pruning for Vision-Language Models
  7. 2026RoRA: Role-Oriented Regional Allocation for Visual Token Pruning in MLLMs
  8. 2025Don't Just Chase "Highlighted Tokens" in MLLMs: Revisiting Visual Holistic Context Retention