CoverPrune: Coverage-Driven Token Pruning for 3D VLMs via Optimal Transport
On the map: LLM reasoning → Spatial and embodied reasoning
also in 2 more
Abstract (arXiv)
While 3D Vision-Language Models (3D VLMs) have demonstrated remarkable spatial reasoning capabilities, they suffer from massive visual token counts that create severe computational bottlenecks during inference. Existing token pruning methods primarily rely on diversity-based selection, discarding similar tokens to maximize dispersion. However, in 3D environments, this approach frequently drops representative prototype tokens in favor of outliers, breaking the multi-view consistencies and geometric structures essential for spatial reasoning. In this paper, we propose a paradigm shift for 3D VLM token pruning: from maximizing diversity to preserving visual evidence coverage. We introduce CoverPrune, a training-free framework that formulates inference-time token pruning as an Optimal Transport (OT) problem. To overcome the intractable combinatorial subset selection inherent in this formulation, we design the Feature-Spatial-Temporal (FST) transport cost and target capacity, along with an efficient Spatial-Guided Greedy Selection (SGS) algorithm to approximate the OT objective. Furthermore, we propose CoverPrune-Lite, an accelerated variant utilizing spatially structured local matching for minimal overhead. Extensive experiments across multiple 3D visual-spatial reasoning benchmarks demonstrate that our methods achieve state-of-the-art token efficiency, maintaining robust reasoning performance even under highly aggressive pruning budgets. Visit our project website at https://github.com/Brucess/CoverPrune.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 41 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
33 of 41 references.
Closest ancestors · 5
Same direction, newest first
- 2025Reasoning in Space via Grounding in the World15 Oct
- 2025EgoPrune: Efficient Token Pruning for Egomotion Video Reasoning in Embodied Agent21 Jul
- 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation24 Apr
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2022SQA3D: Situated Question Answering in 3D Scenes14 Oct
Other references · 28
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2018Computational Optimal Transportcited by 780
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 391
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
16 more
- 2024VisionZip: Longer is Better but Not Necessary in Vision Language Modelscited by 313
- 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 218
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
- 2023Honeybee: Locality-enhanced Projector for Multimodal LLMcited by 197
- 2024LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Imagescited by 195
- 2025DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Modelscited by 181
- 2024TokenPacker: Efficient Visual Projector for Multimodal LLMcited by 172
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 93
- 2025FastVID: Dynamic Density Pruning for Fast Video Large Language Modelscited by 52
- 2025Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigationcited by 51
- 20253D Aware Region Prompted Vision Language Modelcited by 33
- 2021SPOT: A framework for selection of prototypes using optimal transportcited by 13
- 2025ToSA: Token Merging with Spatial Awarenesscited by 11
- 2021Partial Wasserstein Coveringcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CoVeR: Coverage-Based Token Pruning for Multi-View 3D Reasoning in VLMs
- 2026Who Speaks for the Pruned? Visual Token Pruning as Coverage Optimization
- 2026Geometry-Guided 3D Visual Token Pruning for Video-Language Models
- 2026Efficient3D: A Unified Framework for Adaptive and Debiased Token Reduction in 3D MLLMs
- 2025VLM-Pruner: Buffering for Spatial Sparsity in an Efficient VLM Centrifugal Token Pruning Paradigm
- 2026SwiftVLM: Efficient Vision-Language Model Inference via Cross-Layer Token Bypass
- 2026Moving Beyond Diversity: Visual Token Pruning as Subspace Reconstruction for Efficient VLMs
- 2026SeGPruner: Semantic-Geometric Visual Token Pruner for 3D Question Answering