mlsanityData to 7 Oct 2026

MedARC: Training-Free Adaptive Redundancy Compression of Visual Tokens for 3D Medical Vision-Language Models

arXiv 2607.26554 ↗First posted 29 Jul 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

Integrating 3D medical images with vision-language models (VLMs) holds substantial promise for computer-aided diagnosis. However, volumetric images generate prohibitively long visual-token sequences with considerable spatial and inter-slice redundancy. Existing token compression methods typically apply uniform reduction or rely on a single importance signal, increasing the risk of removing regions that are clinically relevant to the query or structurally distinctive. To address this limitation, we propose MedARC, a unified, training-free framework for Adaptive Redundancy Compression of visual tokens in 3D medical VLMs. MedARC estimates token importance by integrating three complementary cues: self-attention from the VLM vision encoder, which reflects the model's intrinsic visual focus; similarity between projected visual tokens and text embeddings, which identifies query-relevant regions; and deviations of local visual foundation model features from the volume-level feature center, which highlight structurally distinctive anatomy. The resulting importance distribution guides a saliency-aware merging strategy that preserves informative tokens while consolidating redundant ones rather than simply discarding them. Experiments on CT-RATE and MR-RATE show that MedARC reduces visual-token overhead and inference time while preserving or improving diagnostic performance. Its multi-cue scoring cost is outweighed by the savings from processing fewer tokens, with greater benefits expected for larger language models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 11 of its 27 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

11 of 27 references.

References · 11

  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2022Token Merging: Your ViT But Fastercited by 995
  3. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
  4. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  5. 2023Honeybee: Locality-enhanced Projector for Multimodal LLMcited by 195
  6. 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
  7. 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 96
  8. 2021UniMiSS: Universal Medical Self-Supervised Learning via Breaking Dimensionality Barriercited by 55
  9. 2023ChatCAD+: Towards a Universal and Reliable Interactive CAD using LLMscited by 35
  10. 2023TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selectioncited by 18
  11. 2025SparseVILA: Decoupling Visual Sparsity for Efficient VLM Inferencecited by 15

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MedPruner: Training-Free Hierarchical Token Pruning for Efficient 3D Medical Image Understanding in Vision-Language Models
  2. 2025Better Tokens for Better 3D: Advancing Vision-Language Modeling in 3D Medical Imaging
  3. 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis
  4. 2025OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understanding
  5. 2023T3D: Advancing 3D Medical Vision-Language Pre-training by Learning Multi-View Visual Consistency
  6. 2026Prune Redundancy, Preserve Essence: Vision Token Compression in VLMs via Synergistic Importance-Diversity
  7. 2026ORCA: ORgan-Centroid Aggregation for Training-Free 3D CT Visual Token Compression
  8. 2026Disease-Centric Vision-Language Pretraining with Hybrid Visual Encoding for 3D Computed Tomography