mlsanityData to 14 Oct 2026

Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models

arXiv 2512.09927 ↗First posted 10 Dec 2025cs.ROcited by 7

On the map: Vision-language-action models → Efficient VLA inference and adaptation

Abstract (arXiv)

Vision-Language-Action (VLA) models pretrained on large-scale multimodal datasets have emerged as powerful foundations for robotic perception and control. However, their massive scale, often billions of parameters, poses significant challenges for real-time deployment, as inference becomes computationally expensive and latency-sensitive in dynamic environments. To address this, we propose Token Expand-and-Merge-VLA (TEAM-VLA), a training-free token compression framework that accelerates VLA inference while preserving task performance. TEAM-VLA introduces a dynamic token expansion mechanism that identifies and samples additional informative tokens in the spatial vicinity of attention-highlighted regions, enhancing contextual completeness. These expanded tokens are then selectively merged in deeper layers under action-aware guidance, effectively reducing redundancy while maintaining semantic coherence. By coupling expansion and merging within a single feed-forward pass, TEAM-VLA achieves a balanced trade-off between efficiency and effectiveness, without any retraining or parameter updates. Extensive experiments on LIBERO benchmark demonstrate that TEAM-VLA consistently improves inference speed while maintaining or even surpassing the task success rate of full VLA models. The code is public available on hrefhttps://github.com/Jasper-aaa/TEAM-VLAhttps://github.com/Jasper-aaa/TEAM-VLA

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 30 of its 35 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

30 of 35 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Action-aware Dynamic Pruning for Efficient Vision-Language-Action Manipulation26 Sep
  2. 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning16 Sep
  3. 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning6 Sep
  4. 2025TTF-VLA: Temporal Token Fusion via Pixel-Attention Integration for Vision-Language-Action Models15 Aug
  5. 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models11 Jun

Other references · 25

  1. 2023Qwen Technical Reportcited by 3,344
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  8. 2022Token Merging: Your ViT But Fastercited by 1,021
  9. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  10. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  11. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  12. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
13 more
  1. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  2. 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 391
  3. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
  4. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  5. 2021Learned Token Pruning for Transformerscited by 139
  6. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
  7. 2024Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Modelscited by 126
  8. 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 125
  9. 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 84
  10. 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
  11. 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learningcited by 21
  12. 2025Survey on Vision-Language-Action Modelscited by 5
  13. 2025EgoPrune: Efficient Token Pruning for Egomotion Video Reasoning in Embodied Agentcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
  2. 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
  3. 2025SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models
  4. 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
  5. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching
  6. 2025FASTer: Toward Efficient Autoregressive Vision Language Action Modeling via Neural Action Tokenization
  7. 2025Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulation
  8. 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model