Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models pretrained on large-scale multimodal datasets have emerged as powerful foundations for robotic perception and control. However, their massive scale, often billions of parameters, poses significant challenges for real-time deployment, as inference becomes computationally expensive and latency-sensitive in dynamic environments. To address this, we propose Token Expand-and-Merge-VLA (TEAM-VLA), a training-free token compression framework that accelerates VLA inference while preserving task performance. TEAM-VLA introduces a dynamic token expansion mechanism that identifies and samples additional informative tokens in the spatial vicinity of attention-highlighted regions, enhancing contextual completeness. These expanded tokens are then selectively merged in deeper layers under action-aware guidance, effectively reducing redundancy while maintaining semantic coherence. By coupling expansion and merging within a single feed-forward pass, TEAM-VLA achieves a balanced trade-off between efficiency and effectiveness, without any retraining or parameter updates. Extensive experiments on LIBERO benchmark demonstrate that TEAM-VLA consistently improves inference speed while maintaining or even surpassing the task success rate of full VLA models. The code is public available on hrefhttps://github.com/Jasper-aaa/TEAM-VLAhttps://github.com/Jasper-aaa/TEAM-VLA
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 30 of its 35 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
30 of 35 references.
Closest ancestors · 5
Same direction, newest first
- 2025Action-aware Dynamic Pruning for Efficient Vision-Language-Action Manipulation26 Sep
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning16 Sep
- 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning6 Sep
- 2025TTF-VLA: Temporal Token Fusion via Pixel-Attention Integration for Vision-Language-Action Models15 Aug
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models11 Jun
Other references · 25
- 2023Qwen Technical Reportcited by 3,344
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2022Token Merging: Your ViT But Fastercited by 1,021
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
13 more
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 391
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
- 2021Learned Token Pruning for Transformerscited by 139
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
- 2024Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Modelscited by 126
- 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 125
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 84
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learningcited by 21
- 2025Survey on Vision-Language-Action Modelscited by 5
- 2025EgoPrune: Efficient Token Pruning for Egomotion Video Reasoning in Embodied Agentcited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 21
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulationcited by 19
- 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imaginationcited by 18
- 2025TS-DP: Reinforcement Speculative Decoding For Temporal Adaptive Diffusion Policy Accelerationcited by 6
- 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulationcited by 4
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inferencecited by 1
- 2026Training-Free Interaction-Aligned Visual Token Pruning for Efficient Embodied Manipulationcited by 1
- 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulation1 Aug 2026
- 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination8 Jun 2026
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation7 Jun 2026
- 2026Training-Free Interaction-Aligned Visual Token Pruning for Efficient Embodied Manipulation24 Mar 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inference11 Mar 2026
- 2025TS-DP: Reinforcement Speculative Decoding For Temporal Adaptive Diffusion Policy Acceleration13 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
- 2025SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models
- 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching
- 2025FASTer: Toward Efficient Autoregressive Vision Language Action Modeling via Neural Action Tokenization
- 2025Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulation
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model