Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulation
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models have emerged as a powerful paradigm in Embodied AI. However, the significant computational overhead of processing redundant visual tokens remains a critical bottleneck for real-time robotic deployment. While standard token pruning techniques can alleviate this, these task-agnostic methods struggle to preserve task-critical visual information. To address this challenge, simultaneously preserving both the holistic context and fine-grained details for precise action, we propose Compressor-VLA, a novel hybrid instruction-conditioned token compression framework designed for efficient, task-oriented compression of visual information in VLA models. The proposed Compressor-VLA framework consists of two token compression modules: a Semantic Task Compressor (STC) that distills holistic, task-relevant context, and a Spatial Refinement Compressor (SRC) that preserves fine-grained spatial details. This compression is dynamically modulated by the natural language instruction, allowing for the adaptive condensation of task-relevant visual information. Experimentally, extensive evaluations demonstrate that Compressor-VLA achieves a competitive success rate on the LIBERO benchmark while reducing FLOPs by 59% and the visual token count by over 3x compared to its baseline. The real-robot deployments on a dual-arm robot platform validate the model's sim-to-real transferability and practical applicability. Moreover, qualitative analyses reveal that our instruction guidance dynamically steers the model's perceptual focus toward task-relevant objects, thereby validating the effectiveness of our approach.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 30 of its 32 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
30 of 32 references.
Closest ancestors · 3
Same direction, newest first
- 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning6 Sep
- 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Acceleration15 Jun
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models11 Jun
Other references · 27
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
15 more
- 2022Token Merging: Your ViT But Fastercited by 995
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2022A Generalist Agentcited by 802
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 378
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2025DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Modelscited by 177
- 2020Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processingcited by 161
- 2024Beyond Text-Visual Attention: Exploiting Visual Cues for Effective Token Pruning in VLMscited by 153
- 2025TopV: Compatible Token Pruning with Inference Time Optimization for Fast and Low-Memory Multimodal Vision Language Modelcited by 57
- 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
- 2024An Interactive Agent Foundation Modelcited by 25
- 2022Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selectioncited by 13
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026Latent Bridge: Feature Delta Prediction for Efficient Dual-System Vision-Language-Action Model Inferencecited by 4
- 2026Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulationcited by 3
- 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understandingcited by 1
- 2026LEEVLA: Seeing What Matters in Latent Environment Evolution for Vision-Language-Actioncited by 0
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Modelscited by 0
- 2026ReCAT: Remember, Count, and Time: Structured Recurrent Memory for Robot Manipulationcited by 0
- 2026ReCAT: Remember, Count, and Time: Structured Recurrent Memory for Robot Manipulation28 Sep 2026
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models20 Sep 2026
- 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understanding31 Aug 2026
- 2026LEEVLA: Seeing What Matters in Latent Environment Evolution for Vision-Language-Action9 Jul 2026
- 2026Latent Bridge: Feature Delta Prediction for Efficient Dual-System Vision-Language-Action Model Inference4 May 2026
- 2026Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation21 Mar 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation
- 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
- 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think