mlsanityData to 7 Oct 2026

Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulation

arXiv 2511.18950 ↗First posted 24 Nov 2025cs.RO cs.CV cs.LGcited by 7

On the map: Vision-language-action models → Efficient VLA inference and adaptation

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have emerged as a powerful paradigm in Embodied AI. However, the significant computational overhead of processing redundant visual tokens remains a critical bottleneck for real-time robotic deployment. While standard token pruning techniques can alleviate this, these task-agnostic methods struggle to preserve task-critical visual information. To address this challenge, simultaneously preserving both the holistic context and fine-grained details for precise action, we propose Compressor-VLA, a novel hybrid instruction-conditioned token compression framework designed for efficient, task-oriented compression of visual information in VLA models. The proposed Compressor-VLA framework consists of two token compression modules: a Semantic Task Compressor (STC) that distills holistic, task-relevant context, and a Spatial Refinement Compressor (SRC) that preserves fine-grained spatial details. This compression is dynamically modulated by the natural language instruction, allowing for the adaptive condensation of task-relevant visual information. Experimentally, extensive evaluations demonstrate that Compressor-VLA achieves a competitive success rate on the LIBERO benchmark while reducing FLOPs by 59% and the visual token count by over 3x compared to its baseline. The real-robot deployments on a dual-arm robot platform validate the model's sim-to-real transferability and practical applicability. Moreover, qualitative analyses reveal that our instruction guidance dynamically steers the model's perceptual focus toward task-relevant objects, thereby validating the effectiveness of our approach.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 30 of its 32 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

30 of 32 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning6 Sep
  2. 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Acceleration15 Jun
  3. 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models11 Jun

Other references · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  9. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  10. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  12. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
15 more
  1. 2022Token Merging: Your ViT But Fastercited by 995
  2. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  3. 2022A Generalist Agentcited by 802
  4. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
  5. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  6. 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 378
  7. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  8. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
  9. 2025DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Modelscited by 177
  10. 2020Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processingcited by 161
  11. 2024Beyond Text-Visual Attention: Exploiting Visual Cues for Effective Token Pruning in VLMscited by 153
  12. 2025TopV: Compatible Token Pruning with Inference Time Optimization for Fast and Low-Memory Multimodal Vision Language Modelcited by 57
  13. 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
  14. 2024An Interactive Agent Foundation Modelcited by 25
  15. 2022Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selectioncited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models
  2. 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
  3. 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model
  4. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching
  5. 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation
  6. 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
  7. 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
  8. 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think