mlsanityData to 7 Oct 2026

Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptation

arXiv 2606.31382 ↗First posted 30 Jun 2026cs.ROcited by 2

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have made significant strides in embodied intelligence by integrating the powerful representations of pre-trained Vision-Language Models (VLMs). However, the massive parameter scale of VLAs imposes a heavy computational burden, and these models exhibit extreme sensitivity to parameter pruning. Current paradigms often treat the resulting performance degradation as inevitable, relying on fine-tuning or low-rank corrections to recover efficacy. We challenge this convention by questioning whether the removed parameters are truly redundant if VLA pruning necessitates performance recovery to be effective, or if this paradigm masks the indiscriminate pruning of critical parameters. We revisit parameter redundancy through the lens of VLM-to-VLA adaptation, first quantifying the spatial distribution of parameter divergence during adaptation to reveal structured patterns across different modules. Subsequently, we introduce controlled pruning as a diagnostic probe: by comparing the direct impact of removing different parameter subsets on VLA performance without any fine-tuning, we establish a causal link between adaptation-induced divergence signals and functional contributions. Based on the discovered modular heterogeneities, we design a multi-module joint pruning scheme. Evaluations on the LIBERO benchmark demonstrate that our approach reduces the parameters of OpenVLA and π0.5 by 12%--30% while maintaining approximately 90% of the original performance without any post-pruning recovery. In contrast, existing parameter pruning criteria result in total performance collapse when evaluated under the same recovery-free constraints. Our study reveals the parameter evolution mechanism in VLA adaptation and provides a new path for deploying efficient, robust robotic policies in resource-constrained environments.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 37 of its 38 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

37 of 38 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations27 Nov
  2. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct
  3. 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct
  4. 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgetting26 Sep
  5. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
  6. 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges7 May
  7. 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar
  8. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution4 Nov
  9. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
  10. 2023PaLM-E: An Embodied Multimodal Language Model6 Mar

Other references · 27

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  4. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  5. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
  6. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  7. 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 643
  8. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  9. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
  10. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
  11. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  12. 2023Fluctuation-based Adaptive Structured Pruning for Large Language Modelscited by 110
15 more
  1. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
  2. 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Modelscited by 89
  3. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 83
  4. 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Accelerationcited by 56
  5. 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulationcited by 42
  6. 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
  7. 2025Action-aware Dynamic Pruning for Efficient Vision-Language-Action Manipulationcited by 32
  8. 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Modelscited by 30
  9. 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantizationcited by 23
  10. 2025RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Modelscited by 20
  11. 2025SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Modelscited by 15
  12. 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulationcited by 12
  13. 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Modelcited by 9
  14. 2025Saliency-Aware Quantized Imitation Learning for Efficient Robotic Controlcited by 8
  15. 2025Don't Run with Scissors: Pruning Breaks VLA Models but They Can Be Recoveredcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VLM4VLA: Revisiting Vision-Language-Models in Vision-Language-Action Models
  2. 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
  3. 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
  4. 2026Not All Layers Need Tuning: Diagnosing and Directing Adaptation in Vision-Language-Action Models
  5. 2026CLAP: Direct VLM-to-VLA Adaptation via Language-Action Grounding
  6. 2026VLA-Trace: Diagnosing Vision-Language-Action Models through Representation and Behavior Tracing
  7. 2026The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface
  8. 2026CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Models