Don't Run with Scissors: Pruning Breaks VLA Models but They Can Be Recovered
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models are a promising paradigm for field robotics, but their deployment is bottlenecked by strict edge SWaP-C constraints. Compression techniques such as quantization, distillation, and pruning are well-established for LLMs and VLMs. Pruning, however, remains particularly underexplored for VLA models. We surprisingly find that pruning VLA models yields drastic performance degradation and increased safety violations. Through spectral analysis, we identify structural properties of VLA weights that help explain this fragility. Based on this insight, we introduce GLUESTICK, a post-pruning recovery method that restores much of the original model's capability while preserving sparsity benefits. GLUESTICK computes a one-time corrective term by interpolating between the dense and pruned models in weight space. At inference, each pruned layer applies this correction to recover lost performance with minimal overhead. Our approach requires no additional training and is agnostic to the pruning algorithm. Across diverse VLA architectures and domains, GLUESTICK recovers up to 100% of the success rate and restores safety to near-dense levels, while saving up to 5 GB of memory and achieving up to 1.75x speedup. Additional material can be found at: https://gluestick-vla.github.io/
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 42 of its 52 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
42 of 52 references.
References · 42
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
30 more
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,121
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 800
- 2023VILA: On Pre-training for Visual Language Modelscited by 692
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2016EIE: Efficient Inference Engine on Compressed Deep Neural Networkcited by 295
- 2019Challenges of Real-World Reinforcement Learningcited by 291
- 2023A Survey on Model Compression for Large Language Modelscited by 269
- 2021Accelerating Sparse Deep Neural Networkscited by 223
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 197
- 2024Towards Safer Large Language Models through Machine Unlearningcited by 139
- 2024Safe LoRA: the Silver Lining of Reducing Safety Risks when Fine-tuning Large Language Modelscited by 125
- 2024Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuningcited by 72
- 2025SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Mergingcited by 25
- 2025AsFT: Anchoring Safety During LLM Fine-Tuning Within Narrow Safety Basincited by 19
- 2025CAT Pruning: Cluster-Aware Token Pruning For Text-to-Image Diffusion Modelscited by 16
- 2025Safe, Task-Consistent Manipulation with Operational Space Control Barrier Functionscited by 11
- 2024Generative AI Agents in Autonomous Machines: A Safety Perspectivecited by 7
- 2024OmniNxt: A Fully Open-source and Compact Aerial Robot with Omnidirectional Visual Perceptioncited by 6
- 2025A Performance Analysis of You Only Look Once Models for Deployment on Constrained Computational Edge Devices in Drone Applicationscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 26
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 21
- 2026Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?cited by 3
- 2026From Inference Efficiency to Embodied Efficiency: Revisiting Efficiency Metrics for Vision-Language-Action Modelscited by 2
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptationcited by 2
- 2026Environment-Aware Adaptive Pruning with Interleaved Inference Orchestration for Vision-Language-Action Modelscited by 1
- 2026Position: Embodied AI Requires a Privacy-Utility Trade-offcited by 1
- 2026Recovering Aggressively Pruned Vision-Language-Action Models with Offline Hidden-State Distillationcited by 0
- 2026Recovering Aggressively Pruned Vision-Language-Action Models with Offline Hidden-State Distillation17 Sep 2026
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptation30 Jun 2026
- 2026Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?26 Jun 2026
- 2026Position: Embodied AI Requires a Privacy-Utility Trade-off6 May 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
- 2026From Inference Efficiency to Embodied Efficiency: Revisiting Efficiency Metrics for Vision-Language-Action Models19 Mar 2026
- 2026Environment-Aware Adaptive Pruning with Interleaved Inference Orchestration for Vision-Language-Action Models31 Jan 2026
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models
- 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation
- 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Models
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning
- 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
- 2025SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models
- 2026BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action Model