mlsanityData to 14 Oct 2026

Don't Run with Scissors: Pruning Breaks VLA Models but They Can Be Recovered

arXiv 2510.08464 ↗First posted 9 Oct 2025cs.RO cs.LGcited by 8

On the map: Vision-language-action models → Efficient VLA inference and adaptation

Abstract (arXiv)

Vision-Language-Action (VLA) models are a promising paradigm for field robotics, but their deployment is bottlenecked by strict edge SWaP-C constraints. Compression techniques such as quantization, distillation, and pruning are well-established for LLMs and VLMs. Pruning, however, remains particularly underexplored for VLA models. We surprisingly find that pruning VLA models yields drastic performance degradation and increased safety violations. Through spectral analysis, we identify structural properties of VLA weights that help explain this fragility. Based on this insight, we introduce GLUESTICK, a post-pruning recovery method that restores much of the original model's capability while preserving sparsity benefits. GLUESTICK computes a one-time corrective term by interpolating between the dense and pruned models in weight space. At inference, each pruned layer applies this correction to recover lost performance with minimal overhead. Our approach requires no additional training and is agnostic to the pruning algorithm. Across diverse VLA architectures and domains, GLUESTICK recovers up to 100% of the success rate and restores safety to near-dense levels, while saving up to 5 GB of memory and achieving up to 1.75x speedup. Additional material can be found at: https://gluestick-vla.github.io/

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 42 of its 52 references that are in the map. First posted on arXiv 9 Oct 2025.

Builds on

42 of 52 references.

References · 42

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2020Scaling Laws for Neural Language Modelscited by 6,586
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  7. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  9. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  10. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  11. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  12. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
30 more
  1. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  2. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  3. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  4. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  5. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,121
  6. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  7. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  8. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 800
  9. 2023VILA: On Pre-training for Visual Language Modelscited by 692
  10. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
  11. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  12. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  13. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  14. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  15. 2016EIE: Efficient Inference Engine on Compressed Deep Neural Networkcited by 295
  16. 2019Challenges of Real-World Reinforcement Learningcited by 291
  17. 2023A Survey on Model Compression for Large Language Modelscited by 269
  18. 2021Accelerating Sparse Deep Neural Networkscited by 223
  19. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  20. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 197
  21. 2024Towards Safer Large Language Models through Machine Unlearningcited by 139
  22. 2024Safe LoRA: the Silver Lining of Reducing Safety Risks when Fine-tuning Large Language Modelscited by 125
  23. 2024Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuningcited by 72
  24. 2025SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Mergingcited by 25
  25. 2025AsFT: Anchoring Safety During LLM Fine-Tuning Within Narrow Safety Basincited by 19
  26. 2025CAT Pruning: Cluster-Aware Token Pruning For Text-to-Image Diffusion Modelscited by 16
  27. 2025Safe, Task-Consistent Manipulation with Operational Space Control Barrier Functionscited by 11
  28. 2024Generative AI Agents in Autonomous Machines: A Safety Perspectivecited by 7
  29. 2024OmniNxt: A Fully Open-source and Compact Aerial Robot with Omnidirectional Visual Perceptioncited by 6
  30. 2025A Performance Analysis of You Only Look Once Models for Deployment on Constrained Computational Edge Devices in Drone Applicationscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models
  2. 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
  3. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation
  4. 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Models
  5. 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning
  6. 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
  7. 2025SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models
  8. 2026BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action Model