VLA-Forget: Vision-Language-Action Unlearning for Embodied Foundation Models
On the map: Vision-language-action models → Generalist VLA models and benchmarks
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models are emerging as embodied foundation models for robotic manipulation, but their deployment introduces a new unlearning challenge: removing unsafe, spurious, or privacy-sensitive behaviors without degrading perception, language grounding, and action control. In OpenVLA-style policies, behavior is produced through a fused visual encoder, a cross-modal projector, and a language backbone that predicts tokenized robot actions, so undesirable knowledge can be distributed across perception, alignment, and reasoning/action layers rather than confined to a single module. Consequently, partial unlearning applied only to the vision stack or only to the language backbone is often insufficient, while conventional unlearning baselines designed for standalone vision or language models may leave residual forgetting or incur unnecessary utility loss in embodied settings. We propose VLA-Forget, a hybrid unlearning framework that combines ratio-aware selective editing for perception and cross-modal specificity with layer-selective reasoning/action unlearning for utility-preserving forgetting. VLA-Forget jointly optimizes three objectives: targeted forgetting, perceptual preservation, and reasoning retention, through staged updates over the visual encoder, projector, and upper action-generating transformer blocks. Across forget-set behavior probes and retain-task evaluations, VLA-Forget improves forgetting efficacy by 10%, preserves perceptual specificity by 22%, retains reasoning and task success by 9%, and reduces post-quantization recovery by 55% relative to strong unlearning baselines.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 25 of its 34 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
25 of 34 references.
Closest ancestors · 4
Same direction, newest first
- 2026From Knowing to Doing Precisely: A General Self-Correction and Termination Framework for VLA models2 Feb
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 21
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2019Machine Unlearningcited by 1,061
- 2021Membership Inference Attacks From First Principlescited by 878
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
- 2023Unified Concept Editing in Diffusion Modelscited by 388
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generationcited by 386
- 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampeningcited by 181
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
- 2024Catastrophic Failure of LLM Unlearning via Quantizationcited by 81
9 more
- 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruningcited by 43
- 2024Unlearning as multi-task optimization: A normalized gradient difference approach with an adaptive learning ratecited by 31
- 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 18
- 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertaintycited by 13
- 2026Position: LLMs Must Use Functor-Based and RAG-Driven Bias Mitigation for Fairnesscited by 10
- 2026CatRAG: Functor-Guided Structural Debiasing with Retrieval Augmentation for Fair LLMscited by 9
- 2026G-Drift MIA: Membership Inference via Gradient-Induced Feature Drift in LLMscited by 8
- 2026Improving Robustness of Vision-Language-Action Models by Restoring Corrupted Visual Inputscited by 4
- 2026KORAL: Knowledge Graph Guided LLM Reasoning for SSD Operational Analysiscited by 2
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanismscited by 13
- 2026PERSA: Reinforcement Learning for Professor-Style Personalized Feedback with LLMscited by 6
- 2026SafeCommit: Certifying When Memory-Grounded Agents May Safely Actcited by 6
- 2026Listening with Attention: Entropy-Guided Explainability for Transformer-Based Audio Modelscited by 4
- 2026Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMscited by 2
- 2026Suppression Sticks, Locality Is Fragile: A Closed-Loop Target-and-Control Audit of Task-Vector Negation in VLA Policiescited by 1
- 2026Rethinking Demonstration Unlearning in Imitation Learning for Roboticscited by 1
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluationcited by 0
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directionscited by 0
- 2026REPORT-OPS: Hybrid Evidence-Guided Reporting with Human-Supervised Refinement for HPCcited by 0
- 2026REPORT-OPS: Hybrid Evidence-Guided Reporting with Human-Supervised Refinement for HPC13 Oct 2026
- 2026Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs9 Sep 2026
- 2026Rethinking Demonstration Unlearning in Imitation Learning for Robotics21 Aug 2026
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directions19 Aug 2026
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation17 Aug 2026
- 2026Suppression Sticks, Locality Is Fragile: A Closed-Loop Target-and-Control Audit of Task-Vector Negation in VLA Policies5 Aug 2026
- 2026SafeCommit: Certifying When Memory-Grounded Agents May Safely Act4 Aug 2026
- 2026Listening with Attention: Entropy-Guided Explainability for Transformer-Based Audio Models12 Jun 2026
- 2026PERSA: Reinforcement Learning for Professor-Style Personalized Feedback with LLMs1 May 2026
- 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanisms26 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2026UAM: A Dual-Stream Perspective on Forgetting in VLA Training
- 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
- 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
- 2026EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training
- 2025VITA-VLA: Efficiently Teaching Vision-Language Models to Act via Action Expert Distillation