mlsanityData to 14 Oct 2026

VLA-Forget: Vision-Language-Action Unlearning for Embodied Foundation Models

arXiv 2604.03956 ↗First posted 5 Apr 2026cs.CV cs.AIcited by 10

On the map: Vision-language-action models → Generalist VLA models and benchmarks

also in 1 more
Abstract (arXiv)

Vision-language-action (VLA) models are emerging as embodied foundation models for robotic manipulation, but their deployment introduces a new unlearning challenge: removing unsafe, spurious, or privacy-sensitive behaviors without degrading perception, language grounding, and action control. In OpenVLA-style policies, behavior is produced through a fused visual encoder, a cross-modal projector, and a language backbone that predicts tokenized robot actions, so undesirable knowledge can be distributed across perception, alignment, and reasoning/action layers rather than confined to a single module. Consequently, partial unlearning applied only to the vision stack or only to the language backbone is often insufficient, while conventional unlearning baselines designed for standalone vision or language models may leave residual forgetting or incur unnecessary utility loss in embodied settings. We propose VLA-Forget, a hybrid unlearning framework that combines ratio-aware selective editing for perception and cross-modal specificity with layer-selective reasoning/action unlearning for utility-preserving forgetting. VLA-Forget jointly optimizes three objectives: targeted forgetting, perceptual preservation, and reasoning retention, through staged updates over the visual encoder, projector, and upper action-generating transformer blocks. Across forget-set behavior probes and retain-task evaluations, VLA-Forget improves forgetting efficacy by 10%, preserves perceptual specificity by 22%, retains reasoning and task success by 9%, and reduces post-quantization recovery by 55% relative to strong unlearning baselines.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 25 of its 34 references that are in the map. First posted on arXiv 5 Apr 2026.

Builds on

25 of 34 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026From Knowing to Doing Precisely: A General Self-Correction and Termination Framework for VLA models2 Feb
  2. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 21

  1. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  2. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  3. 2019Machine Unlearningcited by 1,061
  4. 2021Membership Inference Attacks From First Principlescited by 878
  5. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
  6. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
  7. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
  8. 2023Unified Concept Editing in Diffusion Modelscited by 388
  9. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generationcited by 386
  10. 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampeningcited by 181
  11. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
  12. 2024Catastrophic Failure of LLM Unlearning via Quantizationcited by 81
9 more
  1. 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruningcited by 43
  2. 2024Unlearning as multi-task optimization: A normalized gradient difference approach with an adaptive learning ratecited by 31
  3. 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 18
  4. 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertaintycited by 13
  5. 2026Position: LLMs Must Use Functor-Based and RAG-Driven Bias Mitigation for Fairnesscited by 10
  6. 2026CatRAG: Functor-Guided Structural Debiasing with Retrieval Augmentation for Fair LLMscited by 9
  7. 2026G-Drift MIA: Membership Inference via Gradient-Induced Feature Drift in LLMscited by 8
  8. 2026Improving Robustness of Vision-Language-Action Models by Restoring Corrupted Visual Inputscited by 4
  9. 2026KORAL: Knowledge Graph Guided LLM Reasoning for SSD Operational Analysiscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  2. 2026UAM: A Dual-Stream Perspective on Forgetting in VLA Training
  3. 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
  4. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  5. 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
  6. 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
  7. 2026EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training
  8. 2025VITA-VLA: Efficiently Teaching Vision-Language Models to Act via Action Expert Distillation