mlsanityData to 7 Oct 2026

Suppression Sticks, Locality Is Fragile: A Closed-Loop Target-and-Control Audit of Task-Vector Negation in VLA Policies

arXiv 2608.04692 ↗First posted 5 Aug 2026cs.RO cs.LGcited by 1

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Task-vector arithmetic offers a closed-form way to modify a model, yet its behavioral locality remains unclear in closed-loop robot control. We present a target-and-control audit of per-skill task-vector subtraction from multitask vision-language-action (VLA) policies. Across all ten LIBERO-Goal skills, subtraction produces three qualitatively different regimes: target-control separation for five skills, resistance for three, and global collapse for two. On held-out initial states, the five suppressible targets remain at 0% success; however, mean baseline-normalized control retention is only 52%, and each target-suppressing edit materially harms at least one nominally unrelated control. Additional Goal panels show separation across tested policies with continuous-regression, discrete-token, and flow-matching action heads, whereas we observe no clean separation on Spatial and control collapse on the tested Object and Long-horizon panels. Mean task-vector cosine does not account for this variation. A matched-norm control identifies a local sign asymmetry around one Goal anchor, while multi-vector outcomes vary with anchor and scale. Retain-aware gradient baselines provide data-dependent comparators but require removal-time data and optimization; subtraction is data- and gradient-free only at edit time, assuming precomputed expert deltas. Finally, a single-skill relearning probe is consistent with behavioral masking, not certified unlearning. These results characterize task-vector subtraction as a fast but brittle intervention and underscore the need for closed-loop target-and-control evaluation when assessing locality in embodied model editing.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 42 of its 51 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

42 of 51 references.

References · 42

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  6. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  7. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
  8. 2017Visualizing the Loss Landscape of Neural Netscited by 1,126
  9. 2019Machine Unlearningcited by 1,020
  10. 2022Mass-Editing Memory in a Transformercited by 976
  11. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  12. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
30 more
  1. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
  2. 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 627
  3. 2021Merging Models with Fisher-Weighted Averagingcited by 613
  4. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
  5. 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 585
  6. 2019Certified Data Removal from Machine Learning Modelscited by 512
  7. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 507
  8. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  9. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  10. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
  11. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 484
  12. 2017Sharp Minima Can Generalize For Deep Netscited by 462
  13. 2022Dataless Knowledge Fusion by Merging Weights of Language Modelscited by 384
  14. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generationcited by 376
  15. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
  16. 2020Amnesiac Machine Learningcited by 305
  17. 2021ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networkscited by 293
  18. 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 251
  19. 2023Task Arithmetic in the Tangent Space: Improved Editing of Pre-Trained Modelscited by 218
  20. 2022Continual Learning and Private Unlearningcited by 124
  21. 2024An Adversarial Perspective on Machine Unlearning for AI Safetycited by 113
  22. 2024Do Unlearning Methods Remove Information from Language Model Weights?cited by 66
  23. 2025When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformerscited by 38
  24. 2025MergeVLA: Cross-Skill Model Merging Toward a Generalist Vision-Language-Action Agentcited by 15
  25. 2026Pretrained Vision-Language-Action Models are Surprisingly Resistant to Forgetting in Continual Learningcited by 15
  26. 2026VLA-Forget: Vision-Language-Action Unlearning for Embodied Foundation Modelscited by 9
  27. 2025Effective Skill Unlearning through Intervention and Abstentioncited by 8
  28. 2026A Brain-inspired Embodied Intelligence for Fluid and Fast Reflexive Robotics Controlcited by 5
  29. 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Actioncited by 4
  30. 2026CATA: Continual Machine Unlearning via Conflict-Averse Task Arithmeticcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causeway: Restoring Task Accessibility for Instruction Switching in VLA Policies
  2. 2026MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation
  3. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
  4. 2026PAPO-VLA: Planning-Aware Policy Optimization for Vision-Language-Action Models
  5. 2026Decoupling Vision, Language, and Action for Efficient Multi-Task Robot Policies
  6. 2026Faster and Better? Benchmark Bugs and Design Limitations Distort the Evaluation of Vision-Language-Action Acceleration
  7. 2025VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Models
  8. 2025SwitchVLA: Execution-Aware Task Switching for Vision-Language-Action Models