Suppression Sticks, Locality Is Fragile: A Closed-Loop Target-and-Control Audit of Task-Vector Negation in VLA Policies
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Task-vector arithmetic offers a closed-form way to modify a model, yet its behavioral locality remains unclear in closed-loop robot control. We present a target-and-control audit of per-skill task-vector subtraction from multitask vision-language-action (VLA) policies. Across all ten LIBERO-Goal skills, subtraction produces three qualitatively different regimes: target-control separation for five skills, resistance for three, and global collapse for two. On held-out initial states, the five suppressible targets remain at 0% success; however, mean baseline-normalized control retention is only 52%, and each target-suppressing edit materially harms at least one nominally unrelated control. Additional Goal panels show separation across tested policies with continuous-regression, discrete-token, and flow-matching action heads, whereas we observe no clean separation on Spatial and control collapse on the tested Object and Long-horizon panels. Mean task-vector cosine does not account for this variation. A matched-norm control identifies a local sign asymmetry around one Goal anchor, while multi-vector outcomes vary with anchor and scale. Retain-aware gradient baselines provide data-dependent comparators but require removal-time data and optimization; subtraction is data- and gradient-free only at edit time, assuming precomputed expert deltas. Finally, a single-skill relearning probe is consistent with behavioral masking, not certified unlearning. These results characterize task-vector subtraction as a fast but brittle intervention and underscore the need for closed-loop target-and-control evaluation when assessing locality in embodied model editing.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 42 of its 51 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
42 of 51 references.
References · 42
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2017Visualizing the Loss Landscape of Neural Netscited by 1,126
- 2019Machine Unlearningcited by 1,020
- 2022Mass-Editing Memory in a Transformercited by 976
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
30 more
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 627
- 2021Merging Models with Fisher-Weighted Averagingcited by 613
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
- 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 585
- 2019Certified Data Removal from Machine Learning Modelscited by 512
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 507
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 484
- 2017Sharp Minima Can Generalize For Deep Netscited by 462
- 2022Dataless Knowledge Fusion by Merging Weights of Language Modelscited by 384
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generationcited by 376
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2020Amnesiac Machine Learningcited by 305
- 2021ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networkscited by 293
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 251
- 2023Task Arithmetic in the Tangent Space: Improved Editing of Pre-Trained Modelscited by 218
- 2022Continual Learning and Private Unlearningcited by 124
- 2024An Adversarial Perspective on Machine Unlearning for AI Safetycited by 113
- 2024Do Unlearning Methods Remove Information from Language Model Weights?cited by 66
- 2025When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformerscited by 38
- 2025MergeVLA: Cross-Skill Model Merging Toward a Generalist Vision-Language-Action Agentcited by 15
- 2026Pretrained Vision-Language-Action Models are Surprisingly Resistant to Forgetting in Continual Learningcited by 15
- 2026VLA-Forget: Vision-Language-Action Unlearning for Embodied Foundation Modelscited by 9
- 2025Effective Skill Unlearning through Intervention and Abstentioncited by 8
- 2026A Brain-inspired Embodied Intelligence for Fluid and Fast Reflexive Robotics Controlcited by 5
- 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Actioncited by 4
- 2026CATA: Continual Machine Unlearning via Conflict-Averse Task Arithmeticcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Causeway: Restoring Task Accessibility for Instruction Switching in VLA Policies
- 2026MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation
- 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
- 2026PAPO-VLA: Planning-Aware Policy Optimization for Vision-Language-Action Models
- 2026Decoupling Vision, Language, and Action for Efficient Multi-Task Robot Policies
- 2026Faster and Better? Benchmark Bugs and Design Limitations Distort the Evaluation of Vision-Language-Action Acceleration
- 2025VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Models
- 2025SwitchVLA: Execution-Aware Task Switching for Vision-Language-Action Models