Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapse
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models also fits: MLLM jailbreaks and adversarial robustness
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models adapt pretrained vision-language models (VLMs) for closed-loop robot control, transferring their perceptual and semantic capabilities to action prediction. Despite strong in-distribution performance, however, VLAs often degrade under deployment shifts. Adversarial training (AT) offers a model-adaptive approach to robustness without explicitly anticipating individual shifts, but its effect on natural distribution-shift generalization in multi-view VLAs remains unclear. We study this question using a multi-view VLA directly adapted from a pretrained VLM and evaluate generalization across seven LIBERO-Plus shift axes. Direct AT substantially improves Camera Viewpoint and Sensor Noise, the two shifts affecting only the third-person view, yet produces mixed or negative effects on other shifts. Controlled view interventions reveal a surprising failure mode that we term view collapse: Direct AT can shift cross-view reliance so strongly that the policy becomes dominated by the wrist view. This exposes a textitrobustness shortcut: apparent robustness to a shifted view can arise from reduced use of that view rather than more robust perception of it. This motivates a distinction between robust perception, extracting reliable information under within-view shifts, and robust fusion, adapting reliance across views according to their reliability. To reduce fixed view reliance, we use a simple View Swap intervention and then re-evaluate AT. With View Swap, AT further improves Camera Viewpoint, Sensor Noise, and Robot Initial State, while its effects remain mixed on other shifts. Our results show that multi-view robustness requires separating improved perception from changes in cross-view reliance, and that AT provides selective rather than generic distribution-shift benefits.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 34 of its 42 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
34 of 42 references.
Closest ancestors · 5
Same direction, newest first
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
- 2026VLM4VLA: Revisiting Vision-Language-Models in Vision-Language-Action Models6 Jan
- 2025MergeVLA: Cross-Skill Model Merging Toward a Generalist Vision-Language-Action Agent24 Nov
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
Other references · 29
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 953
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2020Fast is better than free: Revisiting adversarial trainingcited by 727
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
- 2019Adversarial Examples Improve Image Recognitioncited by 286
17 more
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
- 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
- 2022Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networkscited by 95
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 73
- 2021On the effectiveness of adversarial training against common corruptionscited by 71
- 2023On Uni-Modal Feature Learning in Supervised Multi-Modal Learningcited by 53
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
- 2022Vision-Based Manipulators Need to Also See from Their Handscited by 47
- 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systemscited by 31
- 2024ReVLA: Reverting Visual Domain Limitation of Robotic Foundation Modelscited by 27
- 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Modelscited by 27
- 2025RobustVLA: On Robustness of Vision-Language-Action Model against Multi-Modal Perturbationscited by 25
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attentioncited by 25
- 2025Model-agnostic Adversarial Attack and Defense for Vision-Language-Action Modelscited by 22
- 2022Explicit Tradeoffs between Adversarial and Natural Distributional Robustnesscited by 20
- 2020Learning Precise 3D Manipulation from Multiple Uncalibrated Camerascited by 18
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
- 2025Benchmarking the Generality of Vision-Language-Action Models
- 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
- 2025When Alignment Fails: Multimodal Adversarial Attacks on Vision-Language-Action Models
- 2026CoRe-VLA: Preserving Cross-View Coordination in VLAs under Camera Shifts ↗
- 2025Eva-VLA: Evaluating Vision-Language-Action Models' Robustness Under Real-World Physical Variations
- 2026The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Data Collection
- 2025Enhancing Generalization in Vision-Language-Action Models by Preserving Pretrained Representations