mlsanityData to 14 Oct 2026

Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapse

arXiv 2609.33707 ↗First posted 27 Sep 2026cs.AI cs.ROcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models also fits: MLLM jailbreaks and adversarial robustness

also in 1 more
Abstract (arXiv)

Vision-language-action (VLA) models adapt pretrained vision-language models (VLMs) for closed-loop robot control, transferring their perceptual and semantic capabilities to action prediction. Despite strong in-distribution performance, however, VLAs often degrade under deployment shifts. Adversarial training (AT) offers a model-adaptive approach to robustness without explicitly anticipating individual shifts, but its effect on natural distribution-shift generalization in multi-view VLAs remains unclear. We study this question using a multi-view VLA directly adapted from a pretrained VLM and evaluate generalization across seven LIBERO-Plus shift axes. Direct AT substantially improves Camera Viewpoint and Sensor Noise, the two shifts affecting only the third-person view, yet produces mixed or negative effects on other shifts. Controlled view interventions reveal a surprising failure mode that we term view collapse: Direct AT can shift cross-view reliance so strongly that the policy becomes dominated by the wrist view. This exposes a textitrobustness shortcut: apparent robustness to a shifted view can arise from reduced use of that view rather than more robust perception of it. This motivates a distinction between robust perception, extracting reliable information under within-view shifts, and robust fusion, adapting reliance across views according to their reliability. To reduce fixed view reliance, we use a simple View Swap intervention and then re-evaluate AT. With View Swap, AT further improves Camera Viewpoint, Sensor Noise, and Robot Initial State, while its effects remain mixed on other shifts. Our results show that multi-view robustness requires separating improved perception from changes in cross-view reliance, and that AT provides selective rather than generic distribution-shift benefits.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 34 of its 42 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

34 of 42 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
  2. 2026VLM4VLA: Revisiting Vision-Language-Models in Vision-Language-Action Models6 Jan
  3. 2025MergeVLA: Cross-Skill Model Merging Toward a Generalist Vision-Language-Action Agent24 Nov
  4. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
  5. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb

Other references · 29

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 953
  7. 2018Robustness May Be at Odds with Accuracycited by 880
  8. 2020Fast is better than free: Revisiting adversarial trainingcited by 727
  9. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  10. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  11. 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
  12. 2019Adversarial Examples Improve Image Recognitioncited by 286
17 more
  1. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
  2. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
  3. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
  4. 2022Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networkscited by 95
  5. 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 73
  6. 2021On the effectiveness of adversarial training against common corruptionscited by 71
  7. 2023On Uni-Modal Feature Learning in Supervised Multi-Modal Learningcited by 53
  8. 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
  9. 2022Vision-Based Manipulators Need to Also See from Their Handscited by 47
  10. 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systemscited by 31
  11. 2024ReVLA: Reverting Visual Domain Limitation of Robotic Foundation Modelscited by 27
  12. 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Modelscited by 27
  13. 2025RobustVLA: On Robustness of Vision-Language-Action Model against Multi-Modal Perturbationscited by 25
  14. 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attentioncited by 25
  15. 2025Model-agnostic Adversarial Attack and Defense for Vision-Language-Action Modelscited by 22
  16. 2022Explicit Tradeoffs between Adversarial and Natural Distributional Robustnesscited by 20
  17. 2020Learning Precise 3D Manipulation from Multiple Uncalibrated Camerascited by 18

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
  2. 2025Benchmarking the Generality of Vision-Language-Action Models
  3. 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
  4. 2025When Alignment Fails: Multimodal Adversarial Attacks on Vision-Language-Action Models
  5. 2026CoRe-VLA: Preserving Cross-View Coordination in VLAs under Camera Shifts ↗
  6. 2025Eva-VLA: Evaluating Vision-Language-Action Models' Robustness Under Real-World Physical Variations
  7. 2026The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Data Collection
  8. 2025Enhancing Generalization in Vision-Language-Action Models by Preserving Pretrained Representations