mlsanityData to 14 Oct 2026

RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models

arXiv 2605.19678 ↗First posted 19 May 2026cs.ROcited by 3

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Vision-Language-Action (VLA) models have shown strong performance on embodied manipulation, yet they remain brittle under visual observation changes, paraphrased language instructions, and compounded perturbations. This limitation suggests that existing methods still rely heavily on shallow correlations in the training distribution, rather than learning stable couplings among task semantics, environment states, and action generation. Although recent efforts improve robustness through larger-scale training, post-training adaptation, or enhanced predictive modeling, they rarely enforce invariance-oriented consistency within the end-to-end policy itself. To address this issue, we propose RoVLA, a robust vision-language-action framework with multi-consistency constraints. RoVLA enforces consistency under three complementary transformations: instruction semantics, trajectory evolution, and observation perturbation. Specifically, Instructional Consistency (IC) promotes stable grounding under semantically equivalent instruction rewrites, Evolutionary Consistency (EC) preserves coherent action intent throughout the generation process, and Observational Consistency (OC) improves robustness to visual and proprioceptive perturbations by enforcing consistent predictions before and after targeted disturbances. By explicitly modeling these invariances during training, RoVLA reduces reliance on superficial correlations and improves robustness and generalization. Experiments on LIBERO-Plus, RoboTwin 2.0, and real-world manipulation tasks show that RoVLA consistently outperforms strong baseline methods and exhibits superior robustness under diverse task and observation shifts. These results demonstrate the effectiveness of multi-consistency learning for robust embodied control. Codes will be available at https://github.com/HCPLab-SYSU/RoVLA.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 30 of its 45 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

30 of 45 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Models15 Oct

Other references · 29

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  7. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  9. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  10. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  11. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
  12. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
17 more
  1. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  2. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  3. 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 585
  4. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  5. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  6. 2025π*0.6: a VLA That Learns From Experiencecited by 303
  7. 2025Motus: A Unified Latent Action World Modelcited by 251
  8. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
  9. 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 151
  10. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 135
  11. 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
  12. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
  13. 2025RynnVLA-002: A Unified Vision-Language-Action and World Modelcited by 74
  14. 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 73
  15. 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulationcited by 72
  16. 2025RobustVLA: Robustness-Aware Reinforcement Post-Training for Vision-Language-Action Modelscited by 18
  17. 2025A Survey on Large Language Models for Automated Planningcited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training
  2. 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation
  3. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  4. 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models
  5. 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
  6. 2026VISTA: Enhancing Visual Conditioning via Track-Following Preference Optimization in Vision-Language-Action Models
  7. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  8. 2026When Does Language Matter? Multilingual Instructions Reveal Step-wise Language Sensitivity in Vision-Language-Action Models