mlsanityData to 14 Oct 2026

RationalVLA: A Rational Vision-Language-Action Model with Dual System

arXiv 2506.10826 ↗First posted 12 Jun 2025cs.ROcited by 12

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

A fundamental requirement for real-world robotic deployment is the ability to understand and respond to natural language instructions. Existing language-conditioned manipulation tasks typically assume that instructions are perfectly aligned with the environment. This assumption limits robustness and generalization in realistic scenarios where instructions may be ambiguous, irrelevant, or infeasible. To address this problem, we introduce RAtional MAnipulation (RAMA), a new benchmark that challenges models with both unseen executable instructions and defective ones that should be rejected. In RAMA, we construct a dataset with over 14,000 samples, including diverse defective instructions spanning six dimensions: visual, physical, semantic, motion, safety, and out-of-context. We further propose the Rational Vision-Language-Action model (RationalVLA). It is a dual system for robotic arms that integrates the high-level vision-language model with the low-level manipulation policy by introducing learnable latent space embeddings. This design enables RationalVLA to reason over instructions, reject infeasible commands, and execute manipulation effectively. Experiments demonstrate that RationalVLA outperforms state-of-the-art baselines on RAMA by a 14.5% higher success rate and 0.94 average task length, while maintaining competitive performance on standard manipulation tasks. Real-world trials further validate its effectiveness and robustness in practical applications. Our project page is https://irpn-eai.github.io/RationalVLA.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 47 of its 58 references that are in the map. First posted on arXiv 12 Jun 2025.

Builds on

47 of 58 references.

References · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  9. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  10. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  12. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
35 more
  1. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  2. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  3. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  4. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  5. 2021Dynamic Neural Networks: A Surveycited by 408
  6. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  7. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  8. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
  9. 2020Language Conditioned Imitation Learning over Unstructured Datacited by 209
  10. 2024ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Modelscited by 205
  11. 2024Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillationcited by 166
  12. 2023Video Language Planningcited by 162
  13. 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 154
  14. 2022What Matters in Language Conditioned Robotic Imitation Learning over Unstructured Datacited by 138
  15. 2023RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketchescited by 133
  16. 2023Investigating the Catastrophic Forgetting in Multimodal Large Language Modelscited by 119
  17. 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representationscited by 116
  18. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 103
  19. 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
  20. 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
  21. 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 82
  22. 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 75
  23. 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 73
  24. 2023QUAR-VLA: Vision-Language-Action Model for Quadruped Robotscited by 56
  25. 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulationcited by 51
  26. 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledgecited by 49
  27. 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLMcited by 44
  28. 2025Seeing Far and Clearly: Mitigating Hallucinations in MLLMs with Attention Causal Decodingcited by 43
  29. 2024From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Controlcited by 35
  30. 2024GeRM: A Generalist Robotic Model with Mixture-of-experts for Quadruped Robotcited by 29
  31. 2025MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Modelscited by 27
  32. 2023SARA-RT: Scaling up Robotics Transformers with Self-Adaptive Robust Attentioncited by 20
  33. 2022Interactive Imitation Learning of Bimanual Movement Primitivescited by 18
  34. 2021Learning Generalizable Vision-Tactile Robotic Grasping Strategy for Deformable Objects via Transformercited by 13
  35. 2024Navigating Beyond Instructions: Vision-and-Language Navigation in Obstructed Environmentscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 4.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
  2. 2025REALM: A Real-to-Sim Validated Benchmark for Generalization in Robotic Manipulation
  3. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  4. 2026DAM-VLA: A Dynamic Action Model-Based Vision-Language-Action Framework for Robot Manipulation
  5. 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
  6. 2026PokeVLA: Empowering Pocket-Sized Vision-Language-Action Model with Comprehensive World Knowledge Guidance
  7. 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation
  8. 2025Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation