RationalVLA: A Rational Vision-Language-Action Model with Dual System
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
A fundamental requirement for real-world robotic deployment is the ability to understand and respond to natural language instructions. Existing language-conditioned manipulation tasks typically assume that instructions are perfectly aligned with the environment. This assumption limits robustness and generalization in realistic scenarios where instructions may be ambiguous, irrelevant, or infeasible. To address this problem, we introduce RAtional MAnipulation (RAMA), a new benchmark that challenges models with both unseen executable instructions and defective ones that should be rejected. In RAMA, we construct a dataset with over 14,000 samples, including diverse defective instructions spanning six dimensions: visual, physical, semantic, motion, safety, and out-of-context. We further propose the Rational Vision-Language-Action model (RationalVLA). It is a dual system for robotic arms that integrates the high-level vision-language model with the low-level manipulation policy by introducing learnable latent space embeddings. This design enables RationalVLA to reason over instructions, reject infeasible commands, and execute manipulation effectively. Experiments demonstrate that RationalVLA outperforms state-of-the-art baselines on RAMA by a 14.5% higher success rate and 0.94 average task length, while maintaining competitive performance on standard manipulation tasks. Real-world trials further validate its effectiveness and robustness in practical applications. Our project page is https://irpn-eai.github.io/RationalVLA.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 47 of its 58 references that are in the map. First posted on arXiv 12 Jun 2025.
Builds on
47 of 58 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Visual Instruction Tuningcited by 7,869
- 2024GPT-4o System Cardcited by 4,588
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
35 more
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2021Dynamic Neural Networks: A Surveycited by 408
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
- 2020Language Conditioned Imitation Learning over Unstructured Datacited by 209
- 2024ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Modelscited by 205
- 2024Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillationcited by 166
- 2023Video Language Planningcited by 162
- 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 154
- 2022What Matters in Language Conditioned Robotic Imitation Learning over Unstructured Datacited by 138
- 2023RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketchescited by 133
- 2023Investigating the Catastrophic Forgetting in Multimodal Large Language Modelscited by 119
- 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representationscited by 116
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 103
- 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
- 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 82
- 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 75
- 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 73
- 2023QUAR-VLA: Vision-Language-Action Model for Quadruped Robotscited by 56
- 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulationcited by 51
- 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledgecited by 49
- 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLMcited by 44
- 2025Seeing Far and Clearly: Mitigating Hallucinations in MLLMs with Attention Causal Decodingcited by 43
- 2024From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Controlcited by 35
- 2024GeRM: A Generalist Robotic Model with Mixture-of-experts for Quadruped Robotcited by 29
- 2025MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Modelscited by 27
- 2023SARA-RT: Scaling up Robotics Transformers with Self-Adaptive Robust Attentioncited by 20
- 2022Interactive Imitation Learning of Bimanual Movement Primitivescited by 18
- 2021Learning Generalizable Vision-Tactile Robotic Grasping Strategy for Deformable Objects via Transformercited by 13
- 2024Navigating Beyond Instructions: Vision-and-Language Navigation in Obstructed Environmentscited by 10
Built on by
Citing papers per year: 2025: 8; 2026: 4.
12 papers.
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 84
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2025Unified Diffusion VLA: Vision-Language-Action Model via Joint Discrete Denoising Diffusion Processcited by 39
- 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decodingcited by 38
- 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baselinecited by 9
- 2025RoboOmni: Proactive Robot Manipulation in Omni-modal Contextcited by 8
- 2026RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulationcited by 8
- 2025End-to-end Listen, Look, Speak and Actcited by 5
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026PhysiFlow: Physics-Aware Humanoid Whole-Body VLA via Multi-Brain Latent Flow Matching and Robust Trackingcited by 1
- 2026HUGIN: Enhancing Vision-Language Planning for Autonomous Logistics Sortingcited by 0
- 2026HUGIN: Enhancing Vision-Language Planning for Autonomous Logistics Sorting12 Aug 2026
- 2026RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation11 Mar 2026
- 2026PhysiFlow: Physics-Aware Humanoid Whole-Body VLA via Multi-Brain Latent Flow Matching and Robust Tracking5 Mar 2026
- 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baseline26 Feb 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2025Unified Diffusion VLA: Vision-Language-Action Model via Joint Discrete Denoising Diffusion Process3 Nov 2025
- 2025RoboOmni: Proactive Robot Manipulation in Omni-modal Context27 Oct 2025
- 2025End-to-end Listen, Look, Speak and Act19 Oct 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug 2025
- 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decoding16 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
- 2025REALM: A Real-to-Sim Validated Benchmark for Generalization in Robotic Manipulation
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2026DAM-VLA: A Dynamic Action Model-Based Vision-Language-Action Framework for Robot Manipulation
- 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
- 2026PokeVLA: Empowering Pocket-Sized Vision-Language-Action Model with Comprehensive World Knowledge Guidance
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation
- 2025Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation