VLA-R1: Enhancing Reasoning in Vision-Language-Action Models
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack explicit step-by-step reasoning, instead emitting final actions without considering affordance constraints or geometric relations. Their post-training pipelines also rarely reinforce reasoning quality, relying primarily on supervised fine-tuning with weak reward design. To address these challenges, we present VLA-R1, a reasoning-enhanced VLA that integrates Reinforcement Learning from Verifiable Rewards (RLVR) with Group Relative Policy Optimization (GRPO) to systematically optimize both reasoning and execution. Specifically, we design an RLVR-based post-training strategy with verifiable rewards for region alignment, trajectory consistency, and output formatting, thereby strengthening reasoning robustness and execution accuracy. Moreover, we develop VLA-CoT-13K, a high-quality dataset that provides chain-of-thought supervision explicitly aligned with affordance and trajectory annotations. Furthermore, extensive evaluations on in-domain, out-of-domain, simulation, and real-robot platforms demonstrate that VLA-R1 achieves superior generalization and real-world performance compared to prior VLA methods. We plan to release the model, code, and dataset following the publication of this work. Code: https://github.com/GigaAI-research/VLA-R1. Website: https://gigaai-research.github.io/VLA-R1.
Key facts. Cited by 38 papers in the map (data through 13 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 37 of its 41 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
37 of 41 references.
References · 37
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
- 2023Visual Instruction Tuningcited by 7,827
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,247
- 2025Qwen2.5-VL Technical Reportcited by 5,499
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,389
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,191
- 2023Qwen Technical Reportcited by 3,310
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,022
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,692
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,699
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,362
25 more
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 857
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 739
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 678
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 520
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 348
- 2016Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updatescited by 342
- 2020Integrated Task and Motion Planningcited by 285
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 246
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 161
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 158
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 135
- 2023UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learningcited by 102
- 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
- 2022End-to-End Affordance Learning for Robotic Manipulationcited by 54
- 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understandingcited by 47
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
- 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
- 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modelingcited by 29
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Modelscited by 26
- 2023SparseDFF: Sparse-View Feature Distillation for One-Shot Dexterous Manipulationcited by 22
- 2024Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomaliescited by 19
- 2025DC-Scene: Data-Centric Learning for 3D Scene Understandingcited by 15
- 20253D CoCa: Contrastive Learners are 3D Captionerscited by 13
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 9
- 2025VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Potterycited by 6
Built on by
Citing papers per year: 2025: 7; 2026: 31.
38 papers.
Sort:
By area:
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 133
- 2026LaST0: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Modelcited by 28
- 2025SwiftVLA: Unlocking Spatiotemporal Dynamics for Lightweight VLA Models at Minimal Overheadcited by 25
- 2026Thinking with Blueprints: Assisting Vision-Language Models in Spatial Reasoning via Structured Object Representationcited by 21
- 2026Scaling World Model for Hierarchical Manipulation Policiescited by 16
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robotscited by 15
- 2026TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformerscited by 14
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulationcited by 13
- 2025EvoVLA: Self-Evolving Vision-Language-Action Modelcited by 11
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearchcited by 11
- 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoningcited by 7
- 2026GeoWorld: Geometric World Modelscited by 6
26 more
- 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policycited by 6
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
- 2026AnyDepth: Depth Estimation Made Easycited by 5
- 2026Towards a Theoretical Understanding to the Generalization of RLHFcited by 5
- 2026IG-RFT: An Interaction-Guided RL Framework for VLA Models in Long-Horizon Robotic Manipulationcited by 5
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoningcited by 5
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulationcited by 5
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Potterycited by 4
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligencecited by 3
- 2026Recursive Belief Vision Language Action Modelscited by 3
- 2026Let's Reward Step-by-Step: Step-Aware Contrastive Alignment for Vision-Language Navigation in Continuous Environmentscited by 3
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughtscited by 3
- 2025IRPO: Boosting Image Restoration via Post-training GRPOcited by 2
- 2026Z-1: Efficient Reinforcement Learning for Vision-Language-Action Modelscited by 2
- 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Modelscited by 1
- 2026Panoramic Affordance Predictioncited by 1
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learningcited by 1
- 2026Towards Precise Intent-Aligned VLA Aerial Navigation via Expert-Guided GRPOcited by 1
- 2026Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Modelscited by 1
- 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Modelscited by 1
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulationcited by 1
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimationcited by 0
- 2026Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Maskingcited by 0
- 2026EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modelingcited by 0
- 2026ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligencecited by 0
- 2026Demonstration-Free Success-Probability Reward Learning for Generalist Robot Policiescited by 0
- 2026Demonstration-Free Success-Probability Reward Learning for Generalist Robot Policies27 Sep 2026
- 2026ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligence16 Aug 2026
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulation17 Jul 2026
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch15 Jul 2026
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation7 Jul 2026
- 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Models5 Jul 2026
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts30 Jun 2026
- 2026Z-1: Efficient Reinforcement Learning for Vision-Language-Action Models30 Jun 2026
- 2026EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling25 Jun 2026
- 2026Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models13 Jun 2026
- 2026Towards Precise Intent-Aligned VLA Aerial Navigation via Expert-Guided GRPO1 Jun 2026
- 2026Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Masking15 May 2026
26 more
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learning12 May 2026
- 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policy8 May 2026
- 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning30 Apr 2026
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation29 Apr 2026
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar 2026
- 2026Panoramic Affordance Prediction16 Mar 2026
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning15 Mar 2026
- 2026Let's Reward Step-by-Step: Step-Aware Contrastive Alignment for Vision-Language Navigation in Continuous Environments10 Mar 2026
- 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Models10 Mar 2026
- 2026GeoWorld: Geometric World Models26 Feb 2026
- 2026IG-RFT: An Interaction-Guided RL Framework for VLA Models in Long-Horizon Robotic Manipulation24 Feb 2026
- 2026Recursive Belief Vision Language Action Models24 Feb 2026
- 2026Scaling World Model for Hierarchical Manipulation Policies11 Feb 2026
- 2026Towards a Theoretical Understanding to the Generalization of RLHF23 Jan 2026
- 2026TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformers20 Jan 2026
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligence10 Jan 2026
- 2026LaST0: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model8 Jan 2026
- 2026AnyDepth: Depth Estimation Made Easy6 Jan 2026
- 2026Thinking with Blueprints: Assisting Vision-Language Models in Spatial Reasoning via Structured Object Representation5 Jan 2026
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulation8 Dec 2025
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusion4 Dec 2025
- 2025SwiftVLA: Unlocking Spatiotemporal Dynamics for Lightweight VLA Models at Minimal Overhead30 Nov 2025
- 2025IRPO: Boosting Image Restoration via Post-training GRPO30 Nov 2025
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robots22 Nov 2025
- 2025EvoVLA: Self-Evolving Vision-Language-Action Model20 Nov 2025
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Pottery6 Oct 2025
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robotscited by 15
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulationcited by 13
- 2025EvoVLA: Self-Evolving Vision-Language-Action Modelcited by 11
- 2026IG-RFT: An Interaction-Guided RL Framework for VLA Models in Long-Horizon Robotic Manipulationcited by 5
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulationcited by 5
- 2026Recursive Belief Vision Language Action Modelscited by 3
- 2026Z-1: Efficient Reinforcement Learning for Vision-Language-Action Modelscited by 2
- 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Modelscited by 1
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulationcited by 1
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulation17 Jul 2026
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation7 Jul 2026
- 2026Z-1: Efficient Reinforcement Learning for Vision-Language-Action Models30 Jun 2026
- 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Models10 Mar 2026
- 2026IG-RFT: An Interaction-Guided RL Framework for VLA Models in Long-Horizon Robotic Manipulation24 Feb 2026
- 2026Recursive Belief Vision Language Action Models24 Feb 2026
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulation8 Dec 2025
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robots22 Nov 2025
- 2025EvoVLA: Self-Evolving Vision-Language-Action Model20 Nov 2025
- 2026LaST0: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Modelcited by 28
- 2026Thinking with Blueprints: Assisting Vision-Language Models in Spatial Reasoning via Structured Object Representationcited by 21
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoningcited by 5
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Potterycited by 4
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughtscited by 3
- 2026Towards Precise Intent-Aligned VLA Aerial Navigation via Expert-Guided GRPOcited by 1
- 2026Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Modelscited by 1
- 2026Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Maskingcited by 0
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts30 Jun 2026
- 2026Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models13 Jun 2026
- 2026Towards Precise Intent-Aligned VLA Aerial Navigation via Expert-Guided GRPO1 Jun 2026
- 2026Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Masking15 May 2026
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning15 Mar 2026
- 2026LaST0: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model8 Jan 2026
- 2026Thinking with Blueprints: Assisting Vision-Language Models in Spatial Reasoning via Structured Object Representation5 Jan 2026
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Pottery6 Oct 2025
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 133
- 2026Scaling World Model for Hierarchical Manipulation Policiescited by 16
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearchcited by 11
- 2026GeoWorld: Geometric World Modelscited by 6
- 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policycited by 6
- 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Modelscited by 1
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch15 Jul 2026
- 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Models5 Jul 2026
- 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policy8 May 2026
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar 2026
- 2026GeoWorld: Geometric World Models26 Feb 2026
- 2026Scaling World Model for Hierarchical Manipulation Policies11 Feb 2026
- 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoningcited by 7
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
- 2026AnyDepth: Depth Estimation Made Easycited by 5
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligencecited by 3
- 2026Let's Reward Step-by-Step: Step-Aware Contrastive Alignment for Vision-Language Navigation in Continuous Environmentscited by 3
- 2025IRPO: Boosting Image Restoration via Post-training GRPOcited by 2
- 2026Panoramic Affordance Predictioncited by 1
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimationcited by 0
- 2026EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modelingcited by 0
- 2026ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligencecited by 0
- 2026ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligence16 Aug 2026
- 2026EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling25 Jun 2026
- 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning30 Apr 2026
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation29 Apr 2026
- 2026Panoramic Affordance Prediction16 Mar 2026
- 2026Let's Reward Step-by-Step: Step-Aware Contrastive Alignment for Vision-Language Navigation in Continuous Environments10 Mar 2026
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligence10 Jan 2026
- 2026AnyDepth: Depth Estimation Made Easy6 Jan 2026
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusion4 Dec 2025
- 2025IRPO: Boosting Image Restoration via Post-training GRPO30 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025RLinf-VLA: A Unified and Efficient Framework for Reinforcement Learning of Vision-Language-Action Models
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
- 2026OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RL
- 2025Perception Before Reasoning: Two-Stage Reinforcement Learning for Visual Reasoning in Vision-Language Models
- 2025What Can RL Bring to VLA Generalization? An Empirical Study
- 2025Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
- 2025VL-GenRM: Enhancing Vision-Language Verification via Vision Experts and Iterative Training
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning