mlsanityData to 13 Oct 2026

VLA-R1: Enhancing Reasoning in Vision-Language-Action Models

arXiv 2510.01623 ↗First posted 2 Oct 2025cs.CV cs.ROcited by 38

On the map: Vision-language-action models → Reinforcement learning and post-training

Abstract (arXiv)

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack explicit step-by-step reasoning, instead emitting final actions without considering affordance constraints or geometric relations. Their post-training pipelines also rarely reinforce reasoning quality, relying primarily on supervised fine-tuning with weak reward design. To address these challenges, we present VLA-R1, a reasoning-enhanced VLA that integrates Reinforcement Learning from Verifiable Rewards (RLVR) with Group Relative Policy Optimization (GRPO) to systematically optimize both reasoning and execution. Specifically, we design an RLVR-based post-training strategy with verifiable rewards for region alignment, trajectory consistency, and output formatting, thereby strengthening reasoning robustness and execution accuracy. Moreover, we develop VLA-CoT-13K, a high-quality dataset that provides chain-of-thought supervision explicitly aligned with affordance and trajectory annotations. Furthermore, extensive evaluations on in-domain, out-of-domain, simulation, and real-robot platforms demonstrate that VLA-R1 achieves superior generalization and real-world performance compared to prior VLA methods. We plan to release the model, code, and dataset following the publication of this work. Code: https://github.com/GigaAI-research/VLA-R1. Website: https://gigaai-research.github.io/VLA-R1.

Key facts. Cited by 38 papers in the map (data through 13 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 37 of its 41 references that are in the map. First posted on arXiv 2 Oct 2025.

Builds on

37 of 41 references.

References · 37

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
  2. 2023Visual Instruction Tuningcited by 7,827
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,247
  4. 2025Qwen2.5-VL Technical Reportcited by 5,499
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,389
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,191
  7. 2023Qwen Technical Reportcited by 3,310
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,022
  9. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
  10. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,692
  11. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,699
  12. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,362
25 more
  1. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 857
  2. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 739
  3. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 678
  4. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 520
  5. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 348
  6. 2016Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updatescited by 342
  7. 2020Integrated Task and Motion Planningcited by 285
  8. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 246
  9. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 161
  10. 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 158
  11. 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 135
  12. 2023UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learningcited by 102
  13. 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
  14. 2022End-to-End Affordance Learning for Robotic Manipulationcited by 54
  15. 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understandingcited by 47
  16. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
  17. 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
  18. 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modelingcited by 29
  19. 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Modelscited by 26
  20. 2023SparseDFF: Sparse-View Feature Distillation for One-Shot Dexterous Manipulationcited by 22
  21. 2024Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomaliescited by 19
  22. 2025DC-Scene: Data-Centric Learning for 3D Scene Understandingcited by 15
  23. 20253D CoCa: Contrastive Learners are 3D Captionerscited by 13
  24. 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 9
  25. 2025VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Potterycited by 6

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 7; 2026: 31.

38 papers.

Sort:

By area:

  1. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 133
  2. 2026LaST0: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Modelcited by 28
  3. 2025SwiftVLA: Unlocking Spatiotemporal Dynamics for Lightweight VLA Models at Minimal Overheadcited by 25
  4. 2026Thinking with Blueprints: Assisting Vision-Language Models in Spatial Reasoning via Structured Object Representationcited by 21
  5. 2026Scaling World Model for Hierarchical Manipulation Policiescited by 16
  6. 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robotscited by 15
  7. 2026TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformerscited by 14
  8. 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulationcited by 13
  9. 2025EvoVLA: Self-Evolving Vision-Language-Action Modelcited by 11
  10. 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearchcited by 11
  11. 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoningcited by 7
  12. 2026GeoWorld: Geometric World Modelscited by 6
26 more
  1. 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policycited by 6
  2. 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
  3. 2026AnyDepth: Depth Estimation Made Easycited by 5
  4. 2026Towards a Theoretical Understanding to the Generalization of RLHFcited by 5
  5. 2026IG-RFT: An Interaction-Guided RL Framework for VLA Models in Long-Horizon Robotic Manipulationcited by 5
  6. 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoningcited by 5
  7. 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulationcited by 5
  8. 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Potterycited by 4
  9. 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligencecited by 3
  10. 2026Recursive Belief Vision Language Action Modelscited by 3
  11. 2026Let's Reward Step-by-Step: Step-Aware Contrastive Alignment for Vision-Language Navigation in Continuous Environmentscited by 3
  12. 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughtscited by 3
  13. 2025IRPO: Boosting Image Restoration via Post-training GRPOcited by 2
  14. 2026Z-1: Efficient Reinforcement Learning for Vision-Language-Action Modelscited by 2
  15. 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Modelscited by 1
  16. 2026Panoramic Affordance Predictioncited by 1
  17. 2026Driving Intents Amplify Planning-Oriented Reinforcement Learningcited by 1
  18. 2026Towards Precise Intent-Aligned VLA Aerial Navigation via Expert-Guided GRPOcited by 1
  19. 2026Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Modelscited by 1
  20. 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Modelscited by 1
  21. 2026IMBench: A Benchmark for Intuitive Robotic Manipulationcited by 1
  22. 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimationcited by 0
  23. 2026Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Maskingcited by 0
  24. 2026EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modelingcited by 0
  25. 2026ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligencecited by 0
  26. 2026Demonstration-Free Success-Probability Reward Learning for Generalist Robot Policiescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025RLinf-VLA: A Unified and Efficient Framework for Reinforcement Learning of Vision-Language-Action Models
  2. 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
  3. 2026OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RL
  4. 2025Perception Before Reasoning: Two-Stage Reinforcement Learning for Visual Reasoning in Vision-Language Models
  5. 2025What Can RL Bring to VLA Generalization? An Empirical Study
  6. 2025Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  7. 2025VL-GenRM: Enhancing Vision-Language Verification via Vision Experts and Iterative Training
  8. 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning