mlsanityData to 14 Oct 2026

GRAVA: Grounded Reasoning-to-Action Representation and Learning for Autonomous Driving

arXiv 2609.15169 ↗First posted 14 Sep 2026cs.CV cs.ROcited by 0

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Driving vision-language-action (VLA) models increasingly reason before acting, but their intermediate reasoning is often weakly grounded in physical scene evidence and loosely connected to executable behavior. We present GRAVA, a framework built around Grounded Reasoning-to-Action (GRA), which unifies grounding, reasoning, and action generation in a single autoregressive stream. GRA links action-relevant language references to 2D visual regions and ego-centric physical states, organizes object interactions and decisions in a trajectory-anchored typed graph, and serializes this structure into grounded reasoning. A single VLM generates this reasoning followed by a compact Executable Planner action that is deterministically decoded into a continuous trajectory. We further introduce an agentic GRA data construction pipeline that combines forward scene grounding with backward trajectory anchoring, and use it to build GR-NavSim with 2.2M grounded question-answer pairs and 70K GRA reasoning traces. A progressive training strategy develops grounded cognition through pre-training, establishes the reasoning-to-action interface through imitation, and improves driving behavior through reinforcement learning and exploration. Using about 60% of the available human driving demonstrations for action supervision, GRAVA-8B achieves state-of-the-art performance among purely autoregressive driving models on the full NAVSIM benchmark. On an internal long-tail benchmark, full GRA improves key-object compliance and Closed-loop Driving Score by 19.3% and 20.5% over action-only prediction, respectively. These results show the benefit of preserving action-relevant physical evidence from grounded reasoning through executable action generation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 64 of its 81 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

64 of 81 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving3 Apr
  2. 2026Unifying Language-Action Understanding and Generation for Autonomous Driving2 Mar
  3. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
  4. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  5. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
  6. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model30 Mar

Other references · 58

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  9. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  10. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
  11. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  12. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
38 more
  1. 2022Planning-oriented Autonomous Drivingcited by 1,087
  2. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  3. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
  4. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
  5. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  7. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  8. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  9. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
  10. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  11. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
  12. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  13. 2017End-to-end Driving via Conditional Imitation Learningcited by 485
  14. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
  15. 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 485
  16. 2019Learning by Cheatingcited by 383
  17. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
  18. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
  19. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
  20. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
  21. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
  22. 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
  23. 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 248
  24. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
  25. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
  26. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
  27. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
  28. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  29. 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 150
  30. 2025Pseudo-Simulation for Autonomous Drivingcited by 150
  31. 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 145
  32. 2019Talk2Car: Taking Control of Your Self-Driving Carcited by 142
  33. 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
  34. 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
  35. 2023Visual Point Cloud Forecasting enables Scalable Autonomous Drivingcited by 99
  36. 2025ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Drivingcited by 67
  37. 2023Trajeglish: Traffic Modeling as Next-Token Predictioncited by 60
  38. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 58

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Grounding What Shapes the Plan: Rethinking Groundedness for Physical Intelligence in Autonomous Driving
  2. 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
  3. 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
  4. 2026AnchorReasoning: A Visual Grounding and Causal Reasoning Dataset in Long-Tail Autonomous Driving Scenarios
  5. 2026DriveMA: Rethinking Language Interfaces in Driving VLAs with One-Step Meta-Actions
  6. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
  7. 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving
  8. 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving