mlsanityData to 7 Oct 2026

ReAL-AD: Towards Human-Like Reasoning in End-to-End Autonomous Driving

arXiv 2507.12499 ↗First posted 16 Jul 2025cs.RO cs.LGcited by 15

On the map: LLM reasoning → Chain-of-thought reasoning for driving

also in 1 more
Abstract (arXiv)

End-to-end autonomous driving has emerged as a promising approach to unify perception, prediction, and planning within a single framework, reducing information loss and improving adaptability. However, existing methods often rely on fixed and sparse trajectory supervision, limiting their ability to capture the hierarchical reasoning process that human drivers naturally employ. To bridge this gap, we propose ReAL-AD, a Reasoning-Augmented Learning framework that structures decision-making in autonomous driving based on the three-tier human cognitive model: Driving Strategy, Driving Decision, and Driving Operation, where Vision-Language Models (VLMs) are incorporated to enhance situational awareness and structured reasoning across these levels. Specifically, we introduce: (1) the Strategic Reasoning Injector, which formulates high-level driving strategies by interpreting complex traffic contexts from VLM-generated insights; (2) the Tactical Reasoning Integrator, which refines strategic intent into interpretable tactical choices such as lane changes, overtaking, and speed adjustments; and (3) the Hierarchical Trajectory Decoder, which progressively translates tactical decisions into precise control actions for smooth and human-like trajectory execution. Extensive evaluations show that integrating our framework improves planning accuracy and safety by over 30%, making end-to-end autonomous driving more interpretable and aligned with human-like hierarchical reasoning. The project page can be found at: hrefhttps://4dvlab.github.io/projectpage/realadtexttt4dvlab.github.io/projectpage/realad

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 30 of its 58 references that are in the map. First posted on arXiv 16 Jul 2025.

Builds on

30 of 58 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision19 Dec
  2. 2024FASIONAD : FAst and Slow FusION Thinking Systems for Human-Like Autonomous Driving with Adaptive Feedback27 Nov
  3. 2024OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning2 May

Other references · 27

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  3. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
  4. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
  5. 2024Yi: Open Foundation Models by 01.AIcited by 706
  6. 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 704
  7. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
  8. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  9. 2023GPT-Driver: Learning to Drive with GPTcited by 344
  10. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  11. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  12. 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 250
15 more
  1. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
  2. 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
  3. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  4. 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 204
  5. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
  6. 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
  7. 2023A Language Agent for Autonomous Drivingcited by 161
  8. 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 161
  9. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  10. 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 129
  11. 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Drivingcited by 93
  12. 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Drivingcited by 55
  13. 2024Navigation-Guided Sparse Scene Representation for End-to-End Autonomous Drivingcited by 46
  14. 2024DriveGPT: Scaling Autoregressive Behavior Models for Drivingcited by 29
  15. 2024End-to-End Autonomous Driving without Costly Modularization and 3D Manual Annotationcited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 9.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms
  2. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving
  3. 2024DualAD: Dual-Layer Planning for Reasoning in Autonomous Driving
  4. 2025VERDI: VLM-Embedded Reasoning for Autonomous Driving
  5. 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Models
  6. 2025DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving
  7. 2024WiseAD: Knowledge Augmented End-to-End Autonomous Driving with Vision-Language Model
  8. 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving