mlsanityData to 14 Oct 2026

CogAD: Cognitive-Hierarchy Guided End-to-End Autonomous Driving

arXiv 2505.21581 ↗First posted 27 May 2025cs.RO cs.CVcited by 4

On the map: End-to-end autonomous driving → Reasoning VLA and VLM driving policies

Abstract (arXiv)

While end-to-end autonomous driving has advanced significantly, prevailing methods remain fundamentally misaligned with human cognitive principles in both perception and planning. In this paper, we propose CogAD, a novel end-to-end autonomous driving model that emulates the hierarchical cognition mechanisms of human drivers. CogAD implements dual hierarchical mechanisms: global-to-local context processing for human-like perception and intent-conditioned multi-mode trajectory generation for cognitively-inspired planning. The proposed method demonstrates three principal advantages: comprehensive environmental understanding through hierarchical perception, robust planning exploration enabled by multi-level planning, and diverse yet reasonable multi-modal trajectory generation facilitated by dual-level uncertainty modeling. Extensive experiments on nuScenes and Bench2Drive demonstrate that CogAD achieves state-of-the-art performance in end-to-end planning, exhibiting particular superiority in long-tail scenarios and robust generalization to complex real-world driving conditions.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning VLA and VLM driving policies, one of 9 directions in End-to-end autonomous driving. Builds on 48 of its 62 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

48 of 62 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Divide and Merge: Motion and Semantic Learning in End-to-End Autonomous Driving11 Feb
  2. 2025Distilling Multi-modal Large Language Models for Autonomous Driving16 Jan
  3. 2024FASIONAD : FAst and Slow FusION Thinking Systems for Human-Like Autonomous Driving with Adaptive Feedback27 Nov
  4. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving29 Oct
  5. 2024Continuously Learning, Adapting, and Improving: A Dual-Process Approach to Autonomous Driving24 May

Other references · 43

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  4. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  5. 2022Planning-oriented Autonomous Drivingcited by 1,087
  6. 2016End to End Learning for Self-Driving Carscited by 1,009
  7. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  8. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  9. 2017End-to-end Driving via Conditional Imitation Learningcited by 485
  10. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
  11. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
  12. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
31 more
  1. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
  2. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
  3. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  4. 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
  5. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
  6. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  7. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  8. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
  9. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  10. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
  11. 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 166
  12. 2020Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representationscited by 153
  13. 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 126
  14. 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 120
  15. 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
  16. 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervisioncited by 86
  17. 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Drivingcited by 84
  18. 2016Stochastic Multiple Choice Learning for Training Diverse Deep Ensemblescited by 77
  19. 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Drivingcited by 67
  20. 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Drivingcited by 56
  21. 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 47
  22. 2024Asynchronous Large Language Model Enhanced Planner for Autonomous Drivingcited by 38
  23. 2025HiP-AD: Hierarchical and Multi-Granularity Planning with Deformable Attention for Autonomous Driving in a Single Decodercited by 35
  24. 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
  25. 2024End-to-End Autonomous Driving without Costly Modularization and 3D Manual Annotationcited by 28
  26. 2024DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiencescited by 27
  27. 2024DualAD: Disentangling the Dynamic and Static World for End-to-End Drivingcited by 17
  28. 2020Learning hierarchical behavior and motion planning for autonomous drivingcited by 15
  29. 2023FULLER: Unified Multi-modality Multi-task 3D Perception via Multi-level Gradient Calibrationcited by 13
  30. 2025VDT-Auto: End-to-end Autonomous Driving with VLM-Guided Diffusion Transformerscited by 12
  31. 2025M3Net: Multimodal Multi-task Learning for 3D Detection, Segmentation, and Occupancy Prediction in Autonomous Drivingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReAL-AD: Towards Human-Like Reasoning in End-to-End Autonomous Driving
  2. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving
  3. 2025Perception in Plan: Coupled Perception and Planning for End-to-End Autonomous Driving
  4. 2025LeapVAD: A Leap in Autonomous Driving via Cognitive Perception and Dual-Process Thinking
  5. 2026What Matters for Scalable and Robust Learning in End-to-End Driving Planners?
  6. 2026A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms
  7. 2025Constructing the Umwelt: Cognitive Planning through Belief-Intent Co-Evolution
  8. 2026Cognitive Dual-Process Planning for Autonomous Driving with Structured Scene Knowledge and Verifiable Reasoning-Action Consistency