Addressing the Waypoint-Action Gap in End-to-End Autonomous Driving via Vehicle Motion Models
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake. Most recent benchmark protocols and training pipelines are waypoint-based, which makes action-based policies harder to train and compare, slowing their progress. To bridge this waypoint-action gap, we propose a novel, differentiable vehicle-model framework that rolls out predicted action sequences to their corresponding ego-frame waypoint trajectories while supervising in waypoint space. Our approach enables action-based architectures to be trained and evaluated, for the first time, within waypoint-based benchmarks without modifying the underlying evaluation protocol. We extensively evaluate our framework across multiple challenging benchmarks and observe consistent improvements over the baselines. In particular, on NAVSIM textttnavhard our approach achieves state-of-the-art performance. Our code will be made publicly available upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 24 of its 39 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
24 of 39 references.
Closest ancestors · 7
Same direction, newest first
- 2025Interpretable Decision-Making for End-to-End Autonomous Driving26 Aug
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Driving7 Mar
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun
- 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
Other references · 17
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 391
- 2019Learning by Cheatingcited by 361
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 191
- 2022Model-Based Imitation Learning for Urban Drivingcited by 149
5 more
- 2025Pseudo-Simulation for Autonomous Drivingcited by 141
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradientscited by 95
- 2018On Offline Evaluation of Vision-based Driving Modelscited by 62
- 2023Scaling Vision-based End-to-End Driving with Multi-View Attention Learningcited by 8
- 2024Guiding Attention in End-to-End Driving Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Review
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline
- 2026Multimodal Action Diffusion for Robust End-to-End Autonomous Driving
- 2026Post-Training in End-to-End Autonomous Driving
- 2025Foundation Models for Trajectory Planning in Autonomous Driving: A Review of Progress and Open Challenges