mlsanityData to 14 Oct 2026

Fully Unified Motion Planning for End-to-End Autonomous Driving

arXiv 2504.12667 ↗First posted 17 Apr 2025cs.CVcited by 6

On the map: End-to-end autonomous driving → End-to-end system architecture

Abstract (arXiv)

Current end-to-end autonomous driving methods typically learn only from expert planning data collected from a single ego vehicle, severely limiting the diversity of learnable driving policies and scenarios. However, a critical yet overlooked fact is that in any driving scenario, multiple high-quality trajectories from other vehicles coexist with a specific ego vehicle's trajectory. Existing methods fail to fully exploit this valuable resource, missing important opportunities to improve the models' performance (including long-tail scenarios) through learning from other experts. Intuitively, Jointly learning from both ego and other vehicles' expert data is beneficial for planning tasks. However, this joint learning faces two critical challenges. (1) Different scene observation perspectives across vehicles hinder inter-vehicle alignment of scene feature representations; (2) The absence of partial modality in other vehicles' data (e.g., vehicle states) compared to ego-vehicle data introduces learning bias. To address these challenges, we propose FUMP (Fully Unified Motion Planning), a novel two-stage trajectory generation framework. Building upon probabilistic decomposition, we model the planning task as a specialized subtask of motion prediction. Specifically, our approach decouples trajectory planning into two stages. In Stage 1, a shared decoder jointly generates initial trajectories for both tasks. In Stage 2, the model performs planning-specific refinement conditioned on an ego-vehicle's state. The transition between the two stages is bridged by a state predictor trained exclusively on ego-vehicle data. To address the cross-vehicle discrepancy in observational perspectives, we propose an Equivariant Context-Sharing Adapter (ECSA) before Stage 1 for improving cross-vehicle generalization of scene representations.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 54 of its 71 references that are in the map. First posted on arXiv 17 Apr 2025.

Builds on

54 of 71 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
  2. 2025DiffAD: A Unified Diffusion Modeling Approach for Autonomous Driving15 Mar
  3. 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Driving5 Mar
  4. 2024DeepInteraction++: Multi-Modality Interaction for Autonomous Driving9 Aug
  5. 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mamba7 Aug
  6. 2024End-to-End Autonomous Driving without Costly Modularization and 3D Manual Annotation25 Jun
  7. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
  8. 2024DualAD: Disentangling the Dynamic and Static World for End-to-End Driving10 Jun
  9. 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun
  10. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May
  11. 2024M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving19 Mar
  12. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?5 Dec
7 more
  1. 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving2 Aug
  2. 2023DriveAdapter: Breaking the Coupling Barrier of Perception and Planning in End-to-End Autonomous Driving1 Aug
  3. 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Driving10 May
  4. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul
  5. 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline16 Jun
  6. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
  7. 2021End-to-end Interpretable Neural Motion Planner17 Jan

Other references · 35

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  2. 2022Planning-oriented Autonomous Drivingcited by 1,087
  3. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  4. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  5. 2017End-to-end Driving via Conditional Imitation Learningcited by 485
  6. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  7. 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 346
  8. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
  9. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
  10. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  11. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
  12. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
23 more
  1. 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 212
  2. 2023Scene as Occupancycited by 209
  3. 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
  4. 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 194
  5. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  6. 2022Learning from All Vehiclescited by 135
  7. 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 114
  8. 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
  9. 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 93
  10. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 93
  11. 2022Differentiable Raycasting for Self-supervised Occupancy Forecastingcited by 84
  12. 2024Learning and Leveraging World Models in Visual Representation Learningcited by 72
  13. 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 64
  14. 2020End-to-end Contextual Perception and Prediction with Interaction Transformercited by 54
  15. 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
  16. 2018Hierarchical Game-Theoretic Planning for Autonomous Vehiclescited by 48
  17. 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
  18. 2020GRIP: A Graph Neural Network Accelerator Architecturecited by 37
  19. 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
  20. 2021Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Modelscited by 22
  21. 2021Learning by Watchingcited by 22
  22. 2024ComDrive: Comfort-Oriented End-to-End Autonomous Drivingcited by 11
  23. 2025Int2Planner: An Intention-based Multi-modal Motion Planner for Integrated Prediction and Planningcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling
  2. 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Review
  3. 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
  4. 2025FocalAD: Local Motion Planning for End-to-End Autonomous Driving
  5. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
  6. 2025UniUGP: Unifying Understanding, Generation, and Planing For End-to-end Autonomous Driving
  7. 2025DAP: A Discrete-token Autoregressive Planner for Autonomous Driving
  8. 2026ProDrive: Proactive Planning for Autonomous Driving via Ego-Environment Co-Evolution