Fully Unified Motion Planning for End-to-End Autonomous Driving
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
Current end-to-end autonomous driving methods typically learn only from expert planning data collected from a single ego vehicle, severely limiting the diversity of learnable driving policies and scenarios. However, a critical yet overlooked fact is that in any driving scenario, multiple high-quality trajectories from other vehicles coexist with a specific ego vehicle's trajectory. Existing methods fail to fully exploit this valuable resource, missing important opportunities to improve the models' performance (including long-tail scenarios) through learning from other experts. Intuitively, Jointly learning from both ego and other vehicles' expert data is beneficial for planning tasks. However, this joint learning faces two critical challenges. (1) Different scene observation perspectives across vehicles hinder inter-vehicle alignment of scene feature representations; (2) The absence of partial modality in other vehicles' data (e.g., vehicle states) compared to ego-vehicle data introduces learning bias. To address these challenges, we propose FUMP (Fully Unified Motion Planning), a novel two-stage trajectory generation framework. Building upon probabilistic decomposition, we model the planning task as a specialized subtask of motion prediction. Specifically, our approach decouples trajectory planning into two stages. In Stage 1, a shared decoder jointly generates initial trajectories for both tasks. In Stage 2, the model performs planning-specific refinement conditioned on an ego-vehicle's state. The transition between the two stages is bridged by a state predictor trained exclusively on ego-vehicle data. To address the cross-vehicle discrepancy in observational perspectives, we propose an Equivariant Context-Sharing Adapter (ECSA) before Stage 1 for improving cross-vehicle generalization of scene representations.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 54 of its 71 references that are in the map. First posted on arXiv 17 Apr 2025.
Builds on
54 of 71 references.
Closest ancestors · 19
Same direction, newest first
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2025DiffAD: A Unified Diffusion Modeling Approach for Autonomous Driving15 Mar
- 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Driving5 Mar
- 2024DeepInteraction++: Multi-Modality Interaction for Autonomous Driving9 Aug
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mamba7 Aug
- 2024End-to-End Autonomous Driving without Costly Modularization and 3D Manual Annotation25 Jun
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
- 2024DualAD: Disentangling the Dynamic and Static World for End-to-End Driving10 Jun
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May
- 2024M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving19 Mar
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?5 Dec
7 more
- 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving2 Aug
- 2023DriveAdapter: Breaking the Coupling Barrier of Perception and Planning in End-to-End Autonomous Driving1 Aug
- 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Driving10 May
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline16 Jun
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
- 2021End-to-end Interpretable Neural Motion Planner17 Jan
Other references · 35
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2017End-to-end Driving via Conditional Imitation Learningcited by 485
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 346
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
23 more
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 212
- 2023Scene as Occupancycited by 209
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
- 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 194
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2022Learning from All Vehiclescited by 135
- 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 114
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 93
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 93
- 2022Differentiable Raycasting for Self-supervised Occupancy Forecastingcited by 84
- 2024Learning and Leveraging World Models in Visual Representation Learningcited by 72
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 64
- 2020End-to-end Contextual Perception and Prediction with Interaction Transformercited by 54
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2018Hierarchical Game-Theoretic Planning for Autonomous Vehiclescited by 48
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
- 2020GRIP: A Graph Neural Network Accelerator Architecturecited by 37
- 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
- 2021Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Modelscited by 22
- 2021Learning by Watchingcited by 22
- 2024ComDrive: Comfort-Oriented End-to-End Autonomous Drivingcited by 11
- 2025Int2Planner: An Intention-based Multi-modal Motion Planner for Integrated Prediction and Planningcited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Drivingcited by 26
- 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Drivingcited by 17
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 17
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Drivingcited by 6
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Drivingcited by 0
- 2026MomWorld: Momentum-Aware Latent World Model for Long-Horizon Autonomous Drivingcited by 0
- 2026MomWorld: Momentum-Aware Latent World Model for Long-Horizon Autonomous Driving27 Sep 2026
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Driving16 Aug 2026
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving15 Jun 2026
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May 2026
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Driving31 Mar 2026
- 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Driving5 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Review
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
- 2025FocalAD: Local Motion Planning for End-to-End Autonomous Driving
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
- 2025UniUGP: Unifying Understanding, Generation, and Planing For End-to-end Autonomous Driving
- 2025DAP: A Discrete-token Autoregressive Planner for Autonomous Driving
- 2026ProDrive: Proactive Planning for Autonomous Driving via Ego-Environment Co-Evolution