PIE: Perception and Interaction Enhanced End-to-End Motion Planning for Autonomous Driving
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
End-to-end motion planning is promising for simplifying complex autonomous driving pipelines. However, challenges such as scene understanding and effective prediction for decision-making continue to present substantial obstacles to its large-scale deployment. In this paper, we present PIE, a pioneering framework that integrates advanced perception, reasoning, and intention modeling to dynamically capture interactions between the ego vehicle and surrounding agents. It incorporates a bidirectional Mamba fusion that addresses data compression losses in multimodal fusion of camera and LiDAR inputs, alongside a novel reasoning-enhanced decoder integrating Mamba and Mixture-of-Experts to facilitate scene-compliant anchor selection and optimize adaptive trajectory inference. PIE adopts an action-motion interaction module to effectively utilize state predictions of surrounding agents to refine ego planning. The proposed framework is thoroughly validated on the NAVSIM benchmark. PIE, without using any ensemble and data augmentation techniques, achieves an 88.9 PDM score and 85.6 EPDM score, surpassing the performance of prior state-of-the-art methods. Comprehensive quantitative and qualitative analyses demonstrate that PIE is capable of reliably generating feasible and high-quality ego trajectories.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 32 of its 39 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
32 of 39 references.
Closest ancestors · 12
Same direction, newest first
- 2025GaussianFusion: Gaussian-Based Multi-Sensor Fusion for End-to-End Autonomous Driving27 May
- 2025ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Driving28 Apr
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillation17 Mar
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mamba7 Aug
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?5 Dec
- 2022Safe Real-World Autonomous Driving by Learning to Predict and Plan with a Mixture of Experts3 Nov
- 2022Long-Tail Prediction Uncertainty Aware Trajectory Planning for Self-driving Vehicles2 Jul
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 20
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2021Scaling Vision with Sparse Mixture of Expertscited by 747
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2024Jamba: A Hybrid Transformer-Mamba Language Modelcited by 401
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
8 more
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
- 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 112
- 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
- 2024TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecastingcited by 64
- 2024DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Modelscited by 22
- 2024ControlMTR: Control-Guided Motion Transformer with Scene-Compliant Intention Points for Feasible Motion Predictioncited by 13
- 2024Uncertainty-Aware Prediction and Application in Planning for Autonomous Driving: Definitions, Methods, and Comparisoncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Decoupling Scene Perception and Ego Status: A Multi-Context Fusion Approach for Enhanced Generalization in End-to-End Autonomous Driving
- 2024EgoFSD: Ego-Centric Fully Sparse Paradigm with Uncertainty Denoising and Iterative Refinement for Efficient End-to-End Self-Driving
- 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Driving
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling
- 2025FocalAD: Local Motion Planning for End-to-End Autonomous Driving
- 2025Fully Unified Motion Planning for End-to-End Autonomous Driving
- 2024doScenes: An Autonomous Driving Dataset with Natural Language Instruction for Human Interaction and Vision-Language Navigation
- 2026FlowAD: Ego-Scene Interactive Modeling for Autonomous Driving