Planning-Aware Diffusion Networks for Enhanced Motion Forecasting in Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Autonomous driving technology has seen significant advancements, but existing models often fail to fully capture the complexity of multi-agent environments, where interactions between dynamic agents are critical. To address this, we propose the Planning-Integrated Forecasting Model (PIFM), a novel framework inspired by neural mechanisms governing decision-making and multi-agent coordination in the brain. PIFM leverages rich contextual information, integrating road structures, traffic rules, and the behavior of surrounding vehicles to improve both the accuracy and interpretability of predictions. By adopting a diffusion-based architecture, akin to neural diffusion processes involved in predicting and planning, PIFM is able to forecast future trajectories of all agents within a scenario. This architecture enhances model transparency, as it parallels the brain's method of dynamically adjusting predictions based on external stimuli and other agents'behaviors. Extensive experiments validate PIFM's capacity to provide interpretable, neuroscience-driven solutions for safer and more efficient autonomous driving systems, with an extremely low number of parameters.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 23 references that are in the map. First posted on arXiv 25 Oct 2024.
Builds on
19 of 23 references.
References · 19
- 2018World Modelscited by 1,444
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2018Auxiliary Tasks in Multi-task Learningcited by 106
- 2020PiP: Planning-informed Trajectory Prediction for Autonomous Drivingcited by 80
7 more
- 2021Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Drivingcited by 73
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2020Trajectory Prediction in Autonomous Driving with a Lane Heading Auxiliary Losscited by 30
- 2023Tree-structured Policy Planning with Learned Behavior Modelscited by 24
- 2022LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Predictioncited by 19
- 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Predictioncited by 12
- 2022Holistic Transformer: A Joint Neural Network for Trajectory Prediction and Decision-Making of Autonomous Vehiclescited by 8
Built on by
Not cited yet.