Diverse Multiple Trajectory Prediction Using a Two-stage Prediction Network Trained with Lane Loss
Not on the map. Why?
Abstract (arXiv)
Prior arts in the field of motion predictions for autonomous driving tend to focus on finding a trajectory that is close to the ground truth trajectory. Such problem formulations and approaches, however, frequently lead to loss of diversity and biased trajectory predictions. Therefore, they are unsuitable for real-world autonomous driving where diverse and road-dependent multimodal trajectory predictions are critical for safety. To this end, this study proposes a novel loss function, textitLane Loss, that ensures map-adaptive diversity and accommodates geometric constraints. A two-stage trajectory prediction architecture with a novel trajectory candidate proposal module, textitTrajectory Prediction Attention (TPA), is trained with Lane Loss encourages multiple trajectories to be diversely distributed, covering feasible maneuvers in a map-aware manner. Furthermore, considering that the existing trajectory performance metrics are focusing on evaluating the accuracy based on the ground truth future trajectory, a quantitative evaluation metric is also suggested to evaluate the diversity of predicted multiple trajectories. The experiments performed on the Argoverse dataset show that the proposed method significantly improves the diversity of the predicted trajectories without sacrificing the prediction accuracy.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 34 of its 39 references that are in the map. First posted on arXiv 17 Jun 2022.
Builds on
34 of 39 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2015Fast R-CNNcited by 2,930
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
22 more
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2016Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypothesescited by 96
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2019Diverse Trajectory Forecasting with Determinantal Point Processescited by 80
- 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
- 2020What-If Motion Prediction for Autonomous Drivingcited by 80
- 2020Diverse and Admissible Trajectory Forecasting through Multimodal Context Understandingcited by 68
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2019DiversityGAN: Diversity-Aware Vehicle Motion Prediction via Latent Semantic Samplingcited by 40
- 2021Divide-and-Conquer for Lane-Aware Diverse Trajectory Predictioncited by 37
- 2019Analyzing the Variety Loss in the Context of Probabilistic Trajectory Predictioncited by 30
- 2020Trajectory Prediction in Autonomous Driving with a Lane Heading Auxiliary Losscited by 30
- 2020Probabilistic Multi-modal Trajectory Prediction with Lane Attention for Autonomous Vehiclescited by 28
- 2020The Importance of Prior Knowledge in Precise Multimodal Predictioncited by 25
- 2020Trajectory Prediction for Autonomous Driving based on Multi-Head Attention with Joint Agent-Map Representationcited by 12
- 2019Lane Attention: Predicting Vehicles' Moving Trajectories by Learning Their Attention over Lanescited by 9
- 2020Motion Prediction using Trajectory Sets and Self-Driving Domain Knowledgecited by 8
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 3; 2026: 1.
12 papers.
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Followingcited by 41
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2025Diverse Controllable Diffusion Policy with Signal Temporal Logiccited by 8
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Networkcited by 6
- 2024MS-Net: A Multi-Path Sparse Model for Motion Prediction in Multi-Scenescited by 4
- 2023Efficient Baselines for Motion Prediction in Autonomous Drivingcited by 3
- 2024ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Drivingcited by 3
- 2024Perception Without Vision for Trajectory Prediction: Ego Vehicle Dynamics as Scene Representation for Efficient Active Learning in Autonomous Drivingcited by 2
- 2025Marginalized Generalized IoU (MGIoU): A Unified Objective Function for Optimizing Any Convex Parametric Shapescited by 2
- 2025Dynamic Risk Assessment for Autonomous Vehicles from Spatio-Temporal Probabilistic Occupancy Heatmapscited by 1
- 2026Adjustment of Cluster-Then-Predict Framework for Multiport Scatterer Load Predictioncited by 0
- 2026Adjustment of Cluster-Then-Predict Framework for Multiport Scatterer Load Prediction8 Feb 2026
- 2025Marginalized Generalized IoU (MGIoU): A Unified Objective Function for Optimizing Any Convex Parametric Shapes23 Apr 2025
- 2025Diverse Controllable Diffusion Policy with Signal Temporal Logic4 Mar 2025
- 2025Dynamic Risk Assessment for Autonomous Vehicles from Spatio-Temporal Probabilistic Occupancy Heatmaps27 Jan 2025
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Network26 Jul 2024
- 2024Perception Without Vision for Trajectory Prediction: Ego Vehicle Dynamics as Scene Representation for Efficient Active Learning in Autonomous Driving15 May 2024
- 2024ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving25 Mar 2024
- 2024MS-Net: A Multi-Path Sparse Model for Motion Prediction in Multi-Scenes1 Mar 2024
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following9 Feb 2024
- 2023Efficient Baselines for Motion Prediction in Autonomous Driving6 Sep 2023
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2023Vision-based Multi-future Trajectory Prediction: A Survey21 Feb 2023