Jointly Learning Agent and Lane Information for Multimodal Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Predicting the plausible future trajectories of nearby agents is a core challenge for the safety of Autonomous Vehicles and it mainly depends on two external cues: the dynamic neighbor agents and static scene context. Recent approaches have made great progress in characterizing the two cues separately. However, they ignore the correlation between the two cues and most of them are difficult to achieve map-adaptive prediction. In this paper, we use lane as scene data and propose a staged network that Jointly learning Agent and Lane information for Multimodal Trajectory Prediction (JAL-MTP). JAL-MTP use a Social to Lane (S2L) module to jointly represent the static lane and the dynamic motion of the neighboring agents as instance-level lane, a Recurrent Lane Attention (RLA) mechanism for utilizing the instance-level lanes to predict the map-adaptive future trajectories and two selectors to identify the typical and reasonable trajectories. The experiments conducted on the public Argoverse dataset demonstrate that JAL-MTP significantly outperforms the existing models in both quantitative and qualitative.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 28 references that are in the map. First posted on arXiv 26 Nov 2021.
Builds on
27 of 28 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
- 2020TNT: Target-driveN Trajectory Predictioncited by 347
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 298
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 254
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
- 2020Implicit Latent Variable Model for Scene-Consistent Motion Forecastingcited by 116
15 more
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 113
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 113
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2020What-If Motion Prediction for Autonomous Drivingcited by 80
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2021Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Drivingcited by 73
- 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2020Map-Adaptive Goal-Based Trajectory Predictioncited by 30
- 2020Probabilistic Multi-modal Trajectory Prediction with Lane Attention for Autonomous Vehiclescited by 28
- 2020ReCoG: A Deep Learning Framework with Heterogeneous Graph for Interaction-Aware Trajectory Predictioncited by 20
- 2020SCALE-Net: Scalable Vehicle Trajectory Prediction Network under Random Number of Interacting Vehicles via Edge-enhanced Graph Convolutional Neural Networkcited by 18
- 2021SCOUT: Socially-COnsistent and UndersTandable Graph Attention Network for Trajectory Prediction of Vehicles and VRUscited by 16
- 2019Lane Attention: Predicting Vehicles' Moving Trajectories by Learning Their Attention over Lanescited by 9
Built on by
Not cited yet.