Exploring Map-based Features for Efficient Attention-based Vehicle Motion Prediction
Not on the map. Why?
Abstract (arXiv)
Motion prediction (MP) of multiple agents is a crucial task in arbitrarily complex environments, from social robots to self-driving cars. Current approaches tackle this problem using end-to-end networks, where the input data is usually a rendered top-view of the scene and the past trajectories of all the agents; leveraging this information is a must to obtain optimal performance. In that sense, a reliable Autonomous Driving (AD) system must produce reasonable predictions on time, however, despite many of these approaches use simple ConvNets and LSTMs, models might not be efficient enough for real-time applications when using both sources of information (map and trajectory history). Moreover, the performance of these models highly depends on the amount of training data, which can be expensive (particularly the annotated HD maps). In this work, we explore how to achieve competitive performance on the Argoverse 1.0 Benchmark using efficient attention-based models, which take as input the past trajectories and map-based features from minimal map information to ensure efficient and reliable MP. These features represent interpretable information as the driveable area and plausible goal points, in opposition to black-box CNN-based methods for map processing.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 63 references that are in the map. First posted on arXiv 25 May 2022.
Builds on
48 of 63 references.
References · 48
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
36 more
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
- 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 147
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2020Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?cited by 139
- 2019The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersectionscited by 137
- 2018Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networkscited by 129
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2021Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradientscited by 122
- 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2019Multimodal End-to-End Autonomous Drivingcited by 110
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2019Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecastingcited by 87
- 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
- 2021SafetyNet: Safe planning for real-world self-driving vehicles using machine-learned policiescited by 68
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2020Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimationcited by 57
- 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
- 2019Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMscited by 34
- 2020Understanding Bird's-Eye View of Road Semantics using an Onboard Cameracited by 29
- 2020Trajectory Prediction using Equivariant Continuous Convolutioncited by 26
- 2021Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertaintycited by 19
- 2021DenseTNT: Waymo Open Dataset Motion Prediction Challenge 1st Place Solutioncited by 14
- 2021MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagationcited by 14
- 2021Decoder Fusion RNN: Context and Interaction Aware Decoders for Trajectory Predictioncited by 12
- 20173DOF Pedestrian Trajectory Prediction Learned from Long-Term Autonomous Mobile Robot Deployment Datacited by 11
- 2021Exploring Social Posterior Collapse in Variational Autoencoder for Interaction Modelingcited by 11
- 2021Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Networkcited by 6
- 2019Multi-attention Networks for Temporal Localization of Video-level Labelscited by 4
- 2021Conditional Generative Adversarial Networks for Speed Control in Trajectory Simulationcited by 2
Built on by
Citing papers per year: 2022: 1.
1 paper.
- 2022Exploring Attention GAN for Vehicle Motion Predictioncited by 6
- 2022Exploring Attention GAN for Vehicle Motion Prediction26 Sep 2022