mlsanityData to 7 Oct 2026

Exploring Map-based Features for Efficient Attention-based Vehicle Motion Prediction

arXiv 2205.13071 ↗First posted 25 May 2022cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Motion prediction (MP) of multiple agents is a crucial task in arbitrarily complex environments, from social robots to self-driving cars. Current approaches tackle this problem using end-to-end networks, where the input data is usually a rendered top-view of the scene and the past trajectories of all the agents; leveraging this information is a must to obtain optimal performance. In that sense, a reliable Autonomous Driving (AD) system must produce reasonable predictions on time, however, despite many of these approaches use simple ConvNets and LSTMs, models might not be efficient enough for real-time applications when using both sources of information (map and trajectory history). Moreover, the performance of these models highly depends on the amount of training data, which can be expensive (particularly the annotated HD maps). In this work, we explore how to achieve competitive performance on the Argoverse 1.0 Benchmark using efficient attention-based models, which take as input the past trajectories and map-based features from minimal map information to ensure efficient and reliable MP. These features represent interpretable information as the driveable area and plausible goal points, in opposition to black-box CNN-based methods for map processing.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 63 references that are in the map. First posted on arXiv 25 May 2022.

Builds on

48 of 63 references.

References · 48

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  5. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
  6. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  7. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  8. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  9. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
  10. 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
  11. 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
  12. 2020TNT: Target-driveN Trajectory Predictioncited by 345
36 more
  1. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
  2. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  3. 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
  4. 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
  5. 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
  6. 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
  7. 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
  8. 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 147
  9. 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
  10. 2020Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?cited by 139
  11. 2019The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersectionscited by 137
  12. 2018Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networkscited by 129
  13. 2021HOME: Heatmap Output for future Motion Estimationcited by 122
  14. 2021Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradientscited by 122
  15. 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
  16. 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
  17. 2019Multimodal End-to-End Autonomous Drivingcited by 110
  18. 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
  19. 2019Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecastingcited by 87
  20. 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
  21. 2021SafetyNet: Safe planning for real-world self-driving vehicles using machine-learned policiescited by 68
  22. 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
  23. 2020Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimationcited by 57
  24. 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
  25. 2019Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMscited by 34
  26. 2020Understanding Bird's-Eye View of Road Semantics using an Onboard Cameracited by 29
  27. 2020Trajectory Prediction using Equivariant Continuous Convolutioncited by 26
  28. 2021Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertaintycited by 19
  29. 2021DenseTNT: Waymo Open Dataset Motion Prediction Challenge 1st Place Solutioncited by 14
  30. 2021MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagationcited by 14
  31. 2021Decoder Fusion RNN: Context and Interaction Aware Decoders for Trajectory Predictioncited by 12
  32. 20173DOF Pedestrian Trajectory Prediction Learned from Long-Term Autonomous Mobile Robot Deployment Datacited by 11
  33. 2021Exploring Social Posterior Collapse in Variational Autoencoder for Interaction Modelingcited by 11
  34. 2021Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Networkcited by 6
  35. 2019Multi-attention Networks for Temporal Localization of Video-level Labelscited by 4
  36. 2021Conditional Generative Adversarial Networks for Speed Control in Trajectory Simulationcited by 2

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.