Exploring Attention GAN for Vehicle Motion Prediction
Not on the map. Why?
Abstract (arXiv)
The design of a safe and reliable Autonomous Driving stack (ADS) is one of the most challenging tasks of our era. These ADS are expected to be driven in highly dynamic environments with full autonomy, and a reliability greater than human beings. In that sense, to efficiently and safely navigate through arbitrarily complex traffic scenarios, ADS must have the ability to forecast the future trajectories of surrounding actors. Current state-of-the-art models are typically based on Recurrent, Graph and Convolutional networks, achieving noticeable results in the context of vehicle prediction. In this paper we explore the influence of attention in generative models for motion prediction, considering both physical and social context to compute the most plausible trajectories. We first encode the past trajectories using a LSTM network, which serves as input to a Multi-Head Self-Attention module that computes the social context. On the other hand, we formulate a weighted interpolation to calculate the velocity and orientation in the last observation frame in order to calculate acceptable target points, extracted from the driveable of the HDMap information, which represents our physical context. Finally, the input of our generator is a white noise vector sampled from a multivariate normal distribution while the social and physical context are its conditions, in order to predict plausible trajectories. We validate our method using the Argoverse Motion Forecasting Benchmark 1.1, achieving competitive unimodal results.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 26 Sep 2022.
Builds on
18 of 26 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2017Social Attention: Modeling Attention in Human Crowdscited by 185
- 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
- 2019Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecastingcited by 87
- 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
- 2019Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANscited by 78
6 more
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2020Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimationcited by 57
- 2021Exploring Social Posterior Collapse in Variational Autoencoder for Interaction Modelingcited by 11
- 2021Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Networkcited by 6
- 2019Multi-attention Networks for Temporal Localization of Video-level Labelscited by 4
- 2022Exploring Map-based Features for Efficient Attention-based Vehicle Motion Predictioncited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 0; 2026: 1.
6 papers.
- 2024Motion Forecasting via Model-Based Risk Minimizationcited by 4
- 2024Stochasticity in Motion: An Information-Theoretic Approach to Trajectory Predictioncited by 4
- 2024A Gentle Introduction and Tutorial on Deep Generative Models in Transportation Researchcited by 4
- 2023Efficient Baselines for Motion Prediction in Autonomous Drivingcited by 3
- 2024Fast and Efficient Transformer-based Method for Bird's Eye View Instance Predictioncited by 2
- 2026BEVPredFormer: Spatio-temporal Attention for BEV Instance Prediction in Autonomous Drivingcited by 1
- 2026BEVPredFormer: Spatio-temporal Attention for BEV Instance Prediction in Autonomous Driving3 Apr 2026
- 2024Fast and Efficient Transformer-based Method for Bird's Eye View Instance Prediction11 Nov 2024
- 2024A Gentle Introduction and Tutorial on Deep Generative Models in Transportation Research9 Oct 2024
- 2024Stochasticity in Motion: An Information-Theoretic Approach to Trajectory Prediction2 Oct 2024
- 2024Motion Forecasting via Model-Based Risk Minimization16 Sep 2024
- 2023Efficient Baselines for Motion Prediction in Autonomous Driving6 Sep 2023