Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approach
Not on the map. Why?
Abstract (arXiv)
Estimating the potential behavior of the surrounding human-driven vehicles is crucial for the safety of autonomous vehicles in a mixed traffic flow. Recent state-of-the-art achieved accurate prediction using deep neural networks. However, these end-to-end models are usually black boxes with weak interpretability and generalizability. This paper proposes the Goal-based Neural Variational Agent (GNeVA), an interpretable generative model for motion prediction with robust generalizability to out-of-distribution cases. For interpretability, the model achieves target-driven motion prediction by estimating the spatial distribution of long-term destinations with a variational mixture of Gaussians. We identify a causal structure among maps and agents' histories and derive a variational posterior to enhance generalizability. Experiments on motion prediction datasets validate that the fitted model can be interpretable and generalizable and can achieve comparable performance to state-of-the-art results.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 10 Mar 2024.
Builds on
26 of 42 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2017Generative Adversarial Networks: An Overviewcited by 588
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
14 more
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2022What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?cited by 149
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2020Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?cited by 139
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2021Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Drivingcited by 73
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2021Vehicle trajectory prediction works, but not everywherecited by 39
- 2020Goal-driven Long-Term Trajectory Predictioncited by 24
- 2022Transferable and Adaptable Driving Behavior Predictioncited by 20
- 2020Scenario-Transferable Semantic Graph Reasoning for Interaction-Aware Probabilistic Predictioncited by 17
- 2021Causal-based Time Series Domain Generalization for Vehicle Intention Predictioncited by 17
- 2022Generalizability Analysis of Graph-based Trajectory Predictor with Vectorized Representationcited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 1.
5 papers.
- 2026RAM: Recover Any 3D Human Motion in-the-Wildcited by 11
- 2025Four Principles for Physically Interpretable World Modelscited by 10
- 2024Quantifying Uncertainty in Motion Prediction with Variational Bayesian Mixturecited by 6
- 2024Physically Interpretable World Models via Weakly Supervised Representation Learningcited by 3
- 2025How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomycited by 1
- 2026RAM: Recover Any 3D Human Motion in-the-Wild20 Mar 2026
- 2025How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy12 Aug 2025
- 2025Four Principles for Physically Interpretable World Models4 Mar 2025
- 2024Physically Interpretable World Models via Weakly Supervised Representation Learning17 Dec 2024
- 2024Quantifying Uncertainty in Motion Prediction with Variational Bayesian Mixture4 Apr 2024