GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Model
Not on the map. Why?
Abstract (arXiv)
Trajectory prediction has been a long-standing problem in intelligent systems like autonomous driving and robot navigation. Models trained on large-scale benchmarks have made significant progress in improving prediction accuracy. However, the importance on efficiency for real-time applications has been less emphasized. This paper proposes an attention-based graph model, named GATraj, which achieves a good balance of prediction accuracy and inference speed. We use attention mechanisms to model the spatial-temporal dynamics of agents, such as pedestrians or vehicles, and a graph convolutional network to model their interactions. Additionally, a Laplacian mixture decoder is implemented to mitigate mode collapse and generate diverse multimodal predictions for each agent. GATraj achieves state-of-the-art prediction performance at a much higher speed when tested on the ETH/UCY datasets for pedestrian trajectories, and good performance at about 100 Hz inference speed when tested on the nuScenes dataset for autonomous driving. We conduct extensive experiments to analyze the probability estimation of the Laplacian mixture decoder and compare it with a Gaussian mixture decoder for predicting different multimodalities. Furthermore, comprehensive ablation studies demonstrate the effectiveness of each proposed module in GATraj. The code is released at https://github.com/mengmengliu1998/GATraj.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 45 of its 76 references that are in the map. First posted on arXiv 16 Sep 2022.
Builds on
45 of 76 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
33 more
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 184
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 63
- 2018On GANs and GMMscited by 62
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
- 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2020AMENet: Attentive Maps Encoder Network for Trajectory Predictioncited by 17
- 2020Likelihood-Based Diverse Sampling for Trajectory Forecastingcited by 16
- 2020Exploring Dynamic Context for Multi-path Trajectory Predictioncited by 14
- 2020Quantifying the Complexity of Standard Benchmarking Datasets for Long-Term Human Trajectory Predictioncited by 5
- 2021On the Generalizability of Motion Models for Road Users in Heterogeneous Shared Traffic Spacescited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 6; 2024: 5; 2025: 10; 2026: 3.
25 papers.
Sort:
By area:
- 2026DriveVA: Video Action Models are Zero-Shot Driverscited by 19
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictorscited by 11
- 2023VT-Former: An Exploratory Study on Vehicle Trajectory Prediction for Highway Surveillance through Graph Isomorphism and Transformercited by 10
- 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Predictioncited by 7
- 2025Beyond Frame-wise Tracking: A Trajectory-based Paradigm for Efficient Point Cloud Trackingcited by 4
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generationcited by 4
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillationcited by 3
- 2024FollowGen: A Scaled Noise Conditional Diffusion Model for Car-Following Trajectory Predictioncited by 3
- 2023A Fast and Map-Free Model for Trajectory Prediction in Trafficscited by 2
- 2023An End-to-End Framework of Road User Detection, Tracking, and Prediction from Monocular Imagescited by 2
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehiclescited by 2
13 more
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Predictioncited by 1
- 2024Reliable Probabilistic Human Trajectory Prediction for Autonomous Applicationscited by 1
- 2024Pedestrian motion prediction evaluation for urban autonomous drivingcited by 1
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Predictioncited by 1
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Modelscited by 0
- 2024Convolutional Transformer Neural Collaborative Filteringcited by 0
- 2025EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Drivingcited by 0
- 2025GC-GAT: Multimodal Vehicular Trajectory Prediction using Graph Goal Conditioning and Cross-context Attentioncited by 0
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposalscited by 0
- 2025GContextFormer: A global context-aware hybrid multi-head attention approach with scaled additive aggregation for multimodal trajectory predictioncited by 0
- 2026Exploitation of Hidden Context in Dynamic Movement Forecasting: A Neural Network Journey from Recurrent to Graph Neural Networks and General Purpose Transformerscited by 0
- 2026Uncertainty-Aware Trajectory Forecasting from Imperfect Trackingcited by 0
- 2026Uncertainty-Aware Trajectory Forecasting from Imperfect Tracking31 Aug 2026
- 2026Exploitation of Hidden Context in Dynamic Movement Forecasting: A Neural Network Journey from Recurrent to Graph Neural Networks and General Purpose Transformers14 May 2026
- 2026DriveVA: Video Action Models are Zero-Shot Drivers5 Apr 2026
- 2025GContextFormer: A global context-aware hybrid multi-head attention approach with scaled additive aggregation for multimodal trajectory prediction24 Nov 2025
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generation10 Nov 2025
- 2025Beyond Frame-wise Tracking: A Trajectory-based Paradigm for Efficient Point Cloud Tracking14 Sep 2025
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals12 Sep 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025GC-GAT: Multimodal Vehicular Trajectory Prediction using Graph Goal Conditioning and Cross-context Attention15 Apr 2025
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehicles28 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
13 more
- 2025EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Driving26 Feb 2025
- 2024Convolutional Transformer Neural Collaborative Filtering2 Dec 2024
- 2024FollowGen: A Scaled Noise Conditional Diffusion Model for Car-Following Trajectory Prediction23 Nov 2024
- 2024Pedestrian motion prediction evaluation for urban autonomous driving22 Oct 2024
- 2024Reliable Probabilistic Human Trajectory Prediction for Autonomous Applications9 Oct 2024
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models8 May 2024
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Prediction30 Nov 2023
- 2023VT-Former: An Exploratory Study on Vehicle Trajectory Prediction for Highway Surveillance through Graph Isomorphism and Transformer11 Nov 2023
- 2023An End-to-End Framework of Road User Detection, Tracking, and Prediction from Monocular Images9 Aug 2023
- 2023A Fast and Map-Free Model for Trajectory Prediction in Traffics19 Jul 2023
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillation25 Jun 2023
- 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction15 Feb 2023
- 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictors8 Dec 2022
- 2026DriveVA: Video Action Models are Zero-Shot Driverscited by 19
- 2026DriveVA: Video Action Models are Zero-Shot Drivers5 Apr 2026
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictorscited by 11
- 2023VT-Former: An Exploratory Study on Vehicle Trajectory Prediction for Highway Surveillance through Graph Isomorphism and Transformercited by 10
- 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Predictioncited by 7
- 2025Beyond Frame-wise Tracking: A Trajectory-based Paradigm for Efficient Point Cloud Trackingcited by 4
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generationcited by 4
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillationcited by 3
- 2023A Fast and Map-Free Model for Trajectory Prediction in Trafficscited by 2
- 2023An End-to-End Framework of Road User Detection, Tracking, and Prediction from Monocular Imagescited by 2
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehiclescited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Predictioncited by 1
12 most cited of 23 All 23 (JSON)
- 2026Uncertainty-Aware Trajectory Forecasting from Imperfect Tracking31 Aug 2026
- 2026Exploitation of Hidden Context in Dynamic Movement Forecasting: A Neural Network Journey from Recurrent to Graph Neural Networks and General Purpose Transformers14 May 2026
- 2025GContextFormer: A global context-aware hybrid multi-head attention approach with scaled additive aggregation for multimodal trajectory prediction24 Nov 2025
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generation10 Nov 2025
- 2025Beyond Frame-wise Tracking: A Trajectory-based Paradigm for Efficient Point Cloud Tracking14 Sep 2025
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals12 Sep 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025GC-GAT: Multimodal Vehicular Trajectory Prediction using Graph Goal Conditioning and Cross-context Attention15 Apr 2025
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehicles28 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Driving26 Feb 2025
12 newest of 23 All 23 (JSON)