mlsanityData to 7 Oct 2026

GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Model

arXiv 2209.07857 ↗First posted 16 Sep 2022cs.RO cs.CVcited by 25

Not on the map. Why?

Abstract (arXiv)

Trajectory prediction has been a long-standing problem in intelligent systems like autonomous driving and robot navigation. Models trained on large-scale benchmarks have made significant progress in improving prediction accuracy. However, the importance on efficiency for real-time applications has been less emphasized. This paper proposes an attention-based graph model, named GATraj, which achieves a good balance of prediction accuracy and inference speed. We use attention mechanisms to model the spatial-temporal dynamics of agents, such as pedestrians or vehicles, and a graph convolutional network to model their interactions. Additionally, a Laplacian mixture decoder is implemented to mitigate mode collapse and generate diverse multimodal predictions for each agent. GATraj achieves state-of-the-art prediction performance at a much higher speed when tested on the ETH/UCY datasets for pedestrian trajectories, and good performance at about 100 Hz inference speed when tested on the nuScenes dataset for autonomous driving. We conduct extensive experiments to analyze the probability estimation of the Laplacian mixture decoder and compare it with a Gaussian mixture decoder for predicting different multimodalities. Furthermore, comprehensive ablation studies demonstrate the effectiveness of each proposed module in GATraj. The code is released at https://github.com/mengmengliu1998/GATraj.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 45 of its 76 references that are in the map. First posted on arXiv 16 Sep 2022.

Builds on

45 of 76 references.

References · 45

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2015Variational Inference with Normalizing Flowscited by 2,161
  8. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  9. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  10. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  11. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  12. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
33 more
  1. 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
  2. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
  3. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  4. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
  5. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
  6. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
  7. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  8. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
  9. 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
  10. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  11. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
  12. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  13. 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
  14. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 184
  15. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
  16. 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
  17. 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
  18. 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
  19. 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
  20. 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
  21. 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
  22. 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
  23. 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 63
  24. 2018On GANs and GMMscited by 62
  25. 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
  26. 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
  27. 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
  28. 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
  29. 2020AMENet: Attentive Maps Encoder Network for Trajectory Predictioncited by 17
  30. 2020Likelihood-Based Diverse Sampling for Trajectory Forecastingcited by 16
  31. 2020Exploring Dynamic Context for Multi-path Trajectory Predictioncited by 14
  32. 2020Quantifying the Complexity of Standard Benchmarking Datasets for Long-Term Human Trajectory Predictioncited by 5
  33. 2021On the Generalizability of Motion Models for Road Users in Heterogeneous Shared Traffic Spacescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 6; 2024: 5; 2025: 10; 2026: 3.

25 papers.

Sort:

By area:

  1. 2026DriveVA: Video Action Models are Zero-Shot Driverscited by 19
  2. 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
  3. 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictorscited by 11
  4. 2023VT-Former: An Exploratory Study on Vehicle Trajectory Prediction for Highway Surveillance through Graph Isomorphism and Transformercited by 10
  5. 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Predictioncited by 7
  6. 2025Beyond Frame-wise Tracking: A Trajectory-based Paradigm for Efficient Point Cloud Trackingcited by 4
  7. 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generationcited by 4
  8. 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillationcited by 3
  9. 2024FollowGen: A Scaled Noise Conditional Diffusion Model for Car-Following Trajectory Predictioncited by 3
  10. 2023A Fast and Map-Free Model for Trajectory Prediction in Trafficscited by 2
  11. 2023An End-to-End Framework of Road User Detection, Tracking, and Prediction from Monocular Imagescited by 2
  12. 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehiclescited by 2
13 more
  1. 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
  2. 2023Spatial-Temporal Conditional Random Field for Human Trajectory Predictioncited by 1
  3. 2024Reliable Probabilistic Human Trajectory Prediction for Autonomous Applicationscited by 1
  4. 2024Pedestrian motion prediction evaluation for urban autonomous drivingcited by 1
  5. 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Predictioncited by 1
  6. 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Modelscited by 0
  7. 2024Convolutional Transformer Neural Collaborative Filteringcited by 0
  8. 2025EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Drivingcited by 0
  9. 2025GC-GAT: Multimodal Vehicular Trajectory Prediction using Graph Goal Conditioning and Cross-context Attentioncited by 0
  10. 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposalscited by 0
  11. 2025GContextFormer: A global context-aware hybrid multi-head attention approach with scaled additive aggregation for multimodal trajectory predictioncited by 0
  12. 2026Exploitation of Hidden Context in Dynamic Movement Forecasting: A Neural Network Journey from Recurrent to Graph Neural Networks and General Purpose Transformerscited by 0
  13. 2026Uncertainty-Aware Trajectory Forecasting from Imperfect Trackingcited by 0