mlsanityData to 14 Oct 2026

TranSPORTmer: A Holistic Approach to Trajectory Understanding in Multi-Agent Sports

arXiv 2410.17785 ↗First posted 23 Oct 2024cs.CV cs.MAcited by 11

Not on the map. Why?

Abstract (arXiv)

Understanding trajectories in multi-agent scenarios requires addressing various tasks, including predicting future movements, imputing missing observations, inferring the status of unseen agents, and classifying different global states. Traditional data-driven approaches often handle these tasks separately with specialized models. We introduce TranSPORTmer, a unified transformer-based framework capable of addressing all these tasks, showcasing its application to the intricate dynamics of multi-agent sports scenarios like soccer and basketball. Using Set Attention Blocks, TranSPORTmer effectively captures temporal dynamics and social interactions in an equivariant manner. The model's tasks are guided by an input mask that conceals missing or yet-to-be-predicted observations. Additionally, we introduce a CLS extra agent to classify states along soccer trajectories, including passes, possessions, uncontrolled states, and out-of-play intervals, contributing to an enhancement in modeling trajectories. Evaluations on soccer and basketball datasets show that TranSPORTmer outperforms state-of-the-art task-specific models in player forecasting, player forecasting-imputation, ball inference, and ball imputation. https://youtu.be/8VtSRm8oGoE

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 52 of its 76 references that are in the map. First posted on arXiv 23 Oct 2024.

Builds on

52 of 76 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2017Graph Attention Networkscited by 8,923
  6. 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
  7. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
  8. 2017Non-Autoregressive Neural Machine Translationcited by 463
  9. 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
  10. 2017On human motion prediction using recurrent neural networkscited by 338
  11. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
  12. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 290
38 more
  1. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
  2. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  3. 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
  4. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 229
  5. 2018Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinementcited by 195
  6. 2020Transformer Networks for Trajectory Forecastingcited by 181
  7. 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 165
  8. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
  9. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
  10. 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
  11. 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 132
  12. 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
  13. 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 100
  14. 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
  15. 2018Actions Speak Louder Than Goals: Valuing Player Actions in Soccercited by 90
  16. 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
  17. 2019Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANscited by 79
  18. 2019NAOMI: Non-Autoregressive Multiresolution Sequence Imputationcited by 59
  19. 2020Trajectron++: Dynamically-Feasible Trajectory Forecasting With Heterogeneous Datacited by 58
  20. 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
  21. 2018Generating Multi-Agent Trajectories using Programmatic Weak Supervisioncited by 46
  22. 2023TacticAI: an AI assistant for football tacticscited by 44
  23. 2023Social-Transmotion: Promptable Human Trajectory Predictioncited by 33
  24. 2020DAG-Net: Double Attentive Graph Neural Network for Trajectory Forecastingcited by 30
  25. 2019Sound Event Detection of Weakly Labelled Data with CNN-Transformer and Automatic Threshold Optimizationcited by 29
  26. 2019Stochastic Prediction of Multi-Agent Interactions from Partial Observationscited by 26
  27. 2017Generating Long-term Trajectories Using Deep Hierarchical Networkscited by 23
  28. 2022Evaluation of creating scoring opportunities for teammates in soccer via trajectory predictioncited by 20
  29. 2020Multi-Modal Trajectory Prediction of NBA Playerscited by 19
  30. 2020AC-VRNN: Attentive Conditional-VRNN for Multi-Future Trajectory Predictioncited by 16
  31. 2021baller2vec: A Multi-Entity Transformer For Multi-Agent Spatiotemporal Modelingcited by 14
  32. 2021baller2vec++: A Look-Ahead Multi-Entity Transformer For Modeling Coordinated Agentscited by 12
  33. 2022Social-PatteRNN: Socially-Aware Trajectory Prediction Guided by Motion Patternscited by 12
  34. 2023Ball Trajectory Inference from Multi-Agent Sports Contexts Using Set Transformer and Hierarchical Bi-LSTMcited by 12
  35. 2022Automatic event detection in football using tracking datacited by 10
  36. 2023Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observationscited by 9
  37. 2024FootBots: A Transformer-based Architecture for Motion Prediction in Soccercited by 8
  38. 2017Fine-Grained Retrieval of Sports Plays using Tree-Based Alignment of Trajectoriescited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 7.

11 papers.

  1. 2025Unified Uncertainty-Aware Diffusion for Multi-Agent Trajectory Modelingcited by 15
  2. 2025JointDiff: Bridging Continuous and Discrete in Multi-Agent Trajectory Generationcited by 5
  3. 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modelingcited by 3
  4. 2025Multi-Modal Soccer Scene Analysis with Masked Pre-Trainingcited by 1
  5. 2026Modeling Matches as Language: A Generative Transformer Approach for Counterfactual Player Valuation in Footballcited by 1
  6. 2026Training-Free Off-Screen Player Imputation for Broadcast-Based Spatial Football Analyticscited by 1
  7. 2026Space-Creating versus Dead Possession: An Off-Ball Possession-Quality Index for Broadcast Footballcited by 1
  8. 2025CourtMotion: Learning Event-Driven Motion Representations from Skeletal Data for Basketballcited by 0
  9. 2026PathCRF: Ball-Free Soccer Event Detection via Possession Path Inference from Player Trajectoriescited by 0
  10. 2026Monte Carlo Pass Search: Using Trajectory Generation for 3D Counterfactual Pass Evaluation in Footballcited by 0
  11. 2026How Much Velocity Does Off-Ball Space Value Need? A Broadcast-Viewport Benchmarkcited by 0