Multi-Modal Trajectory Prediction of NBA Players
Not on the map. Why?
Abstract (arXiv)
National Basketball Association (NBA) players are highly motivated and skilled experts that solve complex decision making problems at every time point during a game. As a step towards understanding how players make their decisions, we focus on their movement trajectories during games. We propose a method that captures the multi-modal behavior of players, where they might consider multiple trajectories and select the most advantageous one. The method is built on an LSTM-based architecture predicting multiple trajectories and their probabilities, trained by a multi-modal loss function that updates the best trajectories. Experiments on large, fine-grained NBA tracking data show that the proposed method outperforms the state-of-the-art. In addition, the results indicate that the approach generates more realistic trajectories and that it can learn individual playing styles of specific players.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 3; 2024: 4; 2025: 4; 2026: 1.
18 papers.
Sort:
- 2022A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directionscited by 21
- 2022Interaction Modeling with Multiplex Attentioncited by 14
- 2024TranSPORTmer: A Holistic Approach to Trajectory Understanding in Multi-Agent Sportscited by 11
- 2023Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observationscited by 9
- 2024FootBots: A Transformer-based Architecture for Motion Prediction in Soccercited by 8
- 2021Time-series Imputation of Temporally-occluded Multiagent Trajectoriescited by 7
- 2022Group Activity Recognition in Basketball Tracking Data -- Neural Embeddings in Team Sports (NETS)cited by 5
- 2024Behavior-Inspired Neural Networks for Relational Inferencecited by 4
- 2022Centralized Training with Hybrid Execution in Multi-Agent Reinforcement Learningcited by 2
- 2023About latent roles in forecasting players in team sportscited by 2
- 2024Neural Interaction Energy for Multi-Agent Trajectory Predictioncited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
6 more
- 2022Rethinking Trajectory Prediction via "Team Game"cited by 1
- 2023Continuous football player tracking from discrete broadcast datacited by 1
- 2025A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Gamescited by 1
- 2026EnvShip: A Unified Framework for Context-Aware and Cross-Region Vessel Trajectory Forecastingcited by 1
- 2025Calisthenics Skills Temporal Video Segmentationcited by 0
- 2025Coherent Multi-Agent Trajectory Forecasting in Team Sports with CausalTrajcited by 0
- 2026EnvShip: A Unified Framework for Context-Aware and Cross-Region Vessel Trajectory Forecasting13 Jun 2026
- 2025Coherent Multi-Agent Trajectory Forecasting in Team Sports with CausalTraj23 Nov 2025
- 2025A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Games28 Jul 2025
- 2025Calisthenics Skills Temporal Video Segmentation16 Jul 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2024TranSPORTmer: A Holistic Approach to Trajectory Understanding in Multi-Agent Sports23 Oct 2024
- 2024FootBots: A Transformer-based Architecture for Motion Prediction in Soccer28 Jun 2024
- 2024Behavior-Inspired Neural Networks for Relational Inference20 Jun 2024
- 2024Neural Interaction Energy for Multi-Agent Trajectory Prediction25 Apr 2024
- 2023Continuous football player tracking from discrete broadcast data24 Nov 2023
- 2023About latent roles in forecasting players in team sports17 Apr 2023
- 2023Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observations13 Feb 2023
6 more
- 2022Rethinking Trajectory Prediction via "Team Game"17 Oct 2022
- 2022Centralized Training with Hybrid Execution in Multi-Agent Reinforcement Learning12 Oct 2022
- 2022Group Activity Recognition in Basketball Tracking Data -- Neural Embeddings in Team Sports (NETS)31 Aug 2022
- 2022Interaction Modeling with Multiplex Attention23 Aug 2022
- 2022A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directions3 Mar 2022
- 2021Time-series Imputation of Temporally-occluded Multiagent Trajectories8 Jun 2021
- 2022A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directionscited by 21
- 2022Interaction Modeling with Multiplex Attentioncited by 14
- 2024TranSPORTmer: A Holistic Approach to Trajectory Understanding in Multi-Agent Sportscited by 11
- 2023Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observationscited by 9
- 2024FootBots: A Transformer-based Architecture for Motion Prediction in Soccercited by 8
- 2021Time-series Imputation of Temporally-occluded Multiagent Trajectoriescited by 7
- 2022Group Activity Recognition in Basketball Tracking Data -- Neural Embeddings in Team Sports (NETS)cited by 5
- 2024Behavior-Inspired Neural Networks for Relational Inferencecited by 4
- 2022Centralized Training with Hybrid Execution in Multi-Agent Reinforcement Learningcited by 2
- 2023About latent roles in forecasting players in team sportscited by 2
- 2024Neural Interaction Energy for Multi-Agent Trajectory Predictioncited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
12 most cited of 18 All 18 (JSON)
- 2026EnvShip: A Unified Framework for Context-Aware and Cross-Region Vessel Trajectory Forecasting13 Jun 2026
- 2025Coherent Multi-Agent Trajectory Forecasting in Team Sports with CausalTraj23 Nov 2025
- 2025A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Games28 Jul 2025
- 2025Calisthenics Skills Temporal Video Segmentation16 Jul 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2024TranSPORTmer: A Holistic Approach to Trajectory Understanding in Multi-Agent Sports23 Oct 2024
- 2024FootBots: A Transformer-based Architecture for Motion Prediction in Soccer28 Jun 2024
- 2024Behavior-Inspired Neural Networks for Relational Inference20 Jun 2024
- 2024Neural Interaction Energy for Multi-Agent Trajectory Prediction25 Apr 2024
- 2023Continuous football player tracking from discrete broadcast data24 Nov 2023
- 2023About latent roles in forecasting players in team sports17 Apr 2023
- 2023Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observations13 Feb 2023
12 newest of 18 All 18 (JSON)