Human Motion Trajectory Prediction: A Survey
Not on the map. Why?
Abstract (arXiv)
With growing numbers of intelligent autonomous systems in human environments, the ability of such systems to perceive, understand and anticipate human behavior becomes increasingly important. Specifically, predicting future positions of dynamic agents and planning considering such predictions are key tasks for self-driving vehicles, service robots and advanced surveillance systems. This paper provides a survey of human motion trajectory prediction. We review, analyze and structure a large selection of work from different communities and propose a taxonomy that categorizes existing methods based on the motion modeling approach and level of contextual information used. We provide an overview of the existing datasets and performance metrics. We discuss limitations of the state of the art and outline directions for further research.
Key facts. Cited by 231 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 56; 2022: 36; 2023: 35; 2024: 41; 2025: 40; 2026: 23.
231 papers.
Sort:
By area:
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 137
- 2023Human Motion Generation: A Surveycited by 95
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2021ROAD: The ROad event Awareness Dataset for Autonomous Drivingcited by 54
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2022Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimationcited by 40
38 more
- 2021Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Drivingcited by 36
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehiclescited by 36
- 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
- 2022How many Observations are Enough? Knowledge Distillation for Trajectory Forecastingcited by 35
- 2021Imagining The Road Ahead: Multi-Agent Trajectory Prediction via Differentiable Simulationcited by 32
- 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 32
- 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Predictioncited by 30
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 28
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
- 2025UniOcc: A Unified Benchmark for Occupancy Forecasting and Prediction in Autonomous Drivingcited by 27
- 2023Convolutional Learning on Simplicial Complexescited by 26
- 2023trajdata: A Unified Interface to Multiple Human Trajectory Datasetscited by 25
- 2021A Survey on Human-aware Robot Navigationcited by 23
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learningcited by 23
- 2021Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perceptioncited by 22
- 2021Learning by Watchingcited by 22
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Mapscited by 22
- 2022Interpretable Self-Aware Neural Networks for Robust Trajectory Predictioncited by 22
- 2021Congestion-aware Multi-agent Trajectory Prediction for Collision Avoidancecited by 21
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Predictioncited by 21
- 2021TrAISformer -- A Transformer Network with Sparse Augmented Data Representation and Cross Entropy Loss for AIS-based Vessel Trajectory Predictioncited by 20
- 2022Transferable and Adaptable Driving Behavior Predictioncited by 20
- 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
- 2021Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertaintycited by 19
- 2021MSN: Multi-Style Network for Trajectory Predictioncited by 19
- 2021Grouptron: Dynamic Multi-Scale Graph Convolutional Networks for Group-Aware Dense Crowd Trajectory Forecastingcited by 19
- 2021Trajectory Prediction with Graph-based Dual-scale Context Fusioncited by 19
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Reviewcited by 18
- 2021Propagating State Uncertainty Through Trajectory Forecastingcited by 17
- 2023OSDaR23: Open Sensor Data for Rail 2023cited by 17
- 2023Coaching a Teachable Studentcited by 17
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?cited by 17
- 2021Diverse Critical Interaction Generation for Planning and Planner Evaluationcited by 15
50 most cited of 231 All 231 (JSON)
- 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Prediction12 Sep 2026
- 2026CrowdTraj: A Benchmark for Dense Crowd Trajectory Prediction in Realistic Crowded Environments7 Sep 2026
- 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decomposition6 Aug 2026
- 2026Failing Gracefully: Mitigating Impact of Inevitable Robot Failures5 Aug 2026
- 2026Inferring Missing Trajectory Data with Temporal Convolutional Networks27 Jul 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026Agent-Centric Animal Pose Forecasting21 Jul 2026
- 2026Long-Term Prediction of Local and Global Human Motion with Occlusion Recovery26 Jun 2026
- 2026DroneShield-AI: A Multi-Modal Sensor Fusion Framework for Real-Time Autonomous Drone Threat Detection, Behavioral Intent Classification, and Swarm Intelligence in Contested Airspace10 Jun 2026
- 2026Intention Driven Identification of In-Possession Match Phases in Association Football through Temporal Graph Learning8 Jun 2026
- 2026COSI-Lab: Conference Living Lab for Modeling Multi-Perspective Multimodal Social Intention2 Jun 2026
- 2026A formal definition and meta-model for a machine theory of mind2 Jun 2026
38 more
- 2026Cooperative Informative Sensing for Monitoring Dynamic Indoor Environments via Multi-Agent Reinforcement Learning25 Apr 2026
- 2026A Dual Perspective on Synthetic Trajectory Generators: Utility Framework and Privacy Vulnerabilities21 Apr 2026
- 2026Learning Probabilistic Responsibility Allocations for Multi-Agent Interactions13 Apr 2026
- 2026Online Intention Prediction via Control-Informed Learning10 Apr 2026
- 2026RankFormer: A Propose-then-Select Transformer for Multi-Agent Multimodal Trajectory Prediction8 Apr 2026
- 2026Forecasting Motion in the Wild1 Apr 2026
- 2026Efficient Dense Crowd Trajectory Prediction Via Dynamic Clustering18 Mar 2026
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2026Detecting Object Tracking Failure via Sequential Hypothesis Testing13 Feb 2026
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibration11 Feb 2026
- 2026AGMA: Adaptive Gaussian Mixture Anchors for Prior-Guided Multimodal Human Trajectory Forecasting4 Feb 2026
- 2025Learning to Plan, Planning to Learn: Adaptive Hierarchical RL-MPC for Sample-Efficient Decision Making18 Dec 2025
- 2025Seeing is Believing (and Predicting): Context-Aware Multi-Human Behavior Prediction with Vision Language Models17 Dec 2025
- 2025Hierarchical Spatio-Temporal Attention Network with Adaptive Risk-Aware Decision for Forward Collision Warning in Complex Scenarios25 Nov 2025
- 2025Estimating cognitive biases with attention-aware inverse planning29 Oct 2025
- 2025Mapping the Urban Mobility Intelligence Frontier: A Scientometric Analysis of Data-Driven Pedestrian Trajectory Prediction and Simulation11 Oct 2025
- 2025Learning to Navigate Socially Through Proactive Risk Perception9 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Prediction1 Oct 2025
- 2025MINT-RVAE: Multi-Cues Intention Prediction of Human-Robot Interaction using Human Pose and Emotion Information from RGB-only Camera Data26 Sep 2025
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals12 Sep 2025
- 2025Causal Sensitivity Identification using Generative Learning1 Sep 2025
- 2025TrajEvo: Trajectory Prediction Heuristics Design via LLM-driven Evolution7 Aug 2025
- 2025User Trajectory Prediction Unifying Global and Local Temporal Information4 Aug 2025
- 2025Unified Generation-Refinement Planning: Bridging Guided Flow Matching and Sampling-Based MPC for Social Navigation2 Aug 2025
- 2025OmniTraj: Pre-Training on Heterogeneous Data for Adaptive and Zero-Shot Human Trajectory Prediction31 Jul 2025
- 2025Generative AI-Driven High-Fidelity Human Motion Simulation18 Jul 2025
- 2025Towards Autonomous Riding: A Review of Perception, Planning, and Control in Intelligent Two-Wheelers16 Jul 2025
- 2025Grounding Intelligence in Movement3 Jul 2025
- 2025Trajectory Prediction in Dynamic Object Tracking: A Critical Study24 Jun 2025
- 2025Selective Social-Interaction via Individual Importance for Fast Human Trajectory Prediction23 Jun 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025UPTor: Unified 3D Human Pose Dynamics and Trajectory Prediction for Human-Robot Interaction20 May 2025
- 2025TPK: Trustworthy Trajectory Prediction Integrating Prior Knowledge For Interpretability and Kinematic Feasibility10 May 2025
- 2025Boundary-Guided Trajectory Prediction for Road Aware and Physically Feasible Autonomous Driving10 May 2025
- 2025Collecting Human Motion Data in Large and Occlusion-Prone Environments using Ultra-Wideband Localization9 May 2025
- 2025TrajEvo: Designing Trajectory Prediction Heuristics via LLM-driven Evolution7 May 2025
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Models7 Apr 2025
50 newest of 231 All 231 (JSON)
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehiclescited by 36
- 2021Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perceptioncited by 22
- 2021Learning by Watchingcited by 22
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehiclescited by 11
- 2024Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Drivingcited by 7
- 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiencycited by 3
- 2023An Overview about Emerging Technologies of Autonomous Drivingcited by 2
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarioscited by 2
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehiclescited by 0
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarios2 Apr 2025
- 2024Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Driving18 Mar 2024
- 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiency6 Feb 2024
- 2023An Overview about Emerging Technologies of Autonomous Driving23 Jun 2023
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles13 Dec 2022
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehicles25 Jul 2022
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles19 Jul 2021
- 2021Learning by Watching10 Jun 2021
- 2021Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perception17 May 2021
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 137
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2024DiffuTraj: A Stochastic Vessel Trajectory Prediction Approach via Guided Diffusion Processcited by 1
- 2025Unified Generation-Refinement Planning: Bridging Guided Flow Matching and Sampling-Based MPC for Social Navigationcited by 0
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Predictioncited by 0
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Prediction1 Oct 2025
- 2025Unified Generation-Refinement Planning: Bridging Guided Flow Matching and Sampling-Based MPC for Social Navigation2 Aug 2025
- 2024DiffuTraj: A Stochastic Vessel Trajectory Prediction Approach via Guided Diffusion Process12 Oct 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion4 Apr 2023
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction25 Nov 2022
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2023Human Motion Generation: A Surveycited by 95
- 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2021ROAD: The ROad event Awareness Dataset for Autonomous Drivingcited by 54
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2022Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimationcited by 40
- 2021Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Drivingcited by 36
- 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
12 most cited of 210 All 210 (JSON)
- 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Prediction12 Sep 2026
- 2026CrowdTraj: A Benchmark for Dense Crowd Trajectory Prediction in Realistic Crowded Environments7 Sep 2026
- 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decomposition6 Aug 2026
- 2026Failing Gracefully: Mitigating Impact of Inevitable Robot Failures5 Aug 2026
- 2026Inferring Missing Trajectory Data with Temporal Convolutional Networks27 Jul 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026Agent-Centric Animal Pose Forecasting21 Jul 2026
- 2026Long-Term Prediction of Local and Global Human Motion with Occlusion Recovery26 Jun 2026
- 2026DroneShield-AI: A Multi-Modal Sensor Fusion Framework for Real-Time Autonomous Drone Threat Detection, Behavioral Intent Classification, and Swarm Intelligence in Contested Airspace10 Jun 2026
- 2026Intention Driven Identification of In-Possession Match Phases in Association Football through Temporal Graph Learning8 Jun 2026
- 2026COSI-Lab: Conference Living Lab for Modeling Multi-Perspective Multimodal Social Intention2 Jun 2026
- 2026A formal definition and meta-model for a machine theory of mind2 Jun 2026
12 newest of 210 All 210 (JSON)