From Goals, Waypoints & Paths To Long Term Human Trajectory Forecasting
Not on the map. Why?
Abstract (arXiv)
Human trajectory forecasting is an inherently multi-modal problem. Uncertainty in future trajectories stems from two sources: (a) sources that are known to the agent but unknown to the model, such as long term goals and (b)sources that are unknown to both the agent & the model, such as intent of other agents & irreducible randomness indecisions. We propose to factorize this uncertainty into its epistemic & aleatoric sources. We model the epistemic un-certainty through multimodality in long term goals and the aleatoric uncertainty through multimodality in waypoints& paths. To exemplify this dichotomy, we also propose a novel long term trajectory forecasting setting, with prediction horizons upto a minute, an order of magnitude longer than prior works. Finally, we presentY-net, a scene com-pliant trajectory forecasting network that exploits the pro-posed epistemic & aleatoric structure for diverse trajectory predictions across long prediction horizons.Y-net significantly improves previous state-of-the-art performance on both (a) The well studied short prediction horizon settings on the Stanford Drone & ETH/UCY datasets and (b) The proposed long prediction horizon setting on the re-purposed Stanford Drone & Intersection Drone datasets.
Key facts. Cited by 167 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 27; 2023: 41; 2024: 44; 2025: 25; 2026: 16.
167 papers.
Sort:
By area:
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Drivingcited by 169
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 132
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 126
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 111
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 67
- 2022Human Trajectory Prediction via Neural Social Physicscited by 66
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
38 more
- 2022Adaptive Trajectory Prediction via Transferable GNNcited by 51
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2021View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrumscited by 45
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2021Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspectivecited by 40
- 2022Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimationcited by 40
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2023Social-Transmotion: Promptable Human Trajectory Predictioncited by 33
- 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 31
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillationcited by 31
- 2024Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioningcited by 30
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 29
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 29
- 2024Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priorscited by 28
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
- 2023SocialCircle: Learning the Angle-based Social Interaction Representation for Pedestrian Trajectory Predictioncited by 27
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistantscited by 23
- 2023StillFast: An End-to-End Approach for Short-Term Object Interaction Anticipationcited by 23
- 2023Robots That Can See: Leveraging Human Pose for Trajectory Predictioncited by 23
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Mapscited by 22
- 2022Interpretable Self-Aware Neural Networks for Robust Trajectory Predictioncited by 22
- 2024ROADWork: A Dataset and Benchmark for Learning to Recognize, Observe, Analyze and Drive Through Work Zonescited by 22
- 2021MSN: Multi-Style Network for Trajectory Predictioncited by 19
- 2021SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Predictioncited by 19
- 2022LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Predictioncited by 19
- 2025Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSMcited by 18
- 2023Unsupervised Sampling Promoting for Stochastic Human Trajectory Predictioncited by 17
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2024Progressive Pretext Task Learning for Human Trajectory Predictioncited by 16
- 2022PoseBERT: A Generic Transformer Module for Temporal 3D Human Modelingcited by 15
- 2022Forecasting Human Trajectory from Scene Historycited by 14
- 2022STGlow: A Flow-based Generative Framework with Dual Graphormer for Pedestrian Trajectory Predictioncited by 14
- 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrumscited by 14
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022Uncertainty estimation for Cross-dataset performance in Trajectory predictioncited by 13
- 2021HYPER: Learned Hybrid Trajectory Prediction via Factored Inference and Adaptive Samplingcited by 12
50 most cited of 167 All 167 (JSON)
- 2026Probabilistic Pedestrian Forecasts from a Handheld Phone: World-Frame Heat Maps, Visual-Inertial Height Drift, and Evaluation without Ground Truth3 Oct 2026
- 2026Destination Support Restoration for Finite-Set Multimodal Trajectory Prediction22 Sep 2026
- 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Prediction12 Sep 2026
- 2026EgoNeMo: Transferable Map of Pedestrian Dynamics via Egocentric LiDAR Scan5 Sep 2026
- 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decomposition6 Aug 2026
- 2026Hybrid Probabilistic Zonotopes for Identifiable and Refinable Predictive Uncertainty5 Aug 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Scene-aware Prediction of Diverse Human Movement Goals29 Jun 2026
- 2026Reasonable Motion: A General ASP Foundation for Environment Constrained Movement Trajectory Computation24 Jun 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
38 more
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Prediction12 May 2026
- 2026Eye Gaze-Informed and Context-Aware Pedestrian Trajectory Prediction in Shared Spaces with Automated Shuttles: A Virtual Reality Study20 Mar 2026
- 2026Optimizing Occupancy Sensor Placement in Smart Environments24 Feb 2026
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibration11 Feb 2026
- 2025E3AD: An Emotion-Aware Vision-Language-Action Model for Human-Centric End-to-End Autonomous Driving4 Dec 2025
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Prediction5 Oct 2025
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations1 Oct 2025
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network11 Sep 2025
- 2025DeepFleet: Multi-Agent Foundation Models for Mobile Robots12 Aug 2025
- 2025Model Predictive Control for Crowd Navigation via Learning-Based Trajectory Prediction9 Aug 2025
- 2025A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Games28 Jul 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025ECAM: A Contrastive Learning Approach to Avoid Environmental Collision in Trajectory Forecasting11 Jun 2025
- 2025Towards Predicting Any Human Trajectory In Context1 Jun 2025
- 2025Future-Oriented Navigation: Dynamic Obstacle Avoidance with One-Shot Energy-Based Multimodal Motion Prediction1 May 2025
- 2025SocialMOIF: Multi-Order Intention Fusion for Pedestrian Trajectory Prediction22 Apr 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025Learning Velocity and Acceleration: Self-Supervised Motion Consistency for Pedestrian Trajectory Prediction31 Mar 2025
- 2025Whenever, Wherever: Towards Orchestrating Crowd Simulations with Spatio-Temporal Spawn Dynamics20 Mar 2025
- 2025Stochastic Trajectory Prediction under Unstructured Constraints18 Mar 2025
- 2025Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSM13 Mar 2025
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation13 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction20 Feb 2025
- 2025Sea-cret Agents: Maritime Abduction for Region Generation to Expose Dark Vessel Trajectories3 Feb 2025
- 2025Control-ITRA: Controlling the Behavior of a Driving Model17 Jan 2025
- 2025ASTRA: A Scene-aware TRAnsformer-based model for trajectory prediction16 Jan 2025
- 2024ITPNet: Towards Instantaneous Trajectory Prediction for Autonomous Driving10 Dec 2024
- 2024Socially-Informed Reconstruction for Pedestrian Trajectory Forecasting5 Dec 2024
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations3 Dec 2024
- 2024Who Walks With You Matters: Perceiving Social Interactions with Groups for Pedestrian Trajectory Prediction3 Dec 2024
- 2024Understanding complex crowd dynamics with generative neural simulators2 Dec 2024
- 2024RealTraj: Towards Real-World Pedestrian Trajectory Forecasting26 Nov 2024
- 2024C2INet: Realizing Incremental Trajectory Prediction with Prior-Aware Continual Causal Intervention19 Nov 2024
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking31 Oct 2024
- 2024PMM-Net: Single-stage Multi-agent Trajectory Prediction with Patching-based Embedding and Explicit Modal Modulation25 Oct 2024
50 newest of 167 All 167 (JSON)
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 132
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillationcited by 31
- 2024Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priorscited by 28
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Predictioncited by 4
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Predictioncited by 3
- 2024DiffuTraj: A Stochastic Vessel Trajectory Prediction Approach via Guided Diffusion Processcited by 1
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Predictioncited by 1
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Predictioncited by 0
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Prediction5 Oct 2025
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation13 Mar 2025
- 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction14 Oct 2024
- 2024DiffuTraj: A Stochastic Vessel Trajectory Prediction Approach via Guided Diffusion Process12 Oct 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors18 Mar 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Prediction25 Nov 2023
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion4 Apr 2023
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Prediction20 Mar 2023
- 2025DeepFleet: Multi-Agent Foundation Models for Mobile Robots12 Aug 2025
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 111
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 67
- 2022Human Trajectory Prediction via Neural Social Physicscited by 66
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2022Adaptive Trajectory Prediction via Transferable GNNcited by 51
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2021View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrumscited by 45
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
12 most cited of 149 All 149 (JSON)
- 2026Probabilistic Pedestrian Forecasts from a Handheld Phone: World-Frame Heat Maps, Visual-Inertial Height Drift, and Evaluation without Ground Truth3 Oct 2026
- 2026Destination Support Restoration for Finite-Set Multimodal Trajectory Prediction22 Sep 2026
- 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Prediction12 Sep 2026
- 2026EgoNeMo: Transferable Map of Pedestrian Dynamics via Egocentric LiDAR Scan5 Sep 2026
- 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decomposition6 Aug 2026
- 2026Hybrid Probabilistic Zonotopes for Identifiable and Refinable Predictive Uncertainty5 Aug 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Scene-aware Prediction of Diverse Human Movement Goals29 Jun 2026
- 2026Reasonable Motion: A General ASP Foundation for Environment Constrained Movement Trajectory Computation24 Jun 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Prediction12 May 2026
12 newest of 149 All 149 (JSON)