It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Human trajectory forecasting with multiple socially interacting agents is of critical importance for autonomous navigation in human environments, e.g., for self-driving cars and social robots. In this work, we present Predicted Endpoint Conditioned Network (PECNet) for flexible human trajectory prediction. PECNet infers distant trajectory endpoints to assist in long-range multi-modal trajectory prediction. A novel non-local social pooling layer enables PECNet to infer diverse yet socially compliant trajectories. Additionally, we present a simple "truncation-trick" for improving few-shot multi-modal trajectory prediction performance. We show that PECNet improves state-of-the-art performance on the Stanford Drone trajectory prediction benchmark by ~20.9% and on the ETH/UCY benchmark by ~40.8%. Project homepage: https://karttikeya.github.io/publication/htf/
Key facts. Cited by 235 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 44; 2023: 38; 2024: 51; 2025: 28; 2026: 23.
235 papers.
Sort:
By area:
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 110
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
38 more
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
- 2022Human Trajectory Prediction via Neural Social Physicscited by 66
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2021Multi-Person 3D Motion Prediction with Multi-Range Transformerscited by 63
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
- 2022P3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervisioncited by 52
- 2022Adaptive Trajectory Prediction via Transferable GNNcited by 51
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
- 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
- 2021View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrumscited by 44
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2021Human Trajectory Prediction via Counterfactual Analysiscited by 42
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2021Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspectivecited by 40
- 2021Spectral Temporal Graph Neural Network for Trajectory Predictioncited by 36
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2021Are socially-aware trajectory prediction models really socially-aware?cited by 32
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 28
- 2022Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoningcited by 28
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 28
- 2023Stochastic Multi-Person 3D Motion Forecastingcited by 28
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
- 2023SocialCircle: Learning the Angle-based Social Interaction Representation for Pedestrian Trajectory Predictioncited by 27
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2024LG-Traj: LLM Guided Pedestrian Trajectory Predictioncited by 24
50 most cited of 235 All 235 (JSON)
- 2026Destination Support Restoration for Finite-Set Multimodal Trajectory Prediction22 Sep 2026
- 2026PRISM: Predictive Representation of Interaction Style and Motion for Social Robot Navigation16 Sep 2026
- 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Prediction12 Sep 2026
- 2026Social Graph Mamba: Forecasting Pedestrian Movements Based on Social Context11 Aug 2026
- 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decomposition6 Aug 2026
- 2026Hybrid Probabilistic Zonotopes for Identifiable and Refinable Predictive Uncertainty5 Aug 2026
- 2026NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVectorized Lane Priors and the NaviLane Forecasting Framework21 Jul 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Scene-aware Prediction of Diverse Human Movement Goals29 Jun 2026
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning23 Jun 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
38 more
- 2026Sparse Compositional Flow Matching by geometric assembly from motion primitives22 May 2026
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling11 May 2026
- 2026SceneSelect: Selective Learning for Trajectory Scene Classification and Expert Scheduling27 Apr 2026
- 2026RankFormer: A Propose-then-Select Transformer for Multi-Agent Multimodal Trajectory Prediction8 Apr 2026
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles6 Apr 2026
- 2026STDDN: A Physics-Guided Deep Learning Framework for Crowd Simulation3 Apr 2026
- 2026Forecasting Motion in the Wild1 Apr 2026
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibration11 Feb 2026
- 2026AGMA: Adaptive Gaussian Mixture Anchors for Prior-Guided Multimodal Human Trajectory Forecasting4 Feb 2026
- 2025MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving3 Dec 2025
- 2025Unified Multimodal Vessel Trajectory Prediction with Explainable Navigation Intention18 Nov 2025
- 2025ViTE: Virtual Graph Trajectory Expert Router for Pedestrian Trajectory Prediction15 Nov 2025
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Prediction5 Oct 2025
- 2025KoopCast: Trajectory Forecasting via Koopman Operators19 Sep 2025
- 2025Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Survey11 Sep 2025
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network11 Sep 2025
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction10 Aug 2025
- 2025A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Games28 Jul 2025
- 2025PatchTraj: Unified Time-Frequency Representation Learning via Dynamic Patches for Trajectory Prediction25 Jul 2025
- 2025AMD: Adaptive Momentum and Decoupled Contrastive Learning Framework for Robust Long-Tail Trajectory Prediction2 Jul 2025
- 2025IDRIFTNET: Physics-Driven Spatiotemporal Deep Learning for Iceberg Drift Forecasting18 Jun 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025ECAM: A Contrastive Learning Approach to Avoid Environmental Collision in Trajectory Forecasting11 Jun 2025
- 2025Towards Predicting Any Human Trajectory In Context1 Jun 2025
- 2025SocialMOIF: Multi-Order Intention Fusion for Pedestrian Trajectory Prediction22 Apr 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025Learning Velocity and Acceleration: Self-Supervised Motion Consistency for Pedestrian Trajectory Prediction31 Mar 2025
- 2025Unified Uncertainty-Aware Diffusion for Multi-Agent Trajectory Modeling24 Mar 2025
- 2025Stochastic Trajectory Prediction under Unstructured Constraints18 Mar 2025
- 2025SGNetPose+: Stepwise Goal-Driven Networks with Pose Information for Trajectory Prediction in Autonomous Driving11 Mar 2025
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clustering6 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction20 Feb 2025
- 2025Sea-cret Agents: Maritime Abduction for Region Generation to Expose Dark Vessel Trajectories3 Feb 2025
- 2025Control-ITRA: Controlling the Behavior of a Driving Model17 Jan 2025
50 newest of 235 All 235 (JSON)
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2024Geometric Trajectory Diffusion Modelscited by 13
- 2024Social Physics Informed Diffusion Model for Crowd Simulationcited by 11
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2024Joint Pedestrian Trajectory Prediction through Posterior Samplingcited by 10
- 2024Predicting Long-Term Human Behaviors in Discrete Representations via Physics-Guided Diffusioncited by 6
- 2024Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Predictioncited by 4
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Predictioncited by 3
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modelingcited by 3
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Predictioncited by 1
12 most cited of 14 All 14 (JSON)
- 2026Sparse Compositional Flow Matching by geometric assembly from motion primitives22 May 2026
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling11 May 2026
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Prediction5 Oct 2025
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction10 Aug 2025
- 2024Geometric Trajectory Diffusion Models16 Oct 2024
- 2024Predicting Long-Term Human Behaviors in Discrete Representations via Physics-Guided Diffusion29 May 2024
- 2024Joint Pedestrian Trajectory Prediction through Posterior Sampling30 Mar 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2024Social Physics Informed Diffusion Model for Crowd Simulation8 Feb 2024
- 2024Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Prediction5 Jan 2024
12 newest of 14 All 14 (JSON)
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 110
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
12 most cited of 212 All 212 (JSON)
- 2026Destination Support Restoration for Finite-Set Multimodal Trajectory Prediction22 Sep 2026
- 2026PRISM: Predictive Representation of Interaction Style and Motion for Social Robot Navigation16 Sep 2026
- 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Prediction12 Sep 2026
- 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decomposition6 Aug 2026
- 2026Hybrid Probabilistic Zonotopes for Identifiable and Refinable Predictive Uncertainty5 Aug 2026
- 2026NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVectorized Lane Priors and the NaviLane Forecasting Framework21 Jul 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Scene-aware Prediction of Diverse Human Movement Goals29 Jun 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2026SceneSelect: Selective Learning for Trajectory Scene Classification and Expert Scheduling27 Apr 2026
- 2026RankFormer: A Propose-then-Select Transformer for Multi-Agent Multimodal Trajectory Prediction8 Apr 2026
12 newest of 212 All 212 (JSON)