Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimation
Not on the map. Why?
Abstract (arXiv)
In this paper, we present Goal-GAN, an interpretable and end-to-end trainable model for human trajectory prediction. Inspired by human navigation, we model the task of trajectory prediction as an intuitive two-stage process: (i) goal estimation, which predicts the most likely target positions of the agent, followed by a (ii) routing module which estimates a set of plausible trajectories that route towards the estimated goal. We leverage information about the past trajectory and visual context of the scene to estimate a multi-modal probability distribution over the possible goal positions, which is used to sample a potential goal during the inference. The routing is governed by a recurrent neural network that reacts to physical constraints in the nearby surroundings and generates feasible paths that route towards the sampled goal. Our extensive experimental evaluation shows that our method establishes a new state-of-the-art on several benchmarks while being able to generate a realistic and diverse set of trajectories that conform to physical constraints.
Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 12; 2023: 13; 2024: 8; 2025: 12; 2026: 5.
57 papers.
Sort:
By area:
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 120
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 111
- 2022Don't Change the Algorithm, Change the Data: Exploratory Data for Offline Reinforcement Learningcited by 96
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 29
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 29
- 2022Forecasting from LiDAR via Future Object Detectioncited by 28
38 more
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2021Self-Paced Context Evaluation for Contextual Reinforcement Learningcited by 25
- 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistantscited by 23
- 2025Learning to Reason at the Frontier of Learnabilitycited by 23
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Mapscited by 22
- 2023Proximal Curriculum for Reinforcement Learning Agentscited by 20
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2022D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lightscited by 10
- 2022Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encodingcited by 8
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Predictioncited by 7
- 2023Conditional Unscented Autoencoders for Trajectory Predictioncited by 7
- 2024Proximal Curriculum with Task Correlations for Deep Reinforcement Learningcited by 7
- 2025Continuous Locomotive Crowd Behavior Generationcited by 7
- 2022Exploring Attention GAN for Vehicle Motion Predictioncited by 6
- 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowdscited by 6
- 2021Hierarchical Motion Encoder-Decoder Network for Trajectory Forecastingcited by 4
- 2022The Stanford Drone Dataset is More Complex than We Think: An Analysis of Key Characteristicscited by 4
- 2021Predicting Physical World Destinations for Commands Given to Self-Driving Carscited by 3
- 2023Efficient Baselines for Motion Prediction in Autonomous Drivingcited by 3
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Predictioncited by 3
- 2025Mimir: Hierarchical Goal-Driven Diffusion with Uncertainty Propagation for End-to-End Autonomous Drivingcited by 3
- 2021Conditional Generative Adversarial Networks for Speed Control in Trajectory Simulationcited by 2
- 2023Integrating spoken instructions into flight trajectory prediction to optimize automation in air traffic controlcited by 2
- 2023Accelerate Multi-Agent Reinforcement Learning in Zero-Sum Games with Subgame Curriculum Learningcited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2025cMALC-D: Contextual Multi-Agent LLM-Guided Curriculum Learning with Diversity-Based Context Blendingcited by 2
- 2025E3AD: An Emotion-Aware Vision-Language-Action Model for Human-Centric End-to-End Autonomous Drivingcited by 2
- 2022Exploring Map-based Features for Efficient Attention-based Vehicle Motion Predictioncited by 1
- 2025Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenariocited by 1
- 2025SceneAware: Scene-Constrained Pedestrian Trajectory Prediction with LLM-Guided Walkabilitycited by 1
- 2026Adaptive Time Step Flow Matching for Autonomous Driving Motion Planningcited by 1
- 2021Recursive Least Squares Based Refinement Network for the Rollout Trajectory Prediction Methodscited by 0
- 2023Likely, Light, and Accurate Context-Free Clusters-based Trajectory Predictioncited by 0
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Predictioncited by 0
- 2024LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Realitycited by 0
- 2024Characterized Diffusion Networks for Enhanced Autonomous Driving Trajectory Predictioncited by 0
50 most cited of 57 All 57 (JSON)
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics28 Jul 2026
- 2026Scene-aware Prediction of Diverse Human Movement Goals29 Jun 2026
- 2026Improving Ensemble Forecasts of Abnormally Deflecting Tropical Cyclones with Fused Atmosphere-Ocean-Terrain Data31 Mar 2026
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2026Adaptive Time Step Flow Matching for Autonomous Driving Motion Planning10 Feb 2026
- 2025Mimir: Hierarchical Goal-Driven Diffusion with Uncertainty Propagation for End-to-End Autonomous Driving8 Dec 2025
- 2025E3AD: An Emotion-Aware Vision-Language-Action Model for Human-Centric End-to-End Autonomous Driving4 Dec 2025
- 2025Fill in the Blanks: Accelerating Q-Learning with a Handful of Demonstrations in Sparse Reward Settings28 Oct 2025
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Prediction1 Oct 2025
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network11 Sep 2025
- 2025cMALC-D: Contextual Multi-Agent LLM-Guided Curriculum Learning with Diversity-Based Context Blending28 Aug 2025
- 2025SceneAware: Scene-Constrained Pedestrian Trajectory Prediction with LLM-Guided Walkability17 Jun 2025
38 more
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Driving7 Mar 2025
- 2025Learning to Reason at the Frontier of Learnability17 Feb 2025
- 2025Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenario18 Jan 2025
- 2024Characterized Diffusion Networks for Enhanced Autonomous Driving Trajectory Prediction25 Nov 2024
- 2024LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Reality9 Oct 2024
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Prediction26 Jun 2024
- 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowds26 May 2024
- 2024Proximal Curriculum with Task Correlations for Deep Reinforcement Learning3 May 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction27 Mar 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Prediction25 Nov 2023
- 2023Conditional Unscented Autoencoders for Trajectory Prediction30 Oct 2023
- 2023Accelerate Multi-Agent Reinforcement Learning in Zero-Sum Games with Subgame Curriculum Learning7 Oct 2023
- 2023Efficient Baselines for Motion Prediction in Autonomous Driving6 Sep 2023
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Prediction17 Aug 2023
- 2023Likely, Light, and Accurate Context-Free Clusters-based Trajectory Prediction27 Jul 2023
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecasting18 Jul 2023
- 2023Integrating spoken instructions into flight trajectory prediction to optimize automation in air traffic control2 May 2023
- 2023Proximal Curriculum for Reinforcement Learning Agents25 Apr 2023
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion4 Apr 2023
- 2023Vision-based Multi-future Trajectory Prediction: A Survey21 Feb 2023
- 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction15 Feb 2023
- 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistants12 Jan 2023
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?14 Oct 2022
- 2022Exploring Attention GAN for Vehicle Motion Prediction26 Sep 2022
- 2022D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lights21 Jul 2022
- 2022Exploring Map-based Features for Efficient Attention-based Vehicle Motion Prediction25 May 2022
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Prediction25 Apr 2022
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos4 Apr 2022
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps31 Mar 2022
- 2022Forecasting from LiDAR via Future Object Detection30 Mar 2022
- 2022SMEMO: Social Memory for Trajectory Forecasting23 Mar 2022
- 2022The Stanford Drone Dataset is More Complex than We Think: An Analysis of Key Characteristics22 Mar 2022
- 2022Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding3 Feb 2022
- 2022Don't Change the Algorithm, Change the Data: Exploratory Data for Offline Reinforcement Learning31 Jan 2022
50 newest of 57 All 57 (JSON)
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 120
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Predictioncited by 3
- 2025Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenariocited by 1
- 2026Adaptive Time Step Flow Matching for Autonomous Driving Motion Planningcited by 1
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Predictioncited by 0
- 2026Adaptive Time Step Flow Matching for Autonomous Driving Motion Planning10 Feb 2026
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Prediction1 Oct 2025
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Driving7 Mar 2025
- 2025Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenario18 Jan 2025
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Prediction25 Nov 2023
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion4 Apr 2023
- 2023Efficient Baselines for Motion Prediction in Autonomous Drivingcited by 3
- 2025Mimir: Hierarchical Goal-Driven Diffusion with Uncertainty Propagation for End-to-End Autonomous Drivingcited by 3
- 2025E3AD: An Emotion-Aware Vision-Language-Action Model for Human-Centric End-to-End Autonomous Drivingcited by 2
- 2025Mimir: Hierarchical Goal-Driven Diffusion with Uncertainty Propagation for End-to-End Autonomous Driving8 Dec 2025
- 2025E3AD: An Emotion-Aware Vision-Language-Action Model for Human-Centric End-to-End Autonomous Driving4 Dec 2025
- 2023Efficient Baselines for Motion Prediction in Autonomous Driving6 Sep 2023
- 2025Learning to Reason at the Frontier of Learnabilitycited by 23
- 2025Learning to Reason at the Frontier of Learnability17 Feb 2025
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 111
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 29
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 29
- 2022Forecasting from LiDAR via Future Object Detectioncited by 28
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2021Self-Paced Context Evaluation for Contextual Reinforcement Learningcited by 25
- 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistantscited by 23
12 most cited of 40 All 40 (JSON)
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics28 Jul 2026
- 2026Scene-aware Prediction of Diverse Human Movement Goals29 Jun 2026
- 2026Improving Ensemble Forecasts of Abnormally Deflecting Tropical Cyclones with Fused Atmosphere-Ocean-Terrain Data31 Mar 2026
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network11 Sep 2025
- 2025SceneAware: Scene-Constrained Pedestrian Trajectory Prediction with LLM-Guided Walkability17 Jun 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2024Characterized Diffusion Networks for Enhanced Autonomous Driving Trajectory Prediction25 Nov 2024
- 2024LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Reality9 Oct 2024
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Prediction26 Jun 2024
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction27 Mar 2024
12 newest of 40 All 40 (JSON)