Goal-driven Self-Attentive Recurrent Networks for Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Human trajectory forecasting is a key component of autonomous vehicles, social-aware robots and advanced video-surveillance applications. This challenging task typically requires knowledge about past motion, the environment and likely destination areas. In this context, multi-modality is a fundamental aspect and its effective modeling can be beneficial to any architecture. Inferring accurate trajectories is nevertheless challenging, due to the inherently uncertain nature of the future. To overcome these difficulties, recent models use different inputs and propose to model human intentions using complex fusion mechanisms. In this respect, we propose a lightweight attention-based recurrent backbone that acts solely on past observed positions. Although this backbone already provides promising results, we demonstrate that its prediction accuracy can be improved considerably when combined with a scene-aware goal-estimation module. To this end, we employ a common goal module, based on a U-Net architecture, which additionally extracts semantic information to predict scene-compliant destinations. We conduct extensive experiments on publicly-available datasets (i.e. SDD, inD, ETH/UCY) and show that our approach performs on par with state-of-the-art techniques while reducing model complexity.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 25 Apr 2022.
Builds on
33 of 47 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2017Automatic Goal Generation for Reinforcement Learning Agentscited by 252
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
21 more
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2017Social Attention: Modeling Attention in Human Crowdscited by 185
- 2020Transformer Networks for Trajectory Forecastingcited by 180
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 166
- 2019The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersectionscited by 137
- 2020Human Trajectory Forecasting in Crowds: A Deep Learning Perspectivecited by 128
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2019What the Constant Velocity Model Can Teach Us About Pedestrian Motion Predictioncited by 78
- 2019The Garden of Forking Paths: Towards Multi-Future Trajectory Predictioncited by 72
- 2020MANTRA: Memory Augmented Networks for Multiple Trajectory Predictioncited by 69
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2020Trajectron++: Dynamically-Feasible Trajectory Forecasting With Heterogeneous Datacited by 58
- 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
- 2020Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimationcited by 57
- 2018Learning Actionable Representations with Goal-Conditioned Policiescited by 53
- 2017CAR-Net: Clairvoyant Attentive Recurrent Networkcited by 34
- 2019Looking to Relations for Future Trajectory Forecastcited by 23
- 2019Social and Scene-Aware Trajectory Prediction in Crowded Spacescited by 19
- 2020AC-VRNN: Attentive Conditional-VRNN for Multi-Future Trajectory Predictioncited by 16
- 2016Knowledge Transfer for Scene-specific Motion Predictioncited by 11
Built on by
Citing papers per year: 2022: 3; 2023: 9; 2024: 8; 2025: 6; 2026: 2.
28 papers.
Sort:
By area:
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2024Adapting to Length Shift: FlexiLength Network for Trajectory Predictioncited by 22
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarkingcited by 8
- 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Predictioncited by 7
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Predictioncited by 5
- 2023Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learningcited by 4
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Predictioncited by 3
16 more
- 2024CCF: Cross Correcting Framework for Pedestrian Trajectory Predictioncited by 2
- 2024Remember and Recall: Associative-Memory-based Trajectory Predictioncited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
- 2022Learning a Pedestrian Social Behavior Dictionarycited by 1
- 2023Improving Trajectory Prediction in Dynamic Multi-Agent Environment by Dropping Waypointscited by 1
- 2023GSGFormer: Generative Social Graph Transformer for Multimodal Pedestrian Trajectory Predictioncited by 1
- 2024PMM-Net: Single-stage Multi-agent Trajectory Prediction with Patching-based Embedding and Explicit Modal Modulationcited by 1
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Predictioncited by 1
- 2022KP-RNN: A Deep Learning Pipeline for Human Motion Prediction and Synthesis of Performance Artcited by 0
- 2024Efficient and Interpretable Traffic Destination Prediction using Explainable Boosting Machinescited by 0
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Predictioncited by 0
- 2025Whenever, Wherever: Towards Orchestrating Crowd Simulations with Spatio-Temporal Spawn Dynamicscited by 0
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Networkcited by 0
- 2026Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videoscited by 0
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Predictioncited by 0
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos17 Jun 2026
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network11 Sep 2025
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction10 Aug 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Whenever, Wherever: Towards Orchestrating Crowd Simulations with Spatio-Temporal Spawn Dynamics20 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking31 Oct 2024
- 2024PMM-Net: Single-stage Multi-agent Trajectory Prediction with Patching-based Embedding and Explicit Modal Modulation25 Oct 2024
- 2024Remember and Recall: Associative-Memory-based Trajectory Prediction3 Oct 2024
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Prediction26 Jun 2024
16 more
- 2024CCF: Cross Correcting Framework for Pedestrian Trajectory Prediction2 Jun 2024
- 2024Adapting to Length Shift: FlexiLength Network for Trajectory Prediction31 Mar 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2024Efficient and Interpretable Traffic Destination Prediction using Explainable Boosting Machines5 Feb 2024
- 2023GSGFormer: Generative Social Graph Transformer for Multimodal Pedestrian Trajectory Prediction7 Dec 2023
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Prediction25 Nov 2023
- 2023Improving Trajectory Prediction in Dynamic Multi-Agent Environment by Dropping Waypoints29 Sep 2023
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Prediction15 May 2023
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecasting10 May 2023
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Prediction28 Mar 2023
- 2023Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learning24 Mar 2023
- 2023Vision-based Multi-future Trajectory Prediction: A Survey21 Feb 2023
- 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Prediction15 Feb 2023
- 2022Learning a Pedestrian Social Behavior Dictionary2 Dec 2022
- 2022Behavioral Intention Prediction in Driving Scenes: A Survey1 Nov 2022
- 2022KP-RNN: A Deep Learning Pipeline for Human Motion Prediction and Synthesis of Performance Art9 Oct 2022
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2024Adapting to Length Shift: FlexiLength Network for Trajectory Predictioncited by 22
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarkingcited by 8
- 2023ForceFormer: Exploring Social Force and Transformer for Pedestrian Trajectory Predictioncited by 7
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Predictioncited by 5
- 2024CCF: Cross Correcting Framework for Pedestrian Trajectory Predictioncited by 2
- 2024Remember and Recall: Associative-Memory-based Trajectory Predictioncited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
12 most cited of 24 All 24 (JSON)
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos17 Jun 2026
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network11 Sep 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Whenever, Wherever: Towards Orchestrating Crowd Simulations with Spatio-Temporal Spawn Dynamics20 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking31 Oct 2024
- 2024PMM-Net: Single-stage Multi-agent Trajectory Prediction with Patching-based Embedding and Explicit Modal Modulation25 Oct 2024
- 2024Remember and Recall: Associative-Memory-based Trajectory Prediction3 Oct 2024
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Prediction26 Jun 2024
- 2024CCF: Cross Correcting Framework for Pedestrian Trajectory Prediction2 Jun 2024
12 newest of 24 All 24 (JSON)