Safety-compliant Generative Adversarial Networks for Human Trajectory Forecasting
Not on the map. Why?
Abstract (arXiv)
Human trajectory forecasting in crowds presents the challenges of modelling social interactions and outputting collision-free multimodal distribution. Following the success of Social Generative Adversarial Networks (SGAN), recent works propose various GAN-based designs to better model human motion in crowds. Despite superior performance in reducing distance-based metrics, current networks fail to output socially acceptable trajectories, as evidenced by high collisions in model predictions. To counter this, we introduce SGANv2: an improved safety-compliant SGAN architecture equipped with spatio-temporal interaction modelling and a transformer-based discriminator. The spatio-temporal modelling ability helps to learn the human social interactions better while the transformer-based discriminator design improves temporal sequence modelling. Additionally, SGANv2 utilizes the learned discriminator even at test-time via a collaborative sampling strategy that not only refines the colliding trajectories but also prevents mode collapse, a common phenomenon in GAN training. Through extensive experimentation on multiple real-world and synthetic datasets, we demonstrate the efficacy of SGANv2 to provide socially-compliant multimodal trajectories.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 44 of its 67 references that are in the map. First posted on arXiv 25 Sep 2022.
Builds on
44 of 67 references.
References · 44
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Generative Adversarial Networkscited by 5,603
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 221
32 more
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2017Social Attention: Modeling Attention in Human Crowdscited by 185
- 2020Transformer Networks for Trajectory Forecastingcited by 180
- 2018Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learningcited by 162
- 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
- 2020Human Trajectory Forecasting in Crowds: A Deep Learning Perspectivecited by 128
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2019Peeking into the Future: Predicting Future Person Activities and Locations in Videoscited by 112
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2016Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypothesescited by 96
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2019What the Constant Velocity Model Can Teach Us About Pedestrian Motion Predictioncited by 78
- 2019Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANscited by 78
- 2018Autonomous Vehicles that Interact with Pedestrians: A Survey of Theory and Practicecited by 74
- 2019The Garden of Forking Paths: Towards Multi-Future Trajectory Predictioncited by 72
- 2020Recursive Social Behavior Graph for Trajectory Predictioncited by 66
- 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
- 2022Adaptive Trajectory Prediction via Transferable GNNcited by 51
- 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
- 2021Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspectivecited by 40
- 2021Are socially-aware trajectory prediction models really socially-aware?cited by 32
- 2020Reciprocal Learning Networks for Human Trajectory Predictioncited by 30
- 2017A Data-driven Model for Interaction-aware Pedestrian Motion Prediction in Object Cluttered Environmentscited by 23
- 2018MX-LSTM: mixing tracklets and vislets to jointly forecast trajectories and head posescited by 17
- 2019StarNet: Pedestrian Trajectory Prediction using Deep Neural Network in Star Topologycited by 17
- 2020Social-WaGDAT: Interaction-aware Trajectory Prediction via Wasserstein Graph Double-Attention Networkcited by 14
- 2019Collaborative Sampling in Generative Adversarial Networkscited by 7
- 2021PECNet: A Deep Multi-Label Segmentation Network for Eosinophilic Esophagitis Biopsy Diagnosticscited by 5
- 2019Data-Driven Crowd Simulation with Generative Adversarial Networkscited by 4
- 2017Likelihood Estimation for Generative Adversarial Networkscited by 3
- 2020EvolveGraph: Multi-Agent Trajectory Prediction with Dynamic Relational Reasoningcited by 3
- 2018Improved OpenCL-based Implementation of Social Field Pedestrian Modelcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 5; 2024: 2; 2025: 3; 2026: 1.
12 papers.
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecastingcited by 12
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 10
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2024Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarioscited by 7
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrationscited by 5
- 2023ManiCast: Collaborative Manipulation with Cost-Aware Human Forecastingcited by 4
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2023Likely, Light, and Accurate Context-Free Clusters-based Trajectory Predictioncited by 0
- 2025Towards Developing Socially Compliant Automated Vehicles: Advances, Expert Insights, and A Conceptual Frameworkcited by 0
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasetscited by 0
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsalscited by 0
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets4 Oct 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Towards Developing Socially Compliant Automated Vehicles: Advances, Expert Insights, and A Conceptual Framework10 Jan 2025
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations3 Dec 2024
- 2024Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarios18 Jul 2024
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actions21 Nov 2023
- 2023ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting20 Oct 2023
- 2023Likely, Light, and Accurate Context-Free Clusters-based Trajectory Prediction27 Jul 2023
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecasting10 May 2023
- 2023Vision-based Multi-future Trajectory Prediction: A Survey21 Feb 2023
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecasting6 Nov 2022