Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networks
Not on the map. Why?
Abstract (arXiv)
Predicting the future trajectories of multiple interacting agents in a scene has become an increasingly important problem for many different applications ranging from control of autonomous vehicles and social robots to security and surveillance. This problem is compounded by the presence of social interactions between humans and their physical interactions with the scene. While the existing literature has explored some of these cues, they mainly ignored the multimodal nature of each human's future trajectory. In this paper, we present Social-BiGAT, a graph-based generative adversarial network that generates realistic, multimodal trajectory predictions by better modelling the social interactions of pedestrians in a scene. Our method is based on a graph attention network (GAT) that learns reliable feature representations that encode the social interactions between humans in the scene, and a recurrent encoder-decoder architecture that is trained adversarially to predict, based on the features, the humans' paths. We explicitly account for the multimodal nature of the prediction problem by forming a reversible transformation between each scene and its latent noise vector, as in Bicycle-GAN. We show that our framework achieves state-of-the-art performance comparing it to several baselines on existing trajectory forecasting benchmarks.
Key facts. Cited by 229 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 61; 2022: 48; 2023: 40; 2024: 46; 2025: 21; 2026: 13.
229 papers.
Sort:
By area:
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 132
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2021Multi-Person Extreme Motion Predictioncited by 75
38 more
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Multi-Person 3D Motion Prediction with Multi-Range Transformerscited by 63
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
- 2022Adaptive Trajectory Prediction via Transferable GNNcited by 51
- 2022AdvDO: Realistic Adversarial Attacks for Trajectory Predictioncited by 49
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2021MobTCast: Leveraging Auxiliary Trajectory Forecasting for Human Mobility Predictioncited by 48
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 48
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
- 2021View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrumscited by 45
- 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2021Human Trajectory Prediction via Counterfactual Analysiscited by 42
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2022Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimationcited by 40
- 2021Divide-and-Conquer for Lane-Aware Diverse Trajectory Predictioncited by 37
- 2021Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Predictioncited by 37
- 2021RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecastingcited by 36
- 2022Graph-based Spatial Transformer with Memory Replay for Multi-future Pedestrian Trajectory Predictioncited by 36
- 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
- 2022How many Observations are Enough? Knowledge Distillation for Trajectory Forecastingcited by 35
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2021Are socially-aware trajectory prediction models really socially-aware?cited by 32
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2022Motron: Multimodal Probabilistic Human Motion Forecastingcited by 30
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2022Skeleton-Parted Graph Scattering Networks for 3D Human Motion Predictioncited by 29
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 29
- 2022Graph Neural Networks in IoT: A Surveycited by 28
- 2022Forecasting from LiDAR via Future Object Detectioncited by 28
50 most cited of 229 All 229 (JSON)
- 2026Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data9 Oct 2026
- 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction30 Sep 2026
- 2026PRISM: Predictive Representation of Interaction Style and Motion for Social Robot Navigation16 Sep 2026
- 2026Social Graph Mamba: Forecasting Pedestrian Movements Based on Social Context11 Aug 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction22 Jun 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Models14 May 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Prediction12 May 2026
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling11 May 2026
- 2026Improving Ensemble Forecasts of Abnormally Deflecting Tropical Cyclones with Fused Atmosphere-Ocean-Terrain Data31 Mar 2026
38 more
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2025ViTE: Virtual Graph Trajectory Expert Router for Pedestrian Trajectory Prediction15 Nov 2025
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
- 2025TrajGATFormer: A Graph-Based Transformer Approach for Worker and Obstacle Trajectory Prediction in Off-site Construction Environments25 Oct 2025
- 2025KoopCast: Trajectory Forecasting via Koopman Operators19 Sep 2025
- 2025Great GATsBi: Hybrid, Multimodal, Trajectory Forecasting for Bicycles using Anticipation Mechanism20 Aug 2025
- 2025OmniTraj: Pre-Training on Heterogeneous Data for Adaptive and Zero-Shot Human Trajectory Prediction31 Jul 2025
- 2025ECAM: A Contrastive Learning Approach to Avoid Environmental Collision in Trajectory Forecasting11 Jun 2025
- 2025Towards Predicting Any Human Trajectory In Context1 Jun 2025
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025Unified Uncertainty-Aware Diffusion for Multi-Agent Trajectory Modeling24 Mar 2025
- 2025Whenever, Wherever: Towards Orchestrating Crowd Simulations with Spatio-Temporal Spawn Dynamics20 Mar 2025
- 2025Stochastic Trajectory Prediction under Unstructured Constraints18 Mar 2025
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clustering6 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Driving26 Feb 2025
- 2025Unified Spatial-Temporal Edge-Enhanced Graph Networks for Pedestrian Trajectory Prediction4 Feb 2025
- 2025A Spatio-temporal Graph Network Allowing Incomplete Trajectory Input for Pedestrian Trajectory Prediction22 Jan 2025
- 2025ASTRA: A Scene-aware TRAnsformer-based model for trajectory prediction16 Jan 2025
- 2025Pedestrian Trajectory Prediction Based on Social Interactions Learning With Random Weights13 Jan 2025
- 2025Application of Vision-Language Model to Pedestrians Behavior and Scene Understanding in Autonomous Driving12 Jan 2025
- 2024FedGAT: A Privacy-Preserving Federated Approximation Algorithm for Graph Attention Networks20 Dec 2024
- 2024ITPNet: Towards Instantaneous Trajectory Prediction for Autonomous Driving10 Dec 2024
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations3 Dec 2024
- 2024DECODE: Domain-aware Continual Domain Expansion for Motion Prediction26 Nov 2024
- 2024RealTraj: Towards Real-World Pedestrian Trajectory Forecasting26 Nov 2024
- 2024Pose2Trajectory: Using Transformers on Body Pose to Predict Tennis Player's Trajectory7 Nov 2024
- 2024UnityGraph: Unified Learning of Spatio-temporal features for Multi-person Motion Prediction6 Nov 2024
- 2024Relation Learning and Aggregate-attention for Multi-person Motion Prediction6 Nov 2024
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Prediction4 Nov 2024
- 2024HiMemFormer: Hierarchical Memory-Aware Transformer for Multi-Agent Action Anticipation3 Nov 2024
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking31 Oct 2024
- 2024TranSPORTmer: A Holistic Approach to Trajectory Understanding in Multi-Agent Sports23 Oct 2024
- 2024Geometric Graph Neural Network Modeling of Human Interactions in Crowded Environments22 Oct 2024
- 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction14 Oct 2024
- 2024DiffuTraj: A Stochastic Vessel Trajectory Prediction Approach via Guided Diffusion Process12 Oct 2024
- 2024A Gentle Introduction and Tutorial on Deep Generative Models in Transportation Research9 Oct 2024
50 newest of 229 All 229 (JSON)
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 132
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Predictioncited by 18
- 2024Social Physics Informed Diffusion Model for Crowd Simulationcited by 11
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Predictioncited by 4
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modelingcited by 3
- 2024DiffuTraj: A Stochastic Vessel Trajectory Prediction Approach via Guided Diffusion Processcited by 1
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling11 May 2026
- 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction14 Oct 2024
- 2024DiffuTraj: A Stochastic Vessel Trajectory Prediction Approach via Guided Diffusion Process12 Oct 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2024Social Physics Informed Diffusion Model for Crowd Simulation8 Feb 2024
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Prediction23 Oct 2023
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Prediction20 Mar 2023
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2021Learning by Watchingcited by 22
- 2024Conformal Trajectory Prediction with Multi-View Data Integration in Cooperative Drivingcited by 3
- 2024Conformal Trajectory Prediction with Multi-View Data Integration in Cooperative Driving1 Aug 2024
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May 2022
- 2021Learning by Watching10 Jun 2021
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Driving19 Apr 2021
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2021Multi-Person Extreme Motion Predictioncited by 75
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Multi-Person 3D Motion Prediction with Multi-Range Transformerscited by 63
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
12 most cited of 208 All 208 (JSON)
- 2026Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data9 Oct 2026
- 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction30 Sep 2026
- 2026PRISM: Predictive Representation of Interaction Style and Motion for Social Robot Navigation16 Sep 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction22 Jun 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Prediction12 May 2026
- 2026Improving Ensemble Forecasts of Abnormally Deflecting Tropical Cyclones with Fused Atmosphere-Ocean-Terrain Data31 Mar 2026
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2025ViTE: Virtual Graph Trajectory Expert Router for Pedestrian Trajectory Prediction15 Nov 2025
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
12 newest of 208 All 208 (JSON)