Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Better machine understanding of pedestrian behaviors enables faster progress in modeling interactions between agents such as autonomous vehicles and humans. Pedestrian trajectories are not only influenced by the pedestrian itself but also by interaction with surrounding objects. Previous methods modeled these interactions by using a variety of aggregation methods that integrate different learned pedestrians states. We propose the Social Spatio-Temporal Graph Convolutional Neural Network (Social-STGCNN), which substitutes the need of aggregation methods by modeling the interactions as a graph. Our results show an improvement over the state of art by 20% on the Final Displacement Error (FDE) and an improvement on the Average Displacement Error (ADE) with 8.5 times less parameters and up to 48 times faster inference speed than previously reported methods. In addition, our model is data efficient, and exceeds previous state of the art on the ADE metric with only 20% of the training data. We propose a kernel function to embed the social interactions between pedestrians within the adjacency matrix. Through qualitative analysis, we show that our model inherited social behaviors that can be expected between pedestrians trajectories. Code is available at https://github.com/abduallahmohamed/Social-STGCNN.
Key facts. Cited by 324 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 56; 2022: 59; 2023: 55; 2024: 63; 2025: 60; 2026: 31.
324 papers.
Sort:
By area:
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 110
- 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
- 2021Mutual Graph Learning for Camouflaged Object Detectioncited by 103
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
38 more
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2022A Survey on Graph Representation Learning Methodscited by 66
- 2022Human Trajectory Prediction via Neural Social Physicscited by 66
- 2021Multi-Person 3D Motion Prediction with Multi-Range Transformerscited by 63
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2023Graph-based Topology Reasoning for Driving Scenescited by 53
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
- 2022Adaptive Trajectory Prediction via Transferable GNNcited by 51
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
- 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
- 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
- 2021View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrumscited by 44
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2021Human Trajectory Prediction via Counterfactual Analysiscited by 42
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2022Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimationcited by 40
- 2021Spectral Temporal Graph Neural Network for Trajectory Predictioncited by 36
- 2021RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecastingcited by 36
- 2021Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Drivingcited by 36
- 2022Graph-based Spatial Transformer with Memory Replay for Multi-future Pedestrian Trajectory Predictioncited by 36
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2022Learning Optical Flow with Adaptive Graph Reasoningcited by 33
- 2021Are socially-aware trajectory prediction models really socially-aware?cited by 32
- 2022SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Drivingcited by 31
- 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 31
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2021A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videoscited by 28
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 28
- 2022Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoningcited by 28
- 2022Graph Neural Networks in IoT: A Surveycited by 27
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
50 most cited of 324 All 324 (JSON)
- 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction30 Sep 2026
- 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Prediction12 Sep 2026
- 2026MamMA: A Mamba-Based Pedestrian Trajectory Prediction Algorithm Considering Occupancy Map and Pedestrian Awareness States7 Sep 2026
- 2026Uncertainty-Aware Trajectory Forecasting from Imperfect Tracking31 Aug 2026
- 2026Social Graph Mamba: Forecasting Pedestrian Movements Based on Social Context11 Aug 2026
- 2026Entity-Aware Sequence Transduction for Player-Centric Ball Action Spotting3 Aug 2026
- 2026Inferring Missing Trajectory Data with Temporal Convolutional Networks27 Jul 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Towards Metric-Agnostic Trajectory Forecasting1 Jul 2026
- 2026TrajRS: Towards Certified Robustness in Pedestrian Trajectory Prediction27 Jun 2026
- 2026Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction22 Jun 2026
38 more
- 2026EnvShip: A Unified Framework for Context-Aware and Cross-Region Vessel Trajectory Forecasting13 Jun 2026
- 2026AIS-Based Vessel Trajectory Prediction Using Memory-Augmented Neural Networks4 Jun 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026Agent-Centric Social Trajectory Prediction: A Free Energy Principle Perspective25 May 2026
- 2026Sparse Compositional Flow Matching by geometric assembly from motion primitives22 May 2026
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026DeCoR: Design and Control Co-Optimization for Urban Streets Using Reinforcement Learning20 May 2026
- 2026Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Models14 May 2026
- 2026Exploitation of Hidden Context in Dynamic Movement Forecasting: A Neural Network Journey from Recurrent to Graph Neural Networks and General Purpose Transformers14 May 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Prediction12 May 2026
- 2026Learning from the Unseen: Generative Data Augmentation for Geometric-Semantic Accident Anticipation29 Apr 2026
- 2026ESIA: An Energy-Based Spatiotemporal Interaction-Aware Framework for Pedestrian Intention Prediction26 Apr 2026
- 2026EdgeVTP: Exploration of Latency-efficient Trajectory Prediction for Edge-based Embedded Vision Applications18 Apr 2026
- 2026STDDN: A Physics-Guided Deep Learning Framework for Crowd Simulation3 Apr 2026
- 2026Towards Explainable Deep Learning for Ship Trajectory Prediction in Inland Waterways4 Mar 2026
- 2026Robust Human Trajectory Prediction via Self-Supervised Skeleton Representation Learning26 Feb 2026
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibration11 Feb 2026
- 2026Length-Aware Adversarial Training for Variable-Length Trajectories: Digital Twins for Mall Shopper Paths4 Jan 2026
- 2025Decoupled Generative Modeling for Human-Object Interaction Synthesis22 Dec 2025
- 20253D Human-Human Interaction Anomaly Detection15 Dec 2025
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025Mitigating Structural Overfitting: A Distribution-Aware Rectification Framework for Missing Feature Imputation6 Dec 2025
- 2025MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving3 Dec 2025
- 2025City-Conditioned Memory for Multi-City Traffic and Mobility Forecasting30 Nov 2025
- 2025Hierarchical Spatio-Temporal Attention Network with Adaptive Risk-Aware Decision for Forward Collision Warning in Complex Scenarios25 Nov 2025
- 2025GContextFormer: A global context-aware hybrid multi-head attention approach with scaled additive aggregation for multimodal trajectory prediction24 Nov 2025
- 2025CubeletWorld: A New Abstraction for Scalable 3D Modeling21 Nov 2025
- 2025ViTE: Virtual Graph Trajectory Expert Router for Pedestrian Trajectory Prediction15 Nov 2025
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction13 Nov 2025
- 2025Part-Aware Bottom-Up Group Reasoning for Fine-Grained Social Interaction Detection5 Nov 2025
- 2025PEDRA: Evaluating the Realism of Pedestrian Dynamics in Video Generation23 Oct 2025
- 2025Can Image-To-Video Models Simulate Pedestrian Dynamics?20 Oct 2025
- 2025Mapping the Urban Mobility Intelligence Frontier: A Scientometric Analysis of Data-Driven Pedestrian Trajectory Prediction and Simulation11 Oct 2025
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Prediction5 Oct 2025
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Prediction1 Oct 2025
- 2025From Camera-Based Sensing to Reasoning: A Comprehensive Review Toward Proactive Vulnerable Road User Safety30 Sep 2025
50 newest of 324 All 324 (JSON)
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Predictioncited by 18
- 2024Social Physics Informed Diffusion Model for Crowd Simulationcited by 11
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2024Multi-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Predictioncited by 6
- 2023Dual Diffusion Architecture for Fisheye Image Rectification: Synthetic-to-Real Generalizationcited by 5
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
- 2025STGDPM:Vessel Trajectory Prediction with Spatio-Temporal Graph Diffusion Probabilistic Modelcited by 1
- 2025Learning dissection trajectories from expert surgical videos via imitation learning with equivariant diffusioncited by 1
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Predictioncited by 1
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusioncited by 1
12 most cited of 16 All 16 (JSON)
- 2026Sparse Compositional Flow Matching by geometric assembly from motion primitives22 May 2026
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Prediction5 Oct 2025
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Prediction1 Oct 2025
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusion28 Sep 2025
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction10 Aug 2025
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction6 Aug 2025
- 2025Learning dissection trajectories from expert surgical videos via imitation learning with equivariant diffusion5 Jun 2025
- 2025STGDPM:Vessel Trajectory Prediction with Spatio-Temporal Graph Diffusion Probabilistic Model11 Mar 2025
- 2024Multi-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Prediction29 May 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
12 newest of 16 All 16 (JSON)
- 2024Sports-Traj: A Unified Trajectory Generation Model for Multi-Agent Movement in Sportscited by 19
- 2025Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSMcited by 17
- 2026Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Modelscited by 1
- 2025Hazy Pedestrian Trajectory Prediction via Physical Priors and Graph-Mambacited by 0
- 2026Social Graph Mamba: Forecasting Pedestrian Movements Based on Social Contextcited by 0
- 2026Social Graph Mamba: Forecasting Pedestrian Movements Based on Social Context11 Aug 2026
- 2026Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Models14 May 2026
- 2025Hazy Pedestrian Trajectory Prediction via Physical Priors and Graph-Mamba28 Sep 2025
- 2025Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSM13 Mar 2025
- 2024Sports-Traj: A Unified Trajectory Generation Model for Multi-Agent Movement in Sports27 May 2024
- 2025Can Image-To-Video Models Simulate Pedestrian Dynamics?cited by 1
- 2025Can Image-To-Video Models Simulate Pedestrian Dynamics?20 Oct 2025
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 110
- 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
- 2021Mutual Graph Learning for Camouflaged Object Detectioncited by 103
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
12 most cited of 295 All 295 (JSON)
- 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction30 Sep 2026
- 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Prediction12 Sep 2026
- 2026MamMA: A Mamba-Based Pedestrian Trajectory Prediction Algorithm Considering Occupancy Map and Pedestrian Awareness States7 Sep 2026
- 2026Uncertainty-Aware Trajectory Forecasting from Imperfect Tracking31 Aug 2026
- 2026Entity-Aware Sequence Transduction for Player-Centric Ball Action Spotting3 Aug 2026
- 2026Inferring Missing Trajectory Data with Temporal Convolutional Networks27 Jul 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Towards Metric-Agnostic Trajectory Forecasting1 Jul 2026
- 2026TrajRS: Towards Certified Robustness in Pedestrian Trajectory Prediction27 Jun 2026
- 2026Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction22 Jun 2026
- 2026EnvShip: A Unified Framework for Context-Aware and Cross-Region Vessel Trajectory Forecasting13 Jun 2026
12 newest of 295 All 295 (JSON)