Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Forecasting the trajectories of neighbor vehicles is a crucial step for decision making and motion planning of autonomous vehicles. This paper proposes a graph-based spatial-temporal convolutional network (GSTCN) to predict future trajectory distributions of all neighbor vehicles using past trajectories. This network tackles the spatial interactions using a graph convolutional network (GCN), and captures the temporal features with a convolutional neural network (CNN). The spatial-temporal features are encoded and decoded by a gated recurrent unit (GRU) network to generate future trajectory distributions. Besides, we propose a weighted adjacency matrix to describe the intensities of mutual influence between vehicles, and the ablation study demonstrates the effectiveness of our proposed scheme. Our network is evaluated on two real-world freeway trajectory datasets: I-80 and US-101 in the Next Generation Simulation (NGSIM).Comparisons in three aspects, including prediction errors, model sizes, and inference speeds, show that our network can achieve state-of-the-art performance.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 17 of its 55 references that are in the map. First posted on arXiv 27 Sep 2021.
Builds on
17 of 55 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
- 2018An LSTM Network for Highway Trajectory Predictioncited by 81
- 2018Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMscited by 77
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2018How would surround vehicles move? A Unified Framework for Maneuver Classification and Motion Predictioncited by 46
5 more
- 2018Bike Flow Prediction with Multi-Graph Convolutional Networkscited by 42
- 2019Contextualized Spatial-Temporal Network for Taxi Origin-Destination Demand Predictioncited by 34
- 2019Intention-aware Long Horizon Trajectory Prediction of Surrounding Vehicles using Dual LSTM Networkscited by 22
- 2019Cooperation-Aware Lane Change Maneuver in Dense Traffic based on Model Predictive Control with Recurrent Neural Networkcited by 14
- 2019Interaction-aware Kalman Neural Networks for Trajectory Predictioncited by 9
Built on by
Citing papers per year: 2022: 6; 2023: 14; 2024: 10; 2025: 5; 2026: 1.
36 papers.
Sort:
By area:
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmarkcited by 16
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022HRPose: Real-Time High-Resolution 6D Pose Estimation Network Using Knowledge Distillationcited by 11
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learningcited by 11
- 2023Holistic Graph-based Motion Predictioncited by 10
- 2023EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Predictioncited by 10
- 2023Graph-Based Interaction-Aware Multimodal 2D Vehicle Trajectory Prediction using Diffusion Graph Convolutional Networkscited by 10
- 2022Pishgu: Universal Path Prediction Network Architecture for Real-time Cyber-physical Edge Systemscited by 9
- 2023Trajectory Prediction with Observations of Variable-Length for Motion Planning in Highway Merging scenarioscited by 6
- 2024Hypergraph-based Motion Generation with Multi-modal Interaction Relational Reasoningcited by 6
- 2023Interaction-Aware Trajectory Planning for Autonomous Vehicles with Analytic Integration of Neural Networks into Model Predictive Controlcited by 5
24 more
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Predictioncited by 5
- 2023A Novel Temporal Multi-Gate Mixture-of-Experts Approach for Vehicle Trajectory and Driving Intention Predictioncited by 5
- 2024SocialFormer: Social Interaction Modeling with Edge-enhanced Heterogeneous Graph Transformers for Trajectory Predictioncited by 5
- 2024Cross-Domain Transfer Learning using Attention Latent Features for Multi-Agent Trajectory Predictioncited by 5
- 2024Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillationcited by 4
- 2022A Cooperation-Aware Lane Change Method for Autonomous Vehiclescited by 3
- 2024FollowGen: A Scaled Noise Conditional Diffusion Model for Car-Following Trajectory Predictioncited by 3
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Predictioncited by 3
- 2022Global Update Guided Federated Learningcited by 2
- 2024ESP: Extro-Spective Prediction for Long-term Behavior Reasoning in Emergency Scenarioscited by 2
- 2024Crossfusor: A Cross-Attention Transformer Enhanced Conditional Diffusion Model for Car-Following Trajectory Predictioncited by 2
- 2023STF: Spatial Temporal Fusion for Trajectory Predictioncited by 1
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Predictioncited by 1
- 2023Probabilistic Prediction of Longitudinal Trajectory Considering Driving Heterogeneity with Interpretabilitycited by 1
- 2024Graph Neural Networks in Intelligent Transportation Systems: Advances, Applications and Trendscited by 1
- 2024Trajectory Prediction for Autonomous Driving using Agent-Interaction Graph Embeddingcited by 1
- 2025Adaptive Output Steps: FlexiSteps Network for Dynamic Trajectory Predictioncited by 1
- 2023Lane Change Intention Recognition and Vehicle Status Prediction for Autonomous Vehiclescited by 0
- 2023XInsight: Revealing Model Insights for GNNs with Flow-based Explanationscited by 0
- 2023Graph Convolutional Networks for Complex Traffic Scenario Classificationcited by 0
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Modelscited by 0
- 2025Spatial Temporal Attention based Target Vehicle Trajectory Prediction for Internet of Vehiclescited by 0
- 2025Sybil-based Virtual Data Poisoning Attacks in Federated Learningcited by 0
- 2025From Camera-Based Sensing to Reasoning: A Comprehensive Review Toward Proactive Vulnerable Road User Safetycited by 0
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction11 Apr 2026
- 2025From Camera-Based Sensing to Reasoning: A Comprehensive Review Toward Proactive Vulnerable Road User Safety30 Sep 2025
- 2025Adaptive Output Steps: FlexiSteps Network for Dynamic Trajectory Prediction25 Aug 2025
- 2025Sybil-based Virtual Data Poisoning Attacks in Federated Learning15 May 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025Spatial Temporal Attention based Target Vehicle Trajectory Prediction for Internet of Vehicles1 Jan 2025
- 2024FollowGen: A Scaled Noise Conditional Diffusion Model for Car-Following Trajectory Prediction23 Nov 2024
- 2024Cross-Domain Transfer Learning using Attention Latent Features for Multi-Agent Trajectory Prediction9 Nov 2024
- 2024Trajectory Prediction for Autonomous Driving using Agent-Interaction Graph Embedding15 Oct 2024
- 2024Hypergraph-based Motion Generation with Multi-modal Interaction Relational Reasoning18 Sep 2024
- 2024Crossfusor: A Cross-Attention Transformer Enhanced Conditional Diffusion Model for Car-Following Trajectory Prediction17 Jun 2024
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models8 May 2024
24 more
- 2024ESP: Extro-Spective Prediction for Long-term Behavior Reasoning in Emergency Scenarios7 May 2024
- 2024SocialFormer: Social Interaction Modeling with Edge-enhanced Heterogeneous Graph Transformers for Trajectory Prediction6 May 2024
- 2024Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillation2 Apr 2024
- 2024Graph Neural Networks in Intelligent Transportation Systems: Advances, Applications and Trends1 Jan 2024
- 2023Probabilistic Prediction of Longitudinal Trajectory Considering Driving Heterogeneity with Interpretability19 Dec 2023
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Prediction30 Nov 2023
- 2023STF: Spatial Temporal Fusion for Trajectory Prediction29 Nov 2023
- 2023Graph Convolutional Networks for Complex Traffic Scenario Classification26 Oct 2023
- 2023Graph-Based Interaction-Aware Multimodal 2D Vehicle Trajectory Prediction using Diffusion Graph Convolutional Networks5 Sep 2023
- 2023A Novel Temporal Multi-Gate Mixture-of-Experts Approach for Vehicle Trajectory and Driving Intention Prediction1 Aug 2023
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2023Trajectory Prediction with Observations of Variable-Length for Motion Planning in Highway Merging scenarios8 Jun 2023
- 2023XInsight: Revealing Model Insights for GNNs with Flow-based Explanations7 Jun 2023
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Prediction15 May 2023
- 2023Lane Change Intention Recognition and Vehicle Status Prediction for Autonomous Vehicles25 Apr 2023
- 2023EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Prediction29 Mar 2023
- 2023Holistic Graph-based Motion Prediction31 Jan 2023
- 2023Interaction-Aware Trajectory Planning for Autonomous Vehicles with Analytic Integration of Neural Networks into Model Predictive Control13 Jan 2023
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmark19 Dec 2022
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learning2 Nov 2022
- 2022Pishgu: Universal Path Prediction Network Architecture for Real-time Cyber-physical Edge Systems14 Oct 2022
- 2022HRPose: Real-Time High-Resolution 6D Pose Estimation Network Using Knowledge Distillation20 Apr 2022
- 2022Global Update Guided Federated Learning8 Apr 2022
- 2022A Cooperation-Aware Lane Change Method for Autonomous Vehicles26 Jan 2022
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2023Interaction-Aware Trajectory Planning for Autonomous Vehicles with Analytic Integration of Neural Networks into Model Predictive Controlcited by 5
- 2024Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillationcited by 4
- 2024Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillation2 Apr 2024
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2023Interaction-Aware Trajectory Planning for Autonomous Vehicles with Analytic Integration of Neural Networks into Model Predictive Control13 Jan 2023
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmarkcited by 16
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022HRPose: Real-Time High-Resolution 6D Pose Estimation Network Using Knowledge Distillationcited by 11
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learningcited by 11
- 2023Holistic Graph-based Motion Predictioncited by 10
- 2023EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Predictioncited by 10
- 2023Graph-Based Interaction-Aware Multimodal 2D Vehicle Trajectory Prediction using Diffusion Graph Convolutional Networkscited by 10
- 2022Pishgu: Universal Path Prediction Network Architecture for Real-time Cyber-physical Edge Systemscited by 9
- 2023Trajectory Prediction with Observations of Variable-Length for Motion Planning in Highway Merging scenarioscited by 6
- 2024Hypergraph-based Motion Generation with Multi-modal Interaction Relational Reasoningcited by 6
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Predictioncited by 5
- 2023A Novel Temporal Multi-Gate Mixture-of-Experts Approach for Vehicle Trajectory and Driving Intention Predictioncited by 5
12 most cited of 30 All 30 (JSON)
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction11 Apr 2026
- 2025From Camera-Based Sensing to Reasoning: A Comprehensive Review Toward Proactive Vulnerable Road User Safety30 Sep 2025
- 2025Adaptive Output Steps: FlexiSteps Network for Dynamic Trajectory Prediction25 Aug 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025Spatial Temporal Attention based Target Vehicle Trajectory Prediction for Internet of Vehicles1 Jan 2025
- 2024Cross-Domain Transfer Learning using Attention Latent Features for Multi-Agent Trajectory Prediction9 Nov 2024
- 2024Trajectory Prediction for Autonomous Driving using Agent-Interaction Graph Embedding15 Oct 2024
- 2024Hypergraph-based Motion Generation with Multi-modal Interaction Relational Reasoning18 Sep 2024
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models8 May 2024
- 2024ESP: Extro-Spective Prediction for Long-term Behavior Reasoning in Emergency Scenarios7 May 2024
- 2024SocialFormer: Social Interaction Modeling with Edge-enhanced Heterogeneous Graph Transformers for Trajectory Prediction6 May 2024
- 2024Graph Neural Networks in Intelligent Transportation Systems: Advances, Applications and Trends1 Jan 2024
12 newest of 30 All 30 (JSON)