STF: Spatial Temporal Fusion for Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Trajectory prediction is a challenging task that aims to predict the future trajectory of vehicles or pedestrians over a short time horizon based on their historical positions. The main reason is that the trajectory is a kind of complex data, including spatial and temporal information, which is crucial for accurate prediction. Intuitively, the more information the model can capture, the more precise the future trajectory can be predicted. However, previous works based on deep learning methods processed spatial and temporal information separately, leading to inadequate spatial information capture, which means they failed to capture the complete spatial information. Therefore, it is of significance to capture information more fully and effectively on vehicle interactions. In this study, we introduced an integrated 3D graph that incorporates both spatial and temporal edges. Based on this, we proposed the integrated 3D graph, which considers the cross-time interaction information. In specific, we design a Spatial-Temporal Fusion (STF) model including Multi-layer perceptions (MLP) and Graph Attention (GAT) to capture the spatial and temporal information historical trajectories simultaneously on the 3D graph. Our experiment on the ApolloScape Trajectory Datasets shows that the proposed STF outperforms several baseline methods, especially on the long-time-horizon trajectory prediction.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 24 references that are in the map. First posted on arXiv 29 Nov 2023.
Builds on
20 of 24 references.
References · 20
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
- 2021Dive into Deep Learningcited by 111
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2020PiP: Planning-informed Trajectory Prediction for Autonomous Drivingcited by 80
8 more
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2020Recursive Social Behavior Graph for Trajectory Predictioncited by 66
- 2021Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Drivingcited by 36
- 2022Social Interactions for Autonomous Driving: A Review and Perspectivescited by 27
- 2022S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Drivingcited by 22
- 2020ReCoG: A Deep Learning Framework with Heterogeneous Graph for Interaction-Aware Trajectory Predictioncited by 20
- 2019StarNet: Pedestrian Trajectory Prediction using Deep Neural Network in Star Topologycited by 17
- 2020CARPe Posterum: A Convolutional Approach for Real-time Pedestrian Path Predictioncited by 11
Built on by
Citing papers per year: 2025: 1.
1 paper.