Pedestrian Trajectory Prediction via Spatial Interaction Transformer Network
Not on the map. Why?
Abstract (arXiv)
As a core technology of the autonomous driving system, pedestrian trajectory prediction can significantly enhance the function of active vehicle safety and reduce road traffic injuries. In traffic scenes, when encountering with oncoming people, pedestrians may make sudden turns or stop immediately, which often leads to complicated trajectories. To predict such unpredictable trajectories, we can gain insights into the interaction between pedestrians. In this paper, we present a novel generative method named Spatial Interaction Transformer (SIT), which learns the spatio-temporal correlation of pedestrian trajectories through attention mechanisms. Furthermore, we introduce the conditional variational autoencoder (CVAE) framework to model the future latent motion states of pedestrians. In particular, the experiments based on large-scale trafc dataset nuScenes [2] show that SIT has an outstanding performance than state-of-the-art (SOTA) methods. Experimental evaluation on the challenging ETH and UCY datasets conrms the robustness of our proposed model
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 13 Dec 2021.
Builds on
14 of 26 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2019Human Motion Trajectory Prediction: A Surveycited by 232
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2020Transformer Networks for Trajectory Forecastingcited by 181
- 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2017Long-Term On-Board Prediction of People in Traffic Scenes under Uncertaintycited by 63
- 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
- 2019Top-view Trajectories: A Pedestrian Dataset of Vehicle-Crowd Interaction from Controlled Experiments and Crowded Campuscited by 25
- 2020Deep Learning for Vision-based Prediction: A Surveycited by 19
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 1; 2025: 1.
4 papers.
- 2022Human Trajectory Prediction via Neural Social Physicscited by 66
- 2022Under the Hood of Transformer Networks for Trajectory Forecastingcited by 8
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2025Predicting Road Crossing Behaviour using Pose Detection and Sequence Modellingcited by 0
- 2025Predicting Road Crossing Behaviour using Pose Detection and Sequence Modelling21 Aug 2025
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
- 2022Human Trajectory Prediction via Neural Social Physics21 Jul 2022
- 2022Under the Hood of Transformer Networks for Trajectory Forecasting22 Mar 2022