mlsanityData to 14 Oct 2026

Pedestrian Trajectory Prediction via Spatial Interaction Transformer Network

arXiv 2112.06624 ↗First posted 13 Dec 2021cs.CV cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

As a core technology of the autonomous driving system, pedestrian trajectory prediction can significantly enhance the function of active vehicle safety and reduce road traffic injuries. In traffic scenes, when encountering with oncoming people, pedestrians may make sudden turns or stop immediately, which often leads to complicated trajectories. To predict such unpredictable trajectories, we can gain insights into the interaction between pedestrians. In this paper, we present a novel generative method named Spatial Interaction Transformer (SIT), which learns the spatio-temporal correlation of pedestrian trajectories through attention mechanisms. Furthermore, we introduce the conditional variational autoencoder (CVAE) framework to model the future latent motion states of pedestrians. In particular, the experiments based on large-scale trafc dataset nuScenes [2] show that SIT has an outstanding performance than state-of-the-art (SOTA) methods. Experimental evaluation on the challenging ETH and UCY datasets conrms the robustness of our proposed model

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 13 Dec 2021.

Builds on

14 of 26 references.

References · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
  4. 2019Human Motion Trajectory Prediction: A Surveycited by 232
  5. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  6. 2020Transformer Networks for Trajectory Forecastingcited by 181
  7. 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
  8. 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
  9. 2017Long-Term On-Board Prediction of People in Traffic Scenes under Uncertaintycited by 63
  10. 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
  11. 2019Top-view Trajectories: A Pedestrian Dataset of Vehicle-Crowd Interaction from Controlled Experiments and Crowded Campuscited by 25
  12. 2020Deep Learning for Vision-based Prediction: A Surveycited by 19
2 more
  1. 2020Multimodal Future Localization and Emergence Prediction for Objects in Egocentric View with a Reachability Priorcited by 18
  2. 2019Forecasting Pedestrian Trajectory with Machine-Annotated Training Datacited by 8

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 0; 2024: 1; 2025: 1.

4 papers.