mlsanityData to 14 Oct 2026

STGlow: A Flow-based Generative Framework with Dual Graphormer for Pedestrian Trajectory Prediction

arXiv 2211.11220 ↗First posted 21 Nov 2022cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

The pedestrian trajectory prediction task is an essential component of intelligent systems. Its applications include but are not limited to autonomous driving, robot navigation, and anomaly detection of monitoring systems. Due to the diversity of motion behaviors and the complex social interactions among pedestrians, accurately forecasting their future trajectory is challenging. Existing approaches commonly adopt GANs or CVAEs to generate diverse trajectories. However, GAN-based methods do not directly model data in a latent space, which may make them fail to have full support over the underlying data distribution; CVAE-based methods optimize a lower bound on the log-likelihood of observations, which may cause the learned distribution to deviate from the underlying distribution. The above limitations make existing approaches often generate highly biased or inaccurate trajectories. In this paper, we propose a novel generative flow based framework with dual graphormer for pedestrian trajectory prediction (STGlow). Different from previous approaches, our method can more precisely model the underlying data distribution by optimizing the exact log-likelihood of motion behaviors. Besides, our method has clear physical meanings for simulating the evolution of human motion behaviors. The forward process of the flow gradually degrades complex motion behavior into simple behavior, while its reverse process represents the evolution of simple behavior into complex motion behavior. Further, we introduce a dual graphormer combining with the graph structure to more adequately model the temporal dependencies and the mutual spatial interactions. Experimental results on several benchmarks demonstrate that our method achieves much better performance compared to previous state-of-the-art approaches.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 45 of its 90 references that are in the map. First posted on arXiv 21 Nov 2022.

Builds on

45 of 90 references.

References · 45

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2016Layer Normalizationcited by 5,669
  7. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  8. 2016Density estimation using Real NVPcited by 2,042
  9. 2020Rethinking Attention with Performerscited by 1,601
  10. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  11. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  12. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
33 more
  1. 2014NICE: Non-linear Independent Components Estimationcited by 1,058
  2. 2014Show and Tell: A Neural Image Caption Generatorcited by 879
  3. 2020Efficient Transformers: A Surveycited by 790
  4. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
  5. 2021Transformer in Transformercited by 633
  6. 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
  7. 2018Graph Convolutional Networks for Text Classificationcited by 345
  8. 2017On human motion prediction using recurrent neural networkscited by 338
  9. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
  10. 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 325
  11. 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 309
  12. 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 236
  13. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  14. 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
  15. 2017Social Attention: Modeling Attention in Human Crowdscited by 186
  16. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
  17. 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 167
  18. 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
  19. 2019Peeking into the Future: Predicting Future Person Activities and Locations in Videoscited by 114
  20. 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
  21. 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
  22. 2019Conditional Generative Neural System for Probabilistic Trajectory Predictioncited by 76
  23. 2019VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generationcited by 74
  24. 2020Collaborative Motion Prediction via Neural Motion Message Passingcited by 55
  25. 2018FloWaveNet : A Generative Flow for Raw Audiocited by 54
  26. 2019Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Predictioncited by 47
  27. 2020BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimationcited by 47
  28. 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
  29. 2020Temporal Pyramid Network for Pedestrian Trajectory Prediction with Multi-Supervisioncited by 20
  30. 2021Online Multi-Agent Forecasting with Interpretable Collaborative Graph Neural Networkcited by 20
  31. 2022Social Interpretable Tree for Pedestrian Trajectory Predictioncited by 16
  32. 2020A Novel Graph based Trajectory Predictor with Pseudo Oraclecited by 14
  33. 2015Integrating Graph Partitioning and Matching for Trajectory Analysis in Video Surveillancecited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 5; 2025: 3; 2026: 4.

14 papers.

Sort:

By area: