STGlow: A Flow-based Generative Framework with Dual Graphormer for Pedestrian Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
The pedestrian trajectory prediction task is an essential component of intelligent systems. Its applications include but are not limited to autonomous driving, robot navigation, and anomaly detection of monitoring systems. Due to the diversity of motion behaviors and the complex social interactions among pedestrians, accurately forecasting their future trajectory is challenging. Existing approaches commonly adopt GANs or CVAEs to generate diverse trajectories. However, GAN-based methods do not directly model data in a latent space, which may make them fail to have full support over the underlying data distribution; CVAE-based methods optimize a lower bound on the log-likelihood of observations, which may cause the learned distribution to deviate from the underlying distribution. The above limitations make existing approaches often generate highly biased or inaccurate trajectories. In this paper, we propose a novel generative flow based framework with dual graphormer for pedestrian trajectory prediction (STGlow). Different from previous approaches, our method can more precisely model the underlying data distribution by optimizing the exact log-likelihood of motion behaviors. Besides, our method has clear physical meanings for simulating the evolution of human motion behaviors. The forward process of the flow gradually degrades complex motion behavior into simple behavior, while its reverse process represents the evolution of simple behavior into complex motion behavior. Further, we introduce a dual graphormer combining with the graph structure to more adequately model the temporal dependencies and the mutual spatial interactions. Experimental results on several benchmarks demonstrate that our method achieves much better performance compared to previous state-of-the-art approaches.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 45 of its 90 references that are in the map. First posted on arXiv 21 Nov 2022.
Builds on
45 of 90 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2016Layer Normalizationcited by 5,669
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2016Density estimation using Real NVPcited by 2,042
- 2020Rethinking Attention with Performerscited by 1,601
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
33 more
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2014Show and Tell: A Neural Image Caption Generatorcited by 879
- 2020Efficient Transformers: A Surveycited by 790
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2021Transformer in Transformercited by 633
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2017On human motion prediction using recurrent neural networkscited by 338
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 325
- 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 309
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 236
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
- 2017Social Attention: Modeling Attention in Human Crowdscited by 186
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 167
- 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
- 2019Peeking into the Future: Predicting Future Person Activities and Locations in Videoscited by 114
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2019Conditional Generative Neural System for Probabilistic Trajectory Predictioncited by 76
- 2019VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generationcited by 74
- 2020Collaborative Motion Prediction via Neural Motion Message Passingcited by 55
- 2018FloWaveNet : A Generative Flow for Raw Audiocited by 54
- 2019Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Predictioncited by 47
- 2020BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimationcited by 47
- 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
- 2020Temporal Pyramid Network for Pedestrian Trajectory Prediction with Multi-Supervisioncited by 20
- 2021Online Multi-Agent Forecasting with Interpretable Collaborative Graph Neural Networkcited by 20
- 2022Social Interpretable Tree for Pedestrian Trajectory Predictioncited by 16
- 2020A Novel Graph based Trajectory Predictor with Pseudo Oraclecited by 14
- 2015Integrating Graph Partitioning and Matching for Trajectory Analysis in Video Surveillancecited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 3; 2026: 4.
14 papers.
Sort:
By area:
- 2024Graph Transformers: A Surveycited by 32
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2024Text-Driven Traffic Anomaly Detection with Temporal High-Frequency Modeling in Driving Videoscited by 9
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Predictioncited by 9
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2024Entropy-Informed Weighting Channel Normalizing Flow for Deep Generative Modelscited by 5
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Predictioncited by 4
- 2023IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Predictioncited by 3
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecastingcited by 3
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Drivingcited by 1
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibrationcited by 1
- 2026MoCAR: Motion-code Coordinate-aware AutoRegression for Continuous Trajectory Forecasting5 Oct 2026
- 2026Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction22 Jun 2026
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction11 Apr 2026
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibration11 Feb 2026
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Driving12 Mar 2025
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction20 Feb 2025
- 2024Graph Transformers: A Survey13 Jul 2024
- 2024Entropy-Informed Weighting Channel Normalizing Flow for Deep Generative Models6 Jul 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting6 Feb 2024
- 2024Text-Driven Traffic Anomaly Detection with Temporal High-Frequency Modeling in Driving Videos7 Jan 2024
2 more
- 2024Graph Transformers: A Surveycited by 32
- 2024Text-Driven Traffic Anomaly Detection with Temporal High-Frequency Modeling in Driving Videoscited by 9
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Predictioncited by 9
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2024Entropy-Informed Weighting Channel Normalizing Flow for Deep Generative Modelscited by 5
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Predictioncited by 4
- 2023IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Predictioncited by 3
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecastingcited by 3
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Drivingcited by 1
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibrationcited by 1
- 2026Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Predictioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026MoCAR: Motion-code Coordinate-aware AutoRegression for Continuous Trajectory Forecasting5 Oct 2026
- 2026Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction22 Jun 2026
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction11 Apr 2026
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibration11 Feb 2026
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Driving12 Mar 2025
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction20 Feb 2025
- 2024Graph Transformers: A Survey13 Jul 2024
- 2024Entropy-Informed Weighting Channel Normalizing Flow for Deep Generative Models6 Jul 2024
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting6 Feb 2024
- 2024Text-Driven Traffic Anomaly Detection with Temporal High-Frequency Modeling in Driving Videos7 Jan 2024
- 2023IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Prediction26 Nov 2023
12 newest of 13 All 13 (JSON)