Recurrent Aligned Network for Generalized Pedestrian Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Pedestrian trajectory prediction is a crucial component in computer vision and robotics, but remains challenging due to the domain shift problem. Previous studies have tried to tackle this problem by leveraging a portion of the trajectory data from the target domain to adapt the model. However, such domain adaptation methods are impractical in real-world scenarios, as it is infeasible to collect trajectory data from all potential target domains. In this paper, we study a task named generalized pedestrian trajectory prediction, with the aim of generalizing the model to unseen domains without accessing their trajectories. To tackle this task, we introduce a Recurrent Aligned Network~(RAN) to minimize the domain gap through domain alignment. Specifically, we devise a recurrent alignment module to effectively align the trajectory feature spaces at both time-state and time-sequence levels by the recurrent alignment strategy.Furthermore, we introduce a pre-aligned representation module to combine social interactions with the recurrent alignment strategy, which aims to consider social interactions during the alignment process instead of just target trajectories. We extensively evaluate our method and compare it with state-of-the-art methods on three widely used benchmarks. The experimental results demonstrate the superior generalization capability of our method. Our work not only fills the gap in the generalization setting for practical pedestrian trajectory prediction but also sets strong baselines in this field.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 44 of its 82 references that are in the map. First posted on arXiv 9 Mar 2024.
Builds on
44 of 82 references.
References · 44
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2019Tracking without bells and whistlescited by 382
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 146
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2023Multimodal Prompting with Missing Modalities for Visual Recognitioncited by 121
- 2020Learning to Learn with Variational Information Bottleneck for Domain Generalizationcited by 102
32 more
- 2020Dual Mixup Regularized Learning for Adversarial Domain Adaptationcited by 99
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2021Progressive Domain Expansion Network for Single Domain Generalizationcited by 96
- 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
- 2022Conv2Former: A Simple Transformer-Style ConvNet for Visual Recognitioncited by 81
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
- 2022A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learningcited by 60
- 2022Adaptive Trajectory Prediction via Transferable GNNcited by 51
- 2020BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimationcited by 47
- 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
- 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
- 2021Advancing RNN Transducer Technology for Speech Recognitioncited by 44
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2023Global and Local Mixture Consistency Cumulative Learning for Long-tailed Visual Recognitionscited by 43
- 2022Semantic-Conditional Diffusion Networks for Image Captioningcited by 38
- 2022Graph-based Spatial Transformer with Memory Replay for Multi-future Pedestrian Trajectory Predictioncited by 36
- 2020A Unified Object Motion and Affinity Model for Online Multi-Object Trackingcited by 33
- 2023On the Benefits of 3D Pose and Tracking for Human Action Recognitioncited by 32
- 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 31
- 20232PCNet: Two-Phase Consistency Training for Day-to-Night Unsupervised Domain Adaptive Object Detectioncited by 30
- 2019Angular Visual Hardnesscited by 29
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learningcited by 23
- 2020Temporal Pyramid Network for Pedestrian Trajectory Prediction with Multi-Supervisioncited by 20
- 2023Unsupervised Sampling Promoting for Stochastic Human Trajectory Predictioncited by 17
- 2022Social Interpretable Tree for Pedestrian Trajectory Predictioncited by 16
- 2023Learning Common Rationale to Improve Self-Supervised Representation for Fine-Grained Visual Recognition Problemscited by 14
- 2023IPCC-TP: Utilizing Incremental Pearson Correlation Coefficient for Joint Multi-Agent Trajectory Predictioncited by 13
- 2023Improving the Generalizability of Trajectory Prediction Models with Frenet-Based Domain Normalizationcited by 13
- 2023Unsupervised Cumulative Domain Adaptation for Foggy Scene Optical Flowcited by 9
- 2023Adaptive Siamese Tracking with a Compact Latent Networkcited by 5
- 2023AdapTraj: A Multi-Source Domain Generalization Framework for Multi-Agent Trajectory Predictioncited by 5
- 2024MetaTra: Meta-Learning for Generalized Trajectory Prediction in Unseen Domaincited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 5.
8 papers.
- 2024Towards Generalizable Multi-Object Trackingcited by 22
- 2024SocialCircle+: Learning the Angle-based Conditioned Interaction Representation for Pedestrian Trajectory Predictioncited by 6
- 2025Interaction-Merged Motion Planning: Effectively Leveraging Diverse Motion Datasets for Robust Planningcited by 4
- 2024Who Walks With You Matters: Perceiving Social Interactions with Groups for Pedestrian Trajectory Predictioncited by 3
- 2025Towards Predicting Any Human Trajectory In Contextcited by 2
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectoriescited by 1
- 2025Trustworthy Pedestrian Trajectory Prediction via Pattern-Aware Interaction Modelingcited by 0
- 2025Hazy Pedestrian Trajectory Prediction via Physical Priors and Graph-Mambacited by 0
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025Hazy Pedestrian Trajectory Prediction via Physical Priors and Graph-Mamba28 Sep 2025
- 2025Trustworthy Pedestrian Trajectory Prediction via Pattern-Aware Interaction Modeling16 Jul 2025
- 2025Interaction-Merged Motion Planning: Effectively Leveraging Diverse Motion Datasets for Robust Planning7 Jul 2025
- 2025Towards Predicting Any Human Trajectory In Context1 Jun 2025
- 2024Who Walks With You Matters: Perceiving Social Interactions with Groups for Pedestrian Trajectory Prediction3 Dec 2024
- 2024SocialCircle+: Learning the Angle-based Conditioned Interaction Representation for Pedestrian Trajectory Prediction23 Sep 2024
- 2024Towards Generalizable Multi-Object Tracking1 Jun 2024