Enhancing Trajectory Prediction through Self-Supervised Waypoint Noise Prediction
Not on the map. Why?
Abstract (arXiv)
Trajectory prediction is an important task that involves modeling the indeterminate nature of traffic actors to forecast future trajectories given the observed trajectory sequences. However, current methods confine themselves to presumed data manifolds, assuming that trajectories strictly adhere to these manifolds, resulting in overly simplified predictions. To this end, we propose a novel approach called SSWNP (Self-Supervised Waypoint Noise Prediction). In our approach, we first create clean and noise-augmented views of past observed trajectories across the spatial domain of waypoints. We then compel the trajectory prediction model to maintain spatial consistency between predictions from these two views, in addition to the trajectory prediction task. Introducing the noise-augmented view mitigates the model's reliance on a narrow interpretation of the data manifold, enabling it to learn more plausible and diverse representations. We also predict the noise present in the two views of past observed trajectories as an auxiliary self-supervised task, enhancing the model's understanding of the underlying representation and future predictions. Empirical evidence demonstrates that the incorporation of SSWNP into the model learning process significantly improves performance, even in noisy environments, when compared to baseline methods. Our approach can complement existing trajectory prediction methods. To showcase the effectiveness of our approach, we conducted extensive experiments on three datasets: NBA Sports VU, ETH-UCY, and TrajNet++, with experimental results highlighting the substantial improvement achieved in trajectory prediction tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 66 references that are in the map. First posted on arXiv 26 Nov 2023.
Builds on
42 of 66 references.
References · 42
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2018Neural Relational Inference for Interacting Systemscited by 339
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2017Social Attention: Modeling Attention in Human Crowdscited by 185
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
30 more
- 2020Transformer Networks for Trajectory Forecastingcited by 180
- 2016Learning Features by Watching Objects Movecited by 138
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2020Human Trajectory Forecasting in Crowds: A Deep Learning Perspectivecited by 128
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 116
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
- 2020Collaborative Motion Prediction via Neural Motion Message Passingcited by 55
- 2018Iterative Reorganization with Weak Spatial Constraints: Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learningcited by 51
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2018Generating Multi-Agent Trajectories using Programmatic Weak Supervisioncited by 46
- 2023Masked Trajectory Models for Prediction, Representation, and Controlcited by 40
- 2021Are socially-aware trajectory prediction models really socially-aware?cited by 32
- 2022SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Drivingcited by 31
- 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 31
- 2022Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoningcited by 28
- 2022Bootstrap Motion Forecasting With Self-Consistent Constraintscited by 23
- 2021MSN: Multi-Style Network for Trajectory Predictioncited by 19
- 2021SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Predictioncited by 19
- 2020AMENet: Attentive Maps Encoder Network for Trajectory Predictioncited by 17
- 2022Action-based Contrastive Learning for Trajectory Predictioncited by 15
- 2020A Novel Graph based Trajectory Predictor with Pseudo Oraclecited by 14
- 2022TENET: Transformer Encoding Network for Effective Temporal Flow on Motion Predictioncited by 14
- 2020CARPe Posterum: A Convolutional Approach for Real-time Pedestrian Path Predictioncited by 11
- 2021SCAN: A Spatial Context Attentive Network for Joint Multi-Agent Intent Predictioncited by 9
- 2020Robust Trajectory Forecasting for Multiple Intelligent Agents in Dynamic Scenecited by 4
- 2023Discovering Intrinsic Spatial-Temporal Logic Rules to Explain Human Actionscited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.