Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles
Not on the map. Why?
Abstract (arXiv)
Accurate trajectory prediction is essential for the safe operation of autonomous vehicles in real-world environments. Even well-trained machine learning models may produce unreliable predictions due to discrepancies between training data and real-world conditions encountered during inference. In particular, the training dataset tends to overrepresent common scenes (e.g., straight lanes) while underrepresenting less frequent ones (e.g., traffic circles). In addition, it often overlooks unpredictable real-world events such as sudden braking or falling objects. To ensure safety, it is critical to detect in real-time when a model's predictions become unreliable. Leveraging the intuition that in-distribution (ID) scenes exhibit error patterns similar to training data, while out-of-distribution (OOD) scenes do not, we introduce a principled, real-time approach for OOD detection by framing it as a change-point detection problem. We address the challenging settings where the OOD scenes are deceptive, meaning that they are not easily detectable by human intuitions. Our lightweight solutions can handle the occurrence of OOD at any time during trajectory prediction inference. Experimental results on multiple real-world datasets using a benchmark trajectory prediction model demonstrate the effectiveness of our methods.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 56 of its 151 references that are in the map. First posted on arXiv 25 Sep 2024.
Builds on
56 of 151 references.
References · 56
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2021Learning to Prompt for Continual Learningcited by 938
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
38 more
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 206
- 2020Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?cited by 139
- 2020A Review and Comparative Study on Probabilistic Object Detection in Autonomous Drivingcited by 115
- 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
- 2022Is Out-of-Distribution Detection Learnable?cited by 109
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 100
- 2017Imitating Driver Behavior with Generative Adversarial Networkscited by 92
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2018TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactionscited by 82
- 2018An LSTM Network for Highway Trajectory Predictioncited by 81
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2018Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMscited by 77
- 2019Conditional Generative Neural System for Probabilistic Trajectory Predictioncited by 76
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
- 2019BayesOD: A Bayesian Approach for Uncertainty Estimation in Deep Object Detectorscited by 68
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 50
- 2018How would surround vehicles move? A Unified Framework for Maneuver Classification and Motion Predictioncited by 46
- 2020TrajGAIL: Generating Urban Vehicle Trajectories using Generative Adversarial Imitation Learningcited by 46
- 2024HPNet: Dynamic Trajectory Forecasting with Historical Prediction Attentioncited by 37
- 2019Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMscited by 34
- 2021Deep Learning Methods for Vessel Trajectory Prediction based on Recurrent Neural Networkscited by 32
- 2021No True State-of-the-Art? OOD Detection Methods are Inconsistent across Datasetscited by 31
- 2019Uncertainty-Aware Driver Trajectory Prediction at Urban Intersectionscited by 26
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2020Multi-agent Trajectory Prediction with Fuzzy Query Attentioncited by 16
- 2021Anomaly Detection in Multi-Agent Trajectories for Automated Drivingcited by 15
- 2021Out-of-Distribution Dynamics Detection: RL-Relevant Benchmarks and Resultscited by 14
- 2024Reliable Trajectory Prediction and Uncertainty Quantification with Conditioned Diffusion Modelscited by 13
- 2020Multi-Head Attention based Probabilistic Vehicle Trajectory Predictioncited by 12
- 2023Joint Out-of-Distribution Detection and Uncertainty Estimation for Trajectory Predictioncited by 10
- 2023Privacy-preserving and Uncertainty-aware Federated Trajectory Prediction for Connected Autonomous Vehiclescited by 4
- 2018Transferable Pedestrian Motion Prediction Models at Intersectionscited by 3
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 3.
3 papers.