Certified Human Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Predicting human trajectories is essential for the safe operation of autonomous vehicles, yet current data-driven models often lack robustness in case of noisy inputs such as adversarial examples or imperfect observations. Although some trajectory prediction methods have been developed to provide empirical robustness, these methods are heuristic and do not offer guaranteed robustness. In this work, we propose a certification approach tailored for trajectory prediction that provides guaranteed robustness. To this end, we address the unique challenges associated with trajectory prediction, such as unbounded outputs and multi-modality. To mitigate the inherent performance drop through certification, we propose a diffusion-based trajectory denoiser and integrate it into our method. Moreover, we introduce new certified performance metrics to reliably measure the trajectory prediction performance. Through comprehensive experiments, we demonstrate the accuracy and robustness of the certified predictors and highlight their advantages over the non-certified ones. The code is available online: https://s-attack.github.io/.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 51 of its 69 references that are in the map. First posted on arXiv 20 Mar 2024.
Builds on
51 of 69 references.
References · 51
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 564
38 more
- 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 542
- 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2016Safety Verification of Deep Neural Networkscited by 262
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 241
- 2018Adversarial Risk and the Dangers of Evaluating Against Weak Attackscited by 221
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2020Transformer Networks for Trajectory Forecastingcited by 180
- 2018Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learningcited by 162
- 2017Towards Robust Neural Networks via Random Self-ensemblecited by 158
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2022(Certified!!) Adversarial Robustness for Free!cited by 130
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2020Human Trajectory Forecasting in Crowds: A Deep Learning Perspectivecited by 128
- 2018A Dual Approach to Scalable Verification of Deep Networkscited by 125
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2023DiffTraj: Generating GPS Trajectory with Diffusion Probabilistic Modelcited by 64
- 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
- 2017Mitigating Evasion Attacks to Deep Neural Networks via Region-based Classificationcited by 56
- 2022AdvDO: Realistic Adversarial Attacks for Trajectory Predictioncited by 48
- 2020Detection as Regression: Certified Object Detection by Median Smoothingcited by 47
- 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
- 2021Vehicle trajectory prediction works, but not everywherecited by 39
- 2021Spectral Temporal Graph Neural Network for Trajectory Predictioncited by 36
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2023Social-Transmotion: Promptable Human Trajectory Predictioncited by 33
- 2021Are socially-aware trajectory prediction models really socially-aware?cited by 32
- 2017Context-Aware Trajectory Predictioncited by 31
- 2023Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive?cited by 22
- 2020Pedestrian Trajectory Prediction with Convolutional Neural Networkscited by 21
- 2018An Evaluation of Trajectory Prediction Approaches and Notes on the TrajNet Benchmarkcited by 16
- 2022Robust Trajectory Prediction against Adversarial Attackscited by 16
- 2022Semi-supervised Semantics-guided Adversarial Training for Trajectory Predictioncited by 12
- 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictorscited by 11
- 2023Toward Reliable Human Pose Forecasting with Uncertaintycited by 11
- 2023Real-World Denoising via Diffusion Modelcited by 10
- 2022Under the Hood of Transformer Networks for Trajectory Forecastingcited by 8
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 4.
6 papers.
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Predictioncited by 21
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenariocited by 1
- 2026Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Trainingcited by 1
- 2026SceneSelect: Selective Learning for Trajectory Scene Classification and Expert Schedulingcited by 0
- 2026TrajRS: Towards Certified Robustness in Pedestrian Trajectory Predictioncited by 0
- 2026Ego-Human Motion Prediction with 3D-Aware LLMcited by 0
- 2026Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training22 Jul 2026
- 2026Ego-Human Motion Prediction with 3D-Aware LLM8 Jul 2026
- 2026TrajRS: Towards Certified Robustness in Pedestrian Trajectory Prediction27 Jun 2026
- 2026SceneSelect: Selective Learning for Trajectory Scene Classification and Expert Scheduling27 Apr 2026
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario12 Sep 2025
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Prediction4 Nov 2024