Informed Priors for Knowledge Integration in Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Informed machine learning methods allow the integration of prior knowledge into learning systems. This can increase accuracy and robustness or reduce data needs. However, existing methods often assume hard constraining knowledge, that does not require to trade-off prior knowledge with observations, but can be used to directly reduce the problem space. Other approaches use specific, architectural changes as representation of prior knowledge, limiting applicability. We propose an informed machine learning method, based on continual learning. This allows the integration of arbitrary, prior knowledge, potentially from multiple sources, and does not require specific architectures. Furthermore, our approach enables probabilistic and multi-modal predictions, that can improve predictive accuracy and robustness. We exemplify our approach by applying it to a state-of-the-art trajectory predictor for autonomous driving. This domain is especially dependent on informed learning approaches, as it is subject to an overwhelming large variety of possible environments and very rare events, while requiring robust and accurate predictions. We evaluate our model on a commonly used benchmark dataset, only using data already available in a conventional setup. We show that our method outperforms both non-informed and informed learning methods, that are often used in the literature. Furthermore, we are able to compete with a conventional baseline, even using half as many observation examples.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 1 Nov 2022.
Builds on
20 of 28 references.
References · 20
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2018Progress & Compress: A scalable framework for continual learningcited by 516
- 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
- 2017Variational Continual Learningcited by 335
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2019Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systemscited by 203
- 2015A Theoretically Grounded Application of Dropout in Recurrent Neural Networkscited by 161
- 2020A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learningcited by 86
- 2020HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisationcited by 81
8 more
- 2019Conditional Generative Neural System for Probabilistic Trajectory Predictioncited by 76
- 2020Generalized Variational Continual Learningcited by 56
- 2021A Survey on Deep-Learning Approaches for Vehicle Trajectory Prediction in Autonomous Drivingcited by 21
- 2021Injecting Knowledge in Data-driven Vehicle Trajectory Predictorscited by 18
- 2022Knowledge Augmented Machine Learning with Applications in Autonomous Driving: A Surveycited by 11
- 2020Improving Movement Predictions of Traffic Actors in Bird's-Eye View Models using GANs and Differentiable Trajectory Rasterizationcited by 9
- 2020Motion Prediction using Trajectory Sets and Self-Driving Domain Knowledgecited by 8
- 2022Informed Pre-Training on Prior Knowledgecited by 5
Built on by
Citing papers per year: 2025: 2.
2 papers.