Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System
Not on the map. Why?
Abstract (arXiv)
Recent advances in data-driven computer vision have enabled robust autonomous navigation capabilities for civil aviation, including automated landing and runway detection. However, ensuring that these systems meet the robustness and safety requirements for aviation applications remains a major challenge. In this work, we present a practical vision-based pipeline for aircraft pose estimation from runway images that represents a step toward the ability to certify these systems for use in safety-critical aviation applications. Our approach features three key innovations: (i) an efficient, flexible neural architecture based on a spatial Soft Argmax operator for probabilistic keypoint regression, supporting diverse vision backbones with real-time inference; (ii) a principled loss function producing calibrated predictive uncertainties, which are evaluated via sharpness and calibration metrics; and (iii) an adaptation of Residual-based Receiver Autonomous Integrity Monitoring (RAIM), enabling runtime detection and rejection of faulty model outputs. We implement and evaluate our pose estimation pipeline on a dataset of runway images. We show that our model outperforms baseline architectures in terms of accuracy while also producing well-calibrated uncertainty estimates with sub-pixel precision that can be used downstream for fault detection.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 13 Aug 2025.
Builds on
25 of 56 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2015End-to-End Training of Deep Visuomotor Policiescited by 875
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
- 2021Domain Generalization: A Surveycited by 764
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2020A Survey of Algorithms for Black-Box Safety Validation of Cyber-Physical Systemscited by 71
- 2022Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racingcited by 64
- 2020Individual Calibration with Randomized Forecastingcited by 50
13 more
- 2021Reachability Analysis of Neural Feedback Loopscited by 41
- 2018End-to-End Race Driving with Deep Reinforcement Learningcited by 40
- 2021OVERT: An Algorithm for Safety Verification of Neural Network Control Policies for Nonlinear Systemscited by 38
- 2020Reachable Polyhedral Marching (RPM): A Safety Verification Algorithm for Robotic Systems with Deep Neural Network Componentscited by 36
- 2023Autonomous Drone Racing: A Surveycited by 35
- 2023Does progress on ImageNet transfer to real-world datasets?cited by 35
- 2023LARD -- Landing Approach Runway Detection -- Dataset for Vision Based Landingcited by 14
- 2023A Holistic Assessment of the Reliability of Machine Learning Systemscited by 9
- 2022Neural Network Compression of ACAS Xu Early Prototype is Unsafe: Closed-Loop Verification through Quantized State Backreachabilitycited by 8
- 2024Diffusion-Based Failure Sampling for Evaluating Safety-Critical Autonomous Systemscited by 6
- 2023Bayesian Safety Validation for Failure Probability Estimation of Black-Box Systemscited by 5
- 2024Probabilistic Parameter Estimators and Calibration Metrics for Pose Estimation from Image Featurescited by 5
- 2023Framework for Certification of AI-Based Systemscited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.