From Keypoints to Predictive Distributions: Post-Hoc Uncertainty for YOLO-Pose Models
Not on the map. Why?
Abstract (arXiv)
YOLO-Pose models provide efficient keypoint localization, but do not quantify the associated spatial uncertainty. We introduce a lightweight post-hoc probabilistic extension that augments a trained YOLO-Pose model with calibrated bivariate predictive distributions over keypoint locations, centered at the model's original predictions. Concretely, we train additional probabilistic heads with an importance-weighted negative log-likelihood to predict an input-dependent 2×2 dispersion matrix for each keypoint, followed by Gaussian calibration for broad downstream compatibility or Student-t calibration for distributional fidelity. Complementing this, we propose an evaluation protocol that combines a suite of distributional calibration diagnostics with average keypoint precision (AKP), a keypoint-level extension of the COCO AP protocol for assessing reliability rankings. Experiments on COCO show that the learned uncertainty estimates enable effective keypoint-level reliability ranking, Student-t calibration best captures the empirical residual distribution, and uncertainty-based pruning removes unreliable keypoints. A central application-level demonstration is vision-based aircraft landing, where calibrated covariances for runway keypoints support uncertainty-aware aircraft position estimation and downstream sensor fusion.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
23 of 40 references.
References · 23
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2018Accurate Uncertainties for Deep Learning Using Calibrated Regressioncited by 417
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2021TOOD: Task-aligned One-stage Object Detectioncited by 218
- 2018Bounding Box Regression with Uncertainty for Accurate Object Detectioncited by 143
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
11 more
- 2022On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networkscited by 119
- 2019Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Drivingcited by 105
- 2020Multivariate Confidence Calibration for Object Detectioncited by 98
- 2019Distribution Calibration for Regressioncited by 88
- 2019Evaluating and Calibrating Uncertainty Prediction in Regression Taskscited by 85
- 2022YOLO-Pose: Enhancing YOLO for Multi Person Pose Estimation Using Object Keypoint Similarity Losscited by 66
- 2019Uncertainty Estimation in One-Stage Object Detectioncited by 36
- 2022Faithful Heteroscedastic Regression with Neural Networkscited by 36
- 2021Uncertainty-Aware Camera Pose Estimation from Points and Linescited by 16
- 2021The Box Size Confidence Bias Harms Your Object Detectorcited by 5
- 2024Probabilistic Parameter Estimators and Calibration Metrics for Pose Estimation from Image Featurescited by 5
Built on by
Not cited yet.