Hold-Out Self-Validation Cannot Certify Photogrammetric Accuracy: Saturation and Blindness to Coherent Distortion
Not on the map. Why?
Abstract (arXiv)
Internal self-consistency cannot certify the accuracy of a photogrammetric reconstruction, and the failure is structural rather than a matter of tuning. This matters because hold-out self-validation scores are increasingly offered as quality evidence for metric deliverables whose correctness is otherwise unknown without an external survey. We formalise a track-leakage-free hold-out protocol: a deterministic image subset is withheld, and each withheld view is re-localised against only those 3D points supported by two or more retained images, so no view is tested against structure it helped create. We evaluate it on five GNSS-referenced captures across four sites, 13 ETH3D scenes, a EuRoC flight and 30 IMC 2025 scenes. The protocol is well-posed but does not measure accuracy. It saturates: the internal confidence score stays pinned at 1.00 while true error swings 14.1x within one capture. It is blind to coherent distortion: fragmenting corruption is caught, but internally self-consistent, globally distorted models are not, and were wrong by 55-106 m at confidence 1.00 at three of four captures. On IMC 2025 it separates failed from successful reconstructions (rho = 0.68) yet ranks nothing among the successful (rho = 0.01). Track-leakage-free hold-out measures internal geometric consistency: a fragmentation warning, not a substitute for control-point accuracy assessment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 37 references that are in the map. First posted on arXiv 25 Jul 2026.
Builds on
13 of 37 references.
References · 13
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2016Direct Sparse Odometrycited by 485
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 266
- 2020Image Matching across Wide Baselines: From Paper to Practicecited by 225
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2015On-Manifold Preintegration for Real-Time Visual-Inertial Odometrycited by 95
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
- 2021The Hessigheim 3D (H3D) Benchmark on Semantic Segmentation of High-Resolution 3D Point Clouds and Textured Meshes from UAV LiDAR and Multi-View-Stereocited by 37
- 2025E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-trainingcited by 22
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025REOBench: Benchmarking Robustness of Earth Observation Foundation Models
- 2026WorldFact-Bench: Beyond Image-Internal Plausibility to Image-World Consistency
- 2025LAION-C: An Out-of-Distribution Benchmark for Web-Scale Vision Models
- 2026GeoArbiter: Verifiability-Guided Grounding for Remote-Sensing Multimodal LLMs
- 2026Self-Improving 4D Perception via Self-Distillation
- 2026SenseBench: A Benchmark for Remote Sensing Low-Level Visual Perception and Description in Large Vision-Language Models
- 2026PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks