Structure-to-Image: Zero-Shot Depth Estimation in Colonoscopy via High-Fidelity Sim-to-Real Adaptation
Not on the map. Why?
Abstract (arXiv)
Monocular depth estimation (MDE) for colonoscopy is hampered by the domain gap between simulated and real-world images. Existing image-to-image translation methods, which use depth as a posterior constraint, often produce structural distortions and specular highlights by failing to balance realism with structure consistency. To address this, we propose a Structure-to-Image paradigm that transforms the depth map from a passive constraint into an active generative foundation. We are the first to introduce phase congruency to colonoscopic domain adaptation and design a cross-level structure constraint to co-optimize geometric structures and fine-grained details like vascular textures. In zero-shot evaluations conducted on a publicly available phantom dataset, the MDE model that was fine-tuned on our generated data achieved a maximum reduction of 44.18% in RMSE compared to competing methods. Our code is available at https://github.com/YyangJJuan/PC-S2I.git.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 36 references that are in the map. First posted on arXiv 25 Feb 2026.
Builds on
14 of 36 references.
References · 14
- 2024Depth Anything V2cited by 1,385
- 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 78
- 2017Deep Learning and Conditional Random Fields-based Depth Estimation and Topographical Reconstruction from Conventional Endoscopycited by 31
- 2018SurfelMeshing: Online Surfel-Based Mesh Reconstructioncited by 29
- 2020Augmenting Colonoscopy using Extended and Directional CycleGAN for Lossy Image Translationcited by 29
- 2022Bimodal Camera Pose Prediction for Endoscopycited by 20
- 2023LightDepth: Single-View Depth Self-Supervision from Illumination Declinecited by 17
- 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videoscited by 14
- 2023A Surface-normal Based Neural Framework for Colonoscopy Reconstructioncited by 8
- 2023Multi-task learning with cross-task consistency for improved depth estimation in colonoscopycited by 8
- 2021Depth estimation of endoscopy using sim-to-real transfercited by 6
- 2024Structure-preserving Image Translation for Depth Estimation in Colonoscopy Videocited by 6
Built on by
Not cited yet.