mlsanityData to 7 Oct 2026

Structure-to-Image: Zero-Shot Depth Estimation in Colonoscopy via High-Fidelity Sim-to-Real Adaptation

arXiv 2602.21740 ↗First posted 25 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Monocular depth estimation (MDE) for colonoscopy is hampered by the domain gap between simulated and real-world images. Existing image-to-image translation methods, which use depth as a posterior constraint, often produce structural distortions and specular highlights by failing to balance realism with structure consistency. To address this, we propose a Structure-to-Image paradigm that transforms the depth map from a passive constraint into an active generative foundation. We are the first to introduce phase congruency to colonoscopic domain adaptation and design a cross-level structure constraint to co-optimize geometric structures and fine-grained details like vascular textures. In zero-shot evaluations conducted on a publicly available phantom dataset, the MDE model that was fine-tuned on our generated data achieved a maximum reduction of 44.18% in RMSE compared to competing methods. Our code is available at https://github.com/YyangJJuan/PC-S2I.git.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 36 references that are in the map. First posted on arXiv 25 Feb 2026.

Builds on

14 of 36 references.

References · 14

  1. 2024Depth Anything V2cited by 1,385
  2. 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 78
  3. 2017Deep Learning and Conditional Random Fields-based Depth Estimation and Topographical Reconstruction from Conventional Endoscopycited by 31
  4. 2018SurfelMeshing: Online Surfel-Based Mesh Reconstructioncited by 29
  5. 2020Augmenting Colonoscopy using Extended and Directional CycleGAN for Lossy Image Translationcited by 29
  6. 2022Bimodal Camera Pose Prediction for Endoscopycited by 20
  7. 2023LightDepth: Single-View Depth Self-Supervision from Illumination Declinecited by 17
  8. 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videoscited by 14
  9. 2023A Surface-normal Based Neural Framework for Colonoscopy Reconstructioncited by 8
  10. 2023Multi-task learning with cross-task consistency for improved depth estimation in colonoscopycited by 8
  11. 2021Depth estimation of endoscopy using sim-to-real transfercited by 6
  12. 2024Structure-preserving Image Translation for Depth Estimation in Colonoscopy Videocited by 6
2 more
  1. 2024ToDER: Towards Colonoscopy Depth Estimation and Reconstruction with Geometry Constraint Adaptationcited by 2
  2. 2025Sim2Real in endoscopy segmentation with a novel structure aware image translationcited by 1

Built on by

Not cited yet.