mlsanityData to 7 Oct 2026

SimCol3D -- 3D Reconstruction during Colonoscopy Challenge

arXiv 2307.11261 ↗First posted 20 Jul 2023cs.CVcited by 18

Not on the map. Why?

Abstract (arXiv)

Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could enhance the identification of unscreened colon tissue and serve as a training platform. However, reconstructing the colon from video footage remains difficult. Learning-based approaches hold promise as robust alternatives, but necessitate extensive datasets. Establishing a benchmark dataset, the 2022 EndoVis sub-challenge SimCol3D aimed to facilitate data-driven depth and pose prediction during colonoscopy. The challenge was hosted as part of MICCAI 2022 in Singapore. Six teams from around the world and representatives from academia and industry participated in the three sub-challenges: synthetic depth prediction, synthetic pose prediction, and real pose prediction. This paper describes the challenge, the submitted methods, and their results. We show that depth prediction from synthetic colonoscopy images is robustly solvable, while pose estimation remains an open research question.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 33 of its 64 references that are in the map. First posted on arXiv 20 Jul 2023.

Builds on

33 of 64 references.

References · 33

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016Densely Connected Convolutional Networkscited by 6,691
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  7. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  8. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  9. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
  10. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  11. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  12. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
21 more
  1. 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
  2. 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
  3. 2015Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fieldscited by 169
  4. 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
  5. 2017Surgical Data Science: Enabling Next-Generation Surgerycited by 126
  6. 2020Surgical Data Science -- from Concepts toward Clinical Translationcited by 105
  7. 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 78
  8. 2021Progressively Normalized Self-Attention Network for Video Polyp Segmentationcited by 75
  9. 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
  10. 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
  11. 2019BIAS: Transparent reporting of biomedical image analysis challengescited by 57
  12. 2022EndoMapper dataset of complete calibrated endoscopy procedurescited by 53
  13. 2019Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depthcited by 50
  14. 2022FCN-Transformer Feature Fusion for Polyp Segmentationcited by 37
  15. 2017Deep Learning and Conditional Random Fields-based Depth Estimation and Topographical Reconstruction from Conventional Endoscopycited by 31
  16. 2020Augmenting Colonoscopy using Extended and Directional CycleGAN for Lossy Image Translationcited by 29
  17. 2019A deep learning framework for quality assessment and restoration in video endoscopycited by 24
  18. 2022Bimodal Camera Pose Prediction for Endoscopycited by 20
  19. 2020Detecting Deficient Coverage in Colonoscopiescited by 14
  20. 2021On the Uncertain Single-View Depths in Colonoscopiescited by 6
  21. 2019SUMNet: Fully Convolutional Model for Fast Segmentation of Anatomical Structures in Ultrasound Volumescited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 8; 2026: 6.

18 papers.

Sort:

By area:

  1. 2024Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstructioncited by 19
  2. 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videoscited by 14
  3. 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realismcited by 14
  4. 2024A Study on Self-Supervised Pretraining for Vision Problems in Gastrointestinal Endoscopycited by 2
  5. 2025PPS-Ctrl: Controllable Sim-to-Real Translation for Colonoscopy Depth Estimationcited by 2
  6. 2025ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopycited by 2
  7. 2025EndoStreamDepth: Temporally Consistent Monocular Depth Estimation for Endoscopic Video Streamscited by 2
  8. 2026BREATH-VL: Vision-Language-Guided 6-DoF Bronchoscopy Localization via Semantic-Geometric Fusioncited by 2
  9. 2025Endoscopic Depth Estimation Based on Deep Learning: A Surveycited by 1
  10. 2026RealSynCol: a high-fidelity synthetic colon dataset for 3D reconstruction applicationscited by 1
  11. 2024Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Latent Priorscited by 0
  12. 2025EndoGMDE: Generalizable Monocular Depth Estimation with Mixture of Low-Rank Experts for Diverse Endoscopic Scenescited by 0
6 more
  1. 2025C3VDReg: A Benchmark for Local-to-Local Colonoscopic Registration toward Anatomical Localizationcited by 0
  2. 2025SurgiATM: A Physics-Guided Plug-and-Play Model for Deep Learning-Based Smoke Removal in Laparoscopic Surgerycited by 0
  3. 2026Multi-Modal Monocular Endoscopic Depth and Pose Estimation with Edge-Guided Self-Supervisioncited by 0
  4. 2026CoGE: Sim-to-Real Online Geometric Estimation for Monocular Colonoscopycited by 0
  5. 2026C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearancecited by 0
  6. 2026Colon3R: Cross-Domain 3D Reconstruction from Monocular Colonoscopic Videocited by 0