C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearance
Not on the map. Why?
Abstract (arXiv)
3D reconstruction could improve colonoscopy by estimating mucosal coverage and alerting clinicians to missed regions during screening. However, algorithm development is limited as no current datasets provide both a realistic in vivo appearance and dense, time-resolved 3D ground truth, especially under non-rigid deformation. We present C3VD-DEFCOL, a framework and dataset for evaluating deformable colonoscopy reconstruction with paired geometry and realistic texture. Starting from C3VD/C3VDv2 colon meshes and camera trajectories, we generate controlled deformations of the colon surface, including peristaltic waves and centerline motion, and render per-frame depth, surface normals, optical flow, camera poses, and time-stamped 3D meshes. We then use the rendered geometry, primarily depth, to condition an LTX-2.3-based sim-to-real translation model that produces RGB clips with in vivo-like mucosal color, texture, vasculature, and specular appearance while preserving the underlying 3D scene structure. The resulting dataset contains 110 videos from 11 unique colon mesh geometries, with varying camera trajectories, appearances, and parameterized deformation regimes, including three peristaltic severity levels that serve as controlled evaluation axes. We evaluate the generated videos using appearance realism, geometric consistency, and temporal consistency metrics, and use the paired ground truth to benchmark the downstream task of pose estimation in deformable 3D reconstruction. Our experiments show how pose estimation error increases with increasing deformation severity, providing a controlled stress test that is not possible with existing in vivo datasets. Overall, C3VD-DEFCOL is designed as a reproducible, quantitative evaluation platform for testing deformable 3D reconstruction algorithms, with the goal of reducing the domain gap between synthetic datasets and in vivo colonoscopy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
27 of 41 references.
References · 27
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2018Demystifying MMD GANscited by 1,293
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2024In-Context LoRA for Diffusion Transformerscited by 158
- 2019Dense Extreme Inception Network: Towards a Robust CNN Model for Edge Detectioncited by 104
- 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 80
15 more
- 2022EndoMapper dataset of complete calibrated endoscopy procedurescited by 53
- 2024On the Content Bias in Fr'echet Video Distancecited by 52
- 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splattingcited by 33
- 2022SAGE: SLAM with Appearance and Geometry Prior for Endoscopycited by 28
- 2019A deep learning framework for quality assessment and restoration in video endoscopycited by 24
- 2020VR-Caps: A Virtual Environment for Capsule Endoscopycited by 23
- 2020SD-DefSLAM: Semi-Direct Monocular SLAM for Deformable and Intracorporeal Scenescited by 21
- 2023SimCol3D -- 3D Reconstruction during Colonoscopy Challengecited by 19
- 2024Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstructioncited by 19
- 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realismcited by 15
- 2022GAN Inversion for Data Augmentation to Improve Colonoscopy Lesion Classificationcited by 7
- 2023The Drunkard's Odometry: Estimating Camera Motion in Deforming Scenescited by 5
- 2020Improving colonoscopy lesion classification using semi-supervised deep learningcited by 4
- 2025ColonCrafter: A Depth Estimation Model for Colonoscopy Videos Using Diffusion Priorscited by 3
- 2026ColonSplat: Reconstruction of Peristaltic Motion in Colonoscopy with Dynamic Gaussian Splattingcited by 2
Built on by
Not cited yet.