EndoMapper dataset of complete calibrated endoscopy procedures
Not on the map. Why?
Abstract (arXiv)
Computer-assisted systems are becoming broadly used in medicine. In endoscopy, most research focuses on the automatic detection of polyps or other pathologies, but localization and navigation of the endoscope are completely performed manually by physicians. To broaden this research and bring spatial Artificial Intelligence to endoscopies, data from complete procedures is needed. This paper introduces the Endomapper dataset, the first collection of complete endoscopy sequences acquired during regular medical practice, making secondary use of medical data. Its main purpose is to facilitate the development and evaluation of Visual Simultaneous Localization and Mapping (VSLAM) methods in real endoscopy data. The dataset contains more than 24 hours of video. It is the first endoscopic dataset that includes endoscope calibration as well as the original calibration videos. Meta-data and annotations associated with the dataset vary from the anatomical landmarks, procedure labeling, segmentations, reconstructions, simulated sequences with ground truth and same patient procedures. The software used in this paper is publicly available.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 21 of its 58 references that are in the map. First posted on arXiv 29 Apr 2022.
Builds on
21 of 58 references.
References · 21
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
- 2016Direct Sparse Odometrycited by 485
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 326
- 2017LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentationcited by 214
9 more
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2018TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentationcited by 76
- 2019Incorporating Temporal Prior from Motion Flow for Instrument Segmentation in Minimally Invasive Surgery Videocited by 64
- 2020Kvasir-Instrument: Diagnostic and therapeutic tool segmentation dataset in gastrointestinal endoscopycited by 54
- 2018The Double Sphere Camera Modelcited by 52
- 2020Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Roomcited by 47
- 2020VR-Caps: A Virtual Environment for Capsule Endoscopycited by 23
- 2022Bimodal Camera Pose Prediction for Endoscopycited by 20
- 2020UR2KiD: Unifying Retrieval, Keypoint Detection, and Keypoint Description without Local Correspondence Supervisioncited by 17
Built on by
Citing papers per year: 2022: 1; 2023: 10; 2024: 10; 2025: 16; 2026: 16.
53 papers.
Sort:
By area:
- 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
- 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splattingcited by 33
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2023LightNeuS: Neural Surface Reconstruction in Endoscopy using Illumination Declinecited by 24
- 2023SimCol3D -- 3D Reconstruction during Colonoscopy Challengecited by 19
- 2023LightDepth: Single-View Depth Self-Supervision from Illumination Declinecited by 17
- 2025Endo3R: Unified Online Reconstruction from Dynamic Monocular Endoscopic Videocited by 16
- 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realismcited by 15
- 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videoscited by 14
- 2024EndoOmni: Zero-Shot Cross-Dataset Depth Estimation in Endoscopy by Robust Self-Learning from Noisy Labelscited by 12
- 2024CudaSIFT-SLAM: multiple-map visual SLAM for full procedure mapping in real human endoscopycited by 11
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mappingcited by 11
38 more
- 2025EndoMamba: An Efficient Foundation Model for Endoscopic Videos via Hierarchical Pre-trainingcited by 11
- 2024SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy datacited by 7
- 2023Colo-SCRL: Self-Supervised Contrastive Representation Learning for Colonoscopic Video Retrievalcited by 6
- 2024Realistic Surgical Image Dataset Generation Based On 3D Gaussian Splattingcited by 6
- 2024Structure-preserving Image Translation for Depth Estimation in Colonoscopy Videocited by 6
- 2024Topological SLAM in colonoscopies leveraging deep features and topological priorscited by 6
- 2023ColonMapper: topological mapping and localization for colonoscopycited by 5
- 2023The Drunkard's Odometry: Estimating Camera Motion in Deforming Scenescited by 5
- 2023Task-guided Domain Gap Reduction for Monocular Depth Prediction in Endoscopycited by 5
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstructioncited by 4
- 2024EndoMetric: Near-Light Monocular Metric Scale Estimation in Endoscopycited by 3
- 20253D Densification for Multi-Map Monocular VSLAM in Endoscopycited by 3
- 2025PPS-Ctrl: Controllable Sim-to-Real Translation for Colonoscopy Depth Estimationcited by 2
- 2025ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopycited by 2
- 2026BREATH-VL: Vision-Language-Guided 6-DoF Bronchoscopy Localization via Semantic-Geometric Fusioncited by 2
- 2026RealSynCol: a high-fidelity synthetic colon dataset for 3D reconstruction applicationscited by 2
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splattingcited by 2
- 2025Acquiring Submillimeter-Accurate Multi-Task Vision Datasets for Computer-Assisted Orthopedic Surgerycited by 1
- 2025Sim2Real in endoscopy segmentation with a novel structure aware image translationcited by 1
- 2025Endoscopic Depth Estimation Based on Deep Learning: A Surveycited by 1
- 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motionscited by 1
- 2022Convex Relaxations for Isometric and Equiareal NRSfMcited by 0
- 2023SoftEnNet: Symbiotic Monocular Depth Estimation and Lumen Segmentation for Colonoscopy Endorobotscited by 0
- 2023Reconstructing the normal and shape at specularities in endoscopycited by 0
- 2025Automated vision-based assistance tools in bronchoscopy: stenosis severity estimationcited by 0
- 2025EndoMatcher: Generalizable Endoscopic Image Matcher via Multi-Domain Pre-training for Robot-Assisted Surgerycited by 0
- 2025EndoGMDE: Generalizable Monocular Depth Estimation with Mixture of Low-Rank Experts for Diverse Endoscopic Scenescited by 0
- 2025SurgiATM: A Physics-Guided Plug-and-Play Model for Deep Learning-Based Smoke Removal in Laparoscopic Surgerycited by 0
- 2025Bridging the Ex-Vivo to In-Vivo Gap: Synthetic Priors for Monocular Depth Estimation in Specular Surgical Environmentscited by 0
- 2026SuperPoint-E: local features for 3D reconstruction via tracking adaptation in endoscopycited by 0
- 2026Multi-Modal Monocular Endoscopic Depth and Pose Estimation with Edge-Guided Self-Supervisioncited by 0
- 2026The Dresden Dataset for 4D Reconstruction of Non-Rigid Abdominal Surgical Scenescited by 0
- 2026Understanding Model Behavior in Monocular Polyp Sizingcited by 0
- 2026ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learningcited by 0
- 2026C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearancecited by 0
- 2026Gastroendoscopy View Synthesis: A New Real Dataset and Evaluationcited by 0
- 2026Geometry-Aware Camera Localization for Bronchoscopycited by 0
- 2026Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imagingcited by 0
50 most cited of 53 All 53 (JSON)
- 2026A Surgical Foundation Model Reveals Task-Dependent Label Efficiency25 Sep 2026
- 2026RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment16 Sep 2026
- 2026Lesion-centered 3D mapping of colonoscopy procedures: validation of a hierarchical ensemble pipeline on public benchmark videos15 Sep 2026
- 2026Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging28 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026Gastroendoscopy View Synthesis: A New Real Dataset and Evaluation24 Jun 2026
- 2026C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearance5 Jun 2026
- 2026ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learning27 May 2026
- 2026Understanding Model Behavior in Monocular Polyp Sizing19 May 2026
- 2026The Dresden Dataset for 4D Reconstruction of Non-Rigid Abdominal Surgical Scenes3 Mar 2026
- 2026Multi-Modal Monocular Endoscopic Depth and Pose Estimation with Edge-Guided Self-Supervision19 Feb 2026
- 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motions19 Feb 2026
38 more
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting19 Feb 2026
- 2026RealSynCol: a high-fidelity synthetic colon dataset for 3D reconstruction applications9 Feb 2026
- 2026SuperPoint-E: local features for 3D reconstruction via tracking adaptation in endoscopy4 Feb 2026
- 2026BREATH-VL: Vision-Language-Guided 6-DoF Bronchoscopy Localization via Semantic-Geometric Fusion7 Jan 2026
- 2025Bridging the Ex-Vivo to In-Vivo Gap: Synthetic Priors for Monocular Depth Estimation in Specular Surgical Environments29 Dec 2025
- 2025ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopy27 Nov 2025
- 2025SurgiATM: A Physics-Guided Plug-and-Play Model for Deep Learning-Based Smoke Removal in Laparoscopic Surgery7 Nov 2025
- 2025EndoGMDE: Generalizable Monocular Depth Estimation with Mixture of Low-Rank Experts for Diverse Endoscopic Scenes1 Sep 2025
- 2025EndoMatcher: Generalizable Endoscopic Image Matcher via Multi-Domain Pre-training for Robot-Assisted Surgery7 Aug 2025
- 2025Endoscopic Depth Estimation Based on Deep Learning: A Survey28 Jul 2025
- 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realism30 Jun 2025
- 2025Automated vision-based assistance tools in bronchoscopy: stenosis severity estimation8 May 2025
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstruction6 May 2025
- 2025Sim2Real in endoscopy segmentation with a novel structure aware image translation5 May 2025
- 2025PPS-Ctrl: Controllable Sim-to-Real Translation for Colonoscopy Depth Estimation23 Apr 2025
- 2025Endo3R: Unified Online Reconstruction from Dynamic Monocular Endoscopic Video4 Apr 2025
- 20253D Densification for Multi-Map Monocular VSLAM in Endoscopy18 Mar 2025
- 2025EndoMamba: An Efficient Foundation Model for Endoscopic Videos via Hierarchical Pre-training26 Feb 2025
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mapping31 Jan 2025
- 2025Acquiring Submillimeter-Accurate Multi-Task Vision Datasets for Computer-Assisted Orthopedic Surgery26 Jan 2025
- 2024SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy data20 Dec 2024
- 2024EndoMetric: Near-Light Monocular Metric Scale Estimation in Endoscopy19 Oct 2024
- 2024Topological SLAM in colonoscopies leveraging deep features and topological priors25 Sep 2024
- 2024EndoOmni: Zero-Shot Cross-Dataset Depth Estimation in Endoscopy by Robust Self-Learning from Noisy Labels9 Sep 2024
- 2024Structure-preserving Image Translation for Depth Estimation in Colonoscopy Video19 Aug 2024
- 2024Realistic Surgical Image Dataset Generation Based On 3D Gaussian Splatting20 Jul 2024
- 2024CudaSIFT-SLAM: multiple-map visual SLAM for full procedure mapping in real human endoscopy27 May 2024
- 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videos26 Mar 2024
- 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting22 Mar 2024
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenes22 Mar 2024
- 2023Reconstructing the normal and shape at specularities in endoscopy30 Nov 2023
- 2023Tracking and Mapping in Medical Computer Vision: A Review17 Oct 2023
- 2023Task-guided Domain Gap Reduction for Monocular Depth Prediction in Endoscopy2 Oct 2023
- 2023LightNeuS: Neural Surface Reconstruction in Endoscopy using Illumination Decline6 Sep 2023
- 2023LightDepth: Single-View Depth Self-Supervision from Illumination Decline21 Aug 2023
- 2023SimCol3D -- 3D Reconstruction during Colonoscopy Challenge20 Jul 2023
- 2023The Drunkard's Odometry: Estimating Camera Motion in Deforming Scenes29 Jun 2023
- 2023ColonMapper: topological mapping and localization for colonoscopy9 May 2023
50 newest of 53 All 53 (JSON)
- 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
- 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splattingcited by 33
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2023LightNeuS: Neural Surface Reconstruction in Endoscopy using Illumination Declinecited by 24
- 2023SimCol3D -- 3D Reconstruction during Colonoscopy Challengecited by 19
- 2023LightDepth: Single-View Depth Self-Supervision from Illumination Declinecited by 17
- 2025Endo3R: Unified Online Reconstruction from Dynamic Monocular Endoscopic Videocited by 16
- 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realismcited by 15
- 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videoscited by 14
- 2024EndoOmni: Zero-Shot Cross-Dataset Depth Estimation in Endoscopy by Robust Self-Learning from Noisy Labelscited by 12
- 2024CudaSIFT-SLAM: multiple-map visual SLAM for full procedure mapping in real human endoscopycited by 11
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mappingcited by 11
12 most cited of 51 All 51 (JSON)
- 2026A Surgical Foundation Model Reveals Task-Dependent Label Efficiency25 Sep 2026
- 2026RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment16 Sep 2026
- 2026Lesion-centered 3D mapping of colonoscopy procedures: validation of a hierarchical ensemble pipeline on public benchmark videos15 Sep 2026
- 2026Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging28 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026Gastroendoscopy View Synthesis: A New Real Dataset and Evaluation24 Jun 2026
- 2026C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearance5 Jun 2026
- 2026ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learning27 May 2026
- 2026Understanding Model Behavior in Monocular Polyp Sizing19 May 2026
- 2026The Dresden Dataset for 4D Reconstruction of Non-Rigid Abdominal Surgical Scenes3 Mar 2026
- 2026Multi-Modal Monocular Endoscopic Depth and Pose Estimation with Edge-Guided Self-Supervision19 Feb 2026
- 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motions19 Feb 2026
12 newest of 51 All 51 (JSON)