Stereo Correspondence and Reconstruction of Endoscopic Data Challenge
Not on the map. Why?
Abstract (arXiv)
The stereo correspondence and reconstruction of endoscopic data sub-challenge was organized during the Endovis challenge at MICCAI 2019 in Shenzhen, China. The task was to perform dense depth estimation using 7 training datasets and 2 test sets of structured light data captured using porcine cadavers. These were provided by a team at Intuitive Surgical. 10 teams participated in the challenge day. This paper contains 3 additional methods which were submitted after the challenge finished as well as a supplemental section from these teams on issues they found with the dataset.
Key facts. Cited by 101 papers in the map (data through 7 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 4 Jan 2021.
Builds on
11 of 26 references.
References · 11
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
- 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
- 2018Deep Depth Completion of a Single RGB-D Imagecited by 110
- 2017Self-Supervised Siamese Learning on Stereo Image Pairs for Depth Estimation in Robotic Surgerycited by 34
- 2018Self-supervised Learning for Dense Depth Estimation in Monocular Endoscopycited by 13
- 2017Endoscopic Depth Measurement and Super-Spectral-Resolution Imagingcited by 2
Built on by
Citing papers per year: 2021: 5; 2022: 9; 2023: 13; 2024: 26; 2025: 31; 2026: 17.
101 papers.
Sort:
By area:
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 78
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2023EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videoscited by 68
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
- 2024Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgerycited by 52
- 2023Learning How To Robustly Estimate Camera Pose in Endoscopic Videoscited by 49
- 2024Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splattingcited by 43
- 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
- 2021Self-Supervised Generative Adversarial Network for Depth Estimation in Laparoscopic Imagescited by 21
- 2024LGS: A Light-weight 4D Gaussian Splatting for Efficient Surgical Scene Reconstructioncited by 21
- 2024EndoGaussian: Real-time Gaussian Splatting for Dynamic Endoscopic Scene Reconstructioncited by 20
38 more
- 2024Free-SurGS: SfM-Free 3D Gaussian Splatting for Surgical Scene Reconstructioncited by 20
- 2022Self-Supervised Depth Estimation in Laparoscopic Image using 3D Geometric Consistencycited by 19
- 2024EndoSparse: Real-Time Sparse View Synthesis of Endoscopic Scenes using Gaussian Splattingcited by 16
- 2023Surgical Tattoos in Infrared: A Dataset for Quantifying Tissue Tracking and Mappingcited by 15
- 2023SurgT challenge: Benchmark of Soft-Tissue Trackers for Robotic Surgerycited by 14
- 2025Endo3R: Unified Online Reconstruction from Dynamic Monocular Endoscopic Videocited by 14
- 2024Transferring Relative Monocular Depth to Surgical Vision with Temporal Consistencycited by 13
- 2024HFGS: 4D Gaussian Splatting with Emphasis on Spatial and Temporal High-Frequency Components for Endoscopic Scene Reconstructioncited by 13
- 2024EndoOmni: Zero-Shot Cross-Dataset Depth Estimation in Endoscopy by Robust Self-Learning from Noisy Labelscited by 12
- 2021Stereo Dense Scene Reconstruction and Accurate Localization for Learning-Based Navigation of Laparoscope in Minimally Invasive Surgerycited by 11
- 2022A Survey on RGB-D Datasetscited by 11
- 2024MonoPCC: Photometric-invariant Cycle Constraint for Monocular Depth Estimation of Endoscopic Imagescited by 10
- 2022Deep Laparoscopic Stereo Matching with Transformerscited by 9
- 2023WS-SfMLearner: Self-supervised Monocular Depth and Ego-motion Estimation on Surgical Videos with Unknown Camera Parameterscited by 9
- 2024DARES: Depth Anything in Robotic Endoscopic Surgery with Self-supervised Vector-LoRA of the Foundation Modelcited by 8
- 2024UC-NeRF: Uncertainty-aware Conditional Neural Radiance Fields from Endoscopic Sparse Viewscited by 8
- 2022Bidirectional Semi-supervised Dual-branch CNN for Robust 3D Reconstruction of Stereo Endoscopic Images via Adaptive Cross and Parallel Supervisionscited by 6
- 2021How can we learn (more) from challenges? A statistical approach to driving future algorithm developmentcited by 5
- 2023Detecting the Sensing Area of A Laparoscopic Probe in Minimally Invasive Cancer Surgerycited by 5
- 2023RIDE: Self-Supervised Learning of Rotation-Equivariant Keypoint Detection and Invariant Description for Endoscopycited by 5
- 2024Tracking Everything in Robotic-Assisted Surgerycited by 5
- 2025Endo-FASt3r: Endoscopic Foundation model Adaptation for Structure from motioncited by 5
- 2022BDIS: Bayesian Dense Inverse Searching Method for Real-Time Stereo Surgical Image Matchingcited by 4
- 2024BodySLAM: A Generalized Monocular Visual SLAM Framework for Surgical Applicationscited by 4
- 2024Advancing Depth Anything Model for Unsupervised Monocular Depth Estimation in Endoscopycited by 4
- 2021Bayesian dense inverse searching algorithm for real-time stereo matching in minimally invasive surgerycited by 3
- 20223D endoscopic depth estimation using 3D surface-aware constraintscited by 3
- 2022A comprehensive survey on recent deep learning-based methods applied to surgical datacited by 3
- 2024EndoGaussians: Single View Dynamic Gaussian Splatting for Deformable Endoscopic Tissues Reconstructioncited by 3
- 2024Ada-Tracker: Soft Tissue Tracking via Inter-Frame and Adaptive-Template Matchingcited by 3
- 2025Fast SAM2 with Text-Driven Token Pruningcited by 3
- 2023Regularising disparity estimation via multi task learning with structured light reconstructioncited by 2
- 2023EndoDepthL: Lightweight Endoscopic Monocular Depth Estimation with CNN-Transformercited by 2
- 2023BDIS-SLAM: A lightweight CPU-based dense stereo SLAM for surgerycited by 2
- 2024Dense 3D Reconstruction Through Lidar: A Comparative Study on Ex-vivo Porcine Tissuecited by 2
- 2024Neural Fields for 3D Tracking of Anatomy and Surgical Instruments in Monocular Laparoscopic Video Clipscited by 2
- 2024EndoDepth: A Benchmark for Assessing Robustness in Endoscopic Depth Predictioncited by 2
- 2025CodingHomo: Bootstrapping Deep Homography With Video Codingcited by 2
50 most cited of 101 All 101 (JSON)
- 2026EndoPrior-GS: Dynamic Endoscopic Reconstruction with a Joint Texture Prior29 Sep 2026
- 2026RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment16 Sep 2026
- 2026MV-dVRK: A Multi-Viewpoint Benchmark for Spatial Surgical Perception2 Sep 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026Boosting Generalizable Depth Estimation in Endoscopy by Mixture of Lightweight Experts and Intrinsic Image Alignment1 Aug 2026
- 2026Gastroendoscopy View Synthesis: A New Real Dataset and Evaluation24 Jun 2026
- 2026SCARED-C: Corrected Camera Poses for Endoscopic Depth Estimation15 May 2026
- 2026EndoVGGT: GNN-Enhanced Depth Estimation for Surgical 3D Reconstruction25 Mar 2026
- 2026Leveling3D: Leveling Up 3D Reconstruction with Feed-Forward 3D Gaussian Splatting and Geometry-Aware Generation17 Mar 2026
- 2026SurgFed: Language-guided Multi-Task Federated Learning for Surgical Video Understanding10 Mar 2026
- 2026SurgCUT3R: Surgical Scene-Aware Continuous Understanding of Temporal 3D Representation7 Mar 2026
38 more
- 2026The Dresden Dataset for 4D Reconstruction of Non-Rigid Abdominal Surgical Scenes3 Mar 2026
- 2026Monocular Endoscopic Tissue 3D Reconstruction with Multi-Level Geometry Regularization24 Feb 2026
- 2026Diff2DGS: Reliable Reconstruction of Occluded Surgical Scenes via 2D Gaussian Splatting20 Feb 2026
- 2026Multi-Modal Monocular Endoscopic Depth and Pose Estimation with Edge-Guided Self-Supervision19 Feb 2026
- 2026On the Role of Depth in Surgical Vision Foundation Models: An Empirical Study of RGB-D Pre-training26 Jan 2026
- 2025Bridging the Ex-Vivo to In-Vivo Gap: Synthetic Priors for Monocular Depth Estimation in Specular Surgical Environments29 Dec 2025
- 2025Fast SAM2 with Text-Driven Token Pruning24 Dec 2025
- 2025Self-Supervised Contrastive Embedding Adaptation for Endoscopic Image Matching11 Dec 2025
- 2025UnReflectAnything: RGB-Only Highlight Removal by Rendering Synthetic Specular Supervision10 Dec 2025
- 2025More than Segmentation: Benchmarking SAM 3 for Segmentation, 3D Perception, and Reconstruction in Robotic Surgery8 Dec 2025
- 2025DGGAN: Degradation Guided Generative Adversarial Network for Real-time Endoscopic Video Enhancement8 Dec 2025
- 2025An Image-Based Path Planning Algorithm Using a UAV Equipped with Stereo Vision11 Nov 2025
- 2025TiS-TSL: Image-Label Supervised Surgical Video Stereo Matching via Time-Switchable Teacher-Student Learning10 Nov 2025
- 2025SAGS: Self-Adaptive Alias-Free Gaussian Splatting for Dynamic Surgical Endoscopic Reconstruction31 Oct 2025
- 2025EndoSfM3D: Learning to 3D Reconstruct Any Endoscopic Surgery Scene using Self-supervised Foundation Model25 Oct 2025
- 2025Zero-shot Monocular Metric Depth for Endoscopic Images23 Sep 2025
- 2025Efficient 3D Scene Reconstruction and Simulation from Sparse Endoscopic Views21 Sep 2025
- 2025EndoGMDE: Generalizable Monocular Depth Estimation with Mixture of Low-Rank Experts for Diverse Endoscopic Scenes1 Sep 2025
- 2025EndoUFM: Utilizing Foundation Models for Monocular depth estimation of endoscopic images25 Aug 2025
- 2025Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction15 Aug 2025
- 2025Surg-InvNeRF: Invertible NeRF for 3D tracking and reconstruction in surgical vision13 Aug 2025
- 2025NeeCo: Image Synthesis of Novel Instrument States Based on Dynamic and Deformable 3D Gaussian Reconstruction11 Aug 2025
- 2025EndoMatcher: Generalizable Endoscopic Image Matcher via Multi-Domain Pre-training for Robot-Assisted Surgery7 Aug 2025
- 2025Endoscopic Depth Estimation Based on Deep Learning: A Survey28 Jul 2025
- 2025PanMatch: Unleashing the Potential of Large Vision Models for Unified Matching Models11 Jul 2025
- 2025EndoMUST: Monocular Depth Estimation for Robotic Endoscopy via End-to-end Multi-step Self-supervised Training19 Jun 2025
- 2025SurGSplat: Progressive Geometry-Constrained Gaussian Splatting for Surgical Scene Reconstruction6 Jun 2025
- 2025Monocular Depth Guided Occlusion-Aware Disparity Refinement via Semi-supervised Learning in Laparoscopic Images13 May 2025
- 2025StereoMamba: Real-time and Robust Intraoperative Stereo Disparity Estimation via Long-range Spatial Dependencies24 Apr 2025
- 2025CodingHomo: Bootstrapping Deep Homography With Video Coding16 Apr 2025
- 2025Endo3R: Unified Online Reconstruction from Dynamic Monocular Endoscopic Video4 Apr 2025
- 2025EndoLRMGS: Complete Endoscopic Scene Reconstruction combining Large Reconstruction Modelling and Gaussian Splatting28 Mar 2025
- 2025Endo-TTAP: Robust Endoscopic Tissue Tracking via Multi-Facet Guided Attention and Hybrid Flow-point Supervision28 Mar 2025
- 2025Learning to Efficiently Adapt Foundation Models for Self-Supervised Endoscopic 3D Scene Reconstruction from Any Cameras20 Mar 2025
- 2025Endo-FASt3r: Endoscopic Foundation model Adaptation for Structure from motion10 Mar 2025
- 2025Robust Real-Time Endoscopic Stereo Matching under Fuzzy Tissue Boundaries2 Mar 2025
- 2024DaRePlane: Direction-aware Representations for Dynamic Scene Reconstruction18 Oct 2024
- 2024Robotic Arm Platform for Multi-View Image Acquisition and 3D Reconstruction in Minimally Invasive Surgery15 Oct 2024
50 newest of 101 All 101 (JSON)
- 2025Fast SAM2 with Text-Driven Token Pruningcited by 3
- 2025Fast SAM2 with Text-Driven Token Pruning24 Dec 2025
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 78
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2023EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videoscited by 68
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
- 2024Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgerycited by 52
- 2023Learning How To Robustly Estimate Camera Pose in Endoscopic Videoscited by 49
- 2024Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splattingcited by 43
- 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
- 2021Self-Supervised Generative Adversarial Network for Depth Estimation in Laparoscopic Imagescited by 21
- 2024LGS: A Light-weight 4D Gaussian Splatting for Efficient Surgical Scene Reconstructioncited by 21
- 2024EndoGaussian: Real-time Gaussian Splatting for Dynamic Endoscopic Scene Reconstructioncited by 20
12 most cited of 97 All 97 (JSON)
- 2026EndoPrior-GS: Dynamic Endoscopic Reconstruction with a Joint Texture Prior29 Sep 2026
- 2026RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment16 Sep 2026
- 2026MV-dVRK: A Multi-Viewpoint Benchmark for Spatial Surgical Perception2 Sep 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026Boosting Generalizable Depth Estimation in Endoscopy by Mixture of Lightweight Experts and Intrinsic Image Alignment1 Aug 2026
- 2026Gastroendoscopy View Synthesis: A New Real Dataset and Evaluation24 Jun 2026
- 2026SCARED-C: Corrected Camera Poses for Endoscopic Depth Estimation15 May 2026
- 2026EndoVGGT: GNN-Enhanced Depth Estimation for Surgical 3D Reconstruction25 Mar 2026
- 2026SurgFed: Language-guided Multi-Task Federated Learning for Surgical Video Understanding10 Mar 2026
- 2026SurgCUT3R: Surgical Scene-Aware Continuous Understanding of Temporal 3D Representation7 Mar 2026
- 2026The Dresden Dataset for 4D Reconstruction of Non-Rigid Abdominal Surgical Scenes3 Mar 2026
12 newest of 97 All 97 (JSON)