Endoscopic Depth Estimation Based on Deep Learning: A Survey
Not on the map. Why?
Abstract (arXiv)
Endoscopic depth estimation is a critical technology for improving the safety and precision of minimally invasive surgery. It has attracted considerable attention from researchers in medical imaging, computer vision, and robotics. Over the past decade, a large number of methods have been developed. Despite the existence of several related surveys, a comprehensive overview focusing on recent deep learning-based techniques is still limited. This paper endeavors to bridge this gap by comprehensively reviewing the state-of-the-art literature. Specifically, we provide a thorough survey of the field from three key perspectives: data, methods, and applications. Firstly, at the data level, we describe the acquisition process of publicly available datasets. Secondly, at the methodological level, we introduce both monocular and stereo deep learning-based approaches for endoscopic depth estimation. Thirdly, at the application level, we identify the specific challenges and corresponding solutions for the clinical implementation of depth estimation technology, situated within concrete clinical scenarios. Finally, we outline potential directions for future research, such as domain adaptation, real-time implementation, and the synergistic fusion of depth information with sensor technologies, thereby providing a valuable starting point for researchers to engage with and advance the field toward clinical translation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 122 of its 286 references that are in the map. First posted on arXiv 28 Jul 2025.
Builds on
122 of 286 references.
References · 122
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2014Going Deeper with Convolutionscited by 4,241
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
38 more
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2018Pyramid Stereo Matching Networkcited by 489
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 342
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 244
- 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 153
- 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
- 2015Stereo Matching by Training a Convolutional Neural Network to Compare Image Patchescited by 151
- 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
- 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
- 2017Semi-Supervised Deep Learning for Monocular Depth Map Predictioncited by 109
- 2014Deep Convolutional Neural Fields for Depth Estimation from a Single Imagecited by 106
- 2020Surgical Data Science -- from Concepts toward Clinical Translationcited by 105
- 2021Stereo Correspondence and Reconstruction of Endoscopic Data Challengecited by 103
- 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimationcited by 100
- 2016Estimating Depth from Monocular Images as Classification Using Deep Fully Convolutional Residual Networkscited by 91
- 2018StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Predictioncited by 88
- 2018SegStereo: Exploiting Semantic Information for Disparity Estimationcited by 88
- 2021Endo-Depth-and-Motion: Reconstruction and Tracking in Endoscopic Videos using Depth Networks and Photometric Constraintscited by 81
- 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 80
- 2016VolumeDeform: Real-time Volumetric Non-rigid Reconstructioncited by 75
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 72
- 2020DeFeat-Net: General Monocular Depth via Simultaneous Unsupervised Representation Learningcited by 60
- 2017Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Trainingcited by 57
- 2018AdaDepth: Unsupervised Content Congruent Adaptation for Depth Estimationcited by 54
- 2018Anytime Stereo Image Depth Estimation on Mobile Devicescited by 54
- 2022EndoMapper dataset of complete calibrated endoscopy procedurescited by 53
50 most cited of 122 All 122 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.