mlsanityData to 7 Oct 2026

Depth Anything in Medical Images: A Comparative Study

arXiv 2401.16600 ↗First posted 29 Jan 2024cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Monocular depth estimation (MDE) is a critical component of many medical tracking and mapping algorithms, particularly from endoscopic or laparoscopic video. However, because ground truth depth maps cannot be acquired from real patient data, supervised learning is not a viable approach to predict depth maps for medical scenes. Although self-supervised learning for MDE has recently gained attention, the outputs are difficult to evaluate reliably and each MDE's generalizability to other patients and anatomies is limited. This work evaluates the zero-shot performance of the newly released Depth Anything Model on medical endoscopic and laparoscopic scenes. We compare the accuracy and inference speeds of Depth Anything with other MDE models trained on general scenes as well as in-domain models trained on endoscopic data. Our findings show that although the zero-shot capability of Depth Anything is quite impressive, it is not necessarily better than other models in both speed and performance. We hope that this study can spark further research in employing foundation models for MDE in medical scenes.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 20 of its 44 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

20 of 44 references.

References · 20

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  3. 2021Vision Transformers for Dense Predictioncited by 1,789
  4. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  5. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  6. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  7. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
  8. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
  9. 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
  10. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
  11. 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
  12. 2021Endo-Depth-and-Motion: Reconstruction and Tracking in Endoscopic Videos using Depth Networks and Photometric Constraintscited by 80
8 more
  1. 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 78
  2. 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
  3. 2019Dense Depth Estimation in Monocular Endoscopy with Self-supervised Learning Methodscited by 45
  4. 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
  5. 2017Deep Learning and Conditional Random Fields-based Depth Estimation and Topographical Reconstruction from Conventional Endoscopycited by 31
  6. 2019SLAM Endoscopy enhanced by adversarial depth predictioncited by 26
  7. 2020Reconstructing Sinus Anatomy from Endoscopic Video -- Towards a Radiation-free Approach for Quantitative Longitudinal Assessmentcited by 23
  8. 2021Depth estimation of endoscopy using sim-to-real transfercited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 6; 2026: 4.

13 papers.

Sort: