Advancing Depth Anything Model for Unsupervised Monocular Depth Estimation in Endoscopy
Not on the map. Why?
Abstract (arXiv)
Depth estimation is a cornerstone of 3D reconstruction and plays a vital role in minimally invasive endoscopic surgeries. However, most current depth estimation networks rely on traditional convolutional neural networks, which are limited in their ability to capture global information. Foundation models offer a promising approach to enhance depth estimation, but those models currently available are primarily trained on natural images, leading to suboptimal performance when applied to endoscopic images. In this work, we introduce a novel fine-tuning strategy for the Depth Anything Model and integrate it with an intrinsic-based unsupervised monocular depth estimation framework. Our approach includes a low-rank adaptation technique based on random vectors, which improves the model's adaptability to different scales. Additionally, we propose a residual block built on depthwise separable convolution to compensate for the transformer's limited ability to capture local features. Our experimental results on the SCARED dataset and Hamlyn dataset show that our method achieves state-of-the-art performance while minimizing the number of trainable parameters. Applying this method in minimally invasive endoscopic surgery can enhance surgeons' spatial awareness, thereby improving the precision and safety of the procedures.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 12 Sep 2024.
Builds on
24 of 35 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 658
- 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
12 more
- 2023VeRA: Vector-based Random Matrix Adaptationcited by 294
- 2020Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNscited by 103
- 2021Stereo Correspondence and Reconstruction of Endoscopic Data Challengecited by 101
- 2022Inception Transformercited by 99
- 2021Endo-Depth-and-Motion: Reconstruction and Tracking in Endoscopic Videos using Depth Networks and Photometric Constraintscited by 80
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2024EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Cameracited by 42
- 2023STEPS: Joint Self-supervised Nighttime Image Enhancement and Depth Estimationcited by 36
- 2023Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuningcited by 29
- 2022Depthformer : Multiscale Vision Transformer For Monocular Depth Estimation With Local Global Information Fusioncited by 20
- 2022Photometric single-view dense 3D reconstruction in endoscopycited by 11
- 2021Learning-Based Depth and Pose Estimation for Monocular Endoscope with Loss Generalizationcited by 4
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025UniUIR: Considering Underwater Image Restoration as An All-in-One Learnercited by 20
- 2025Endoscopic Depth Estimation Based on Deep Learning: A Surveycited by 1
- 2025eNCApsulate: NCA for Precision Diagnosis on Capsule Endoscopescited by 0
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunitiescited by 0
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2025Endoscopic Depth Estimation Based on Deep Learning: A Survey28 Jul 2025
- 2025eNCApsulate: NCA for Precision Diagnosis on Capsule Endoscopes30 Apr 2025
- 2025UniUIR: Considering Underwater Image Restoration as An All-in-One Learner22 Jan 2025