mlsanityData to 14 Oct 2026

EndoSfM3D: Learning to 3D Reconstruct Any Endoscopic Surgery Scene using Self-supervised Foundation Model

arXiv 2510.22359 ↗First posted 25 Oct 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D reconstruction of endoscopic surgery scenes plays a vital role in enhancing scene perception, enabling AR visualization, and supporting context-aware decision-making in image-guided surgery. A critical yet challenging step in this process is the accurate estimation of the endoscope's intrinsic parameters. In real surgical settings, intrinsic calibration is hindered by sterility constraints and the use of specialized endoscopes with continuous zoom and telescope rotation. Most existing methods for endoscopic 3D reconstruction do not estimate intrinsic parameters, limiting their effectiveness for accurate and reliable reconstruction. In this paper, we integrate intrinsic parameter estimation into a self-supervised monocular depth estimation framework by adapting the Depth Anything V2 (DA2) model for joint depth, pose, and intrinsics prediction. We introduce an attention-based pose network and a Weight-Decomposed Low-Rank Adaptation (DoRA) strategy for efficient fine-tuning of DA2. Our method is validated on the SCARED and C3VD public datasets, demonstrating superior performance compared to recent state-of-the-art approaches in self-supervised monocular depth estimation and 3D reconstruction. Code and model weights can be found in project repository: https://github.com/MOYF-beta/EndoSfM3D.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 25 Oct 2025.

Builds on

18 of 32 references.

References · 18

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2021Vision Transformers for Dense Predictioncited by 1,803
  3. 2024Depth Anything V2cited by 1,422
  4. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
  5. 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
  6. 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
  7. 2021Stereo Correspondence and Reconstruction of Endoscopic Data Challengecited by 103
  8. 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
  9. 2021Endo-Depth-and-Motion: Reconstruction and Tracking in Endoscopic Videos using Depth Networks and Photometric Constraintscited by 81
  10. 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 80
  11. 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 72
  12. 2020DeFeat-Net: General Monocular Depth via Simultaneous Unsupervised Representation Learningcited by 60
6 more
  1. 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 52
  2. 2024EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Cameracited by 43
  3. 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videoscited by 14
  4. 2023Multi-task learning with cross-task consistency for improved depth estimation in colonoscopycited by 8
  5. 2024DARES: Depth Anything in Robotic Endoscopic Surgery with Self-supervised Vector-LoRA of the Foundation Modelcited by 8
  6. 2025Endo-FASt3r: Endoscopic Foundation model Adaptation for Structure from motioncited by 6

Built on by

Not cited yet.