Bridging the Ex-Vivo to In-Vivo Gap: Synthetic Priors for Monocular Depth Estimation in Specular Surgical Environments
Not on the map. Why?
Abstract (arXiv)
Accurate Monocular Depth Estimation (MDE) is critical for autonomous robotic surgery. However, existing self-supervised methods often exhibit a severe "ex-vivo to in-vivo gap": they achieve high accuracy on public datasets but struggle in actual clinical deployments. This disparity arises because the severe specular reflections and fluid-filled deformations inherent to real surgeries. Models trained on noisy real-world pseudo-labels consequently suffer from severe boundary collapse. To address this, we leverage the high-fidelity synthetic priors of the textitDepth Anything V2 architecture, which inherently capture precise geometric details, and efficiently adapt them to the medical domain using Dynamic Vector Low-Rank Adaptation (DV-LORA). Our contributions are two-fold. Technically, our approach establishes a new state-of-the-art on the public SCARED dataset; under a novel physically-stratified evaluation protocol, it reduces Squared Relative Error by over 17% in high-specularity regimes compared to strong baselines. Furthermore, to provide a rigorous reality check for the field, we introduce ROCAL-T 90 (Real Operative CT-Aligned Laparoscopic Trajectories 90), the first real-surgery validation dataset featuring 90 clinical endoscopic sequences with sub-millimeter (< 1mm) ground-truth trajectories. Evaluations on ROCAL-T 90 demonstrate our model's superior robustness in true clinical settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 37 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
18 of 37 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2023Segment Anythingcited by 8,158
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
- 2018Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulationcited by 140
- 2021Stereo Correspondence and Reconstruction of Endoscopic Data Challengecited by 101
- 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 78
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2020DeFeat-Net: General Monocular Depth via Simultaneous Unsupervised Representation Learningcited by 60
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 53
- 2022EndoMapper dataset of complete calibrated endoscopy procedurescited by 53
6 more
- 2024EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Cameracited by 42
- 2019DefSLAM: Tracking and Mapping of Deforming Scenes from Monocular Sequencescited by 36
- 2021Multi-View Fusion for Multi-Level Robotic Scene Understandingcited by 17
- 2016ORBSLAM-based Endoscope Tracking and 3D Reconstructioncited by 15
- 2022Deep Causal Learning for Robotic Intelligencecited by 3
- 2021Single-Camera 3D Head Fitting for Mixed Reality Clinical Applicationscited by 2
Built on by
Not cited yet.