Spectral Rectification for Parameter-Efficient Adaptation of Foundation Models in Colonoscopy Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Accurate monocular depth estimation is critical in colonoscopy for lesion localization and navigation. Foundation models trained on natural images fail to generalize directly to colonoscopy. We identify the core issue not as a semantic gap, but as a statistical shift in the frequency domain: colonoscopy images lack the strong high-frequency edge and texture gradients that these models rely on for geometric reasoning. To address this, we propose SpecDepth, a parameter-efficient adaptation framework that preserves the robust geometric representations of the pre-trained models while adapting to the colonoscopy domain. Its key innovation is an adaptive spectral rectification module, which uses a learnable wavelet decomposition to explicitly model and amplify the attenuated high-frequency components in feature maps. Different from conventional fine-tuning that risks distorting high-level semantic features, this targeted, low-level adjustment realigns the input signal with the original inductive bias of the foundational model. On the public C3VD and SimCol3D datasets, SpecDepth achieved state-of-the-art performance with an absolute relative error of 0.022 and 0.027, respectively. Our work demonstrates that directly addressing spectral mismatches is a highly effective strategy for adapting vision foundation models to specialized medical imaging tasks. The code will be released publicly after the manuscript is accepted for publication.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 58 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
31 of 58 references.
References · 31
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 366
- 2023Customized Segment Anything Model for Medical Image Segmentationcited by 277
19 more
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
- 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
- 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
- 2019Multi-level Wavelet Convolutional Neural Networkscited by 59
- 2024Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgerycited by 52
- 2024EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Cameracited by 42
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2022Multi-stage image denoising with the wavelet transformcited by 37
- 2021Single Image Depth Prediction with Wavelet Decompositioncited by 34
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2020SERV-CT: A disparity dataset from CT for validation of endoscopic 3D reconstructioncited by 23
- 2019Attention-based Context Aggregation Network for Monocular Depth Estimationcited by 18
- 2024Transferring Relative Monocular Depth to Surgical Vision with Temporal Consistencycited by 13
- 2023A Surface-normal Based Neural Framework for Colonoscopy Reconstructioncited by 8
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimation and Completioncited by 8
- 2023Multi-task learning with cross-task consistency for improved depth estimation in colonoscopycited by 8
- 2024DARES: Depth Anything in Robotic Endoscopic Surgery with Self-supervised Vector-LoRA of the Foundation Modelcited by 8
- 2021Learnable Discrete Wavelet Pooling (LDW-Pooling) For Convolutional Networkscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ColonCrafter: A Depth Estimation Model for Colonoscopy Videos Using Diffusion Priors
- 2026DepthPilot: From Controllability to Interpretability in Colonoscopy Video Generation
- 2023ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Models
- 2025PPS-Ctrl: Controllable Sim-to-Real Translation for Colonoscopy Depth Estimation
- 2024CCIS-Diff: A Generative Model with Stable Diffusion Prior for Controlled Colonoscopy Image Synthesis
- 2026Learning with Geometric Priors in U-Net Variants for Polyp Segmentation
- 2024Frontiers in Intelligent Colonoscopy
- 2025EndoStreamDepth: Temporally Consistent Monocular Depth Estimation for Endoscopic Video Streams