ReDepth Anything: Test-Time Depth Refinement via Self-Supervised Re-lighting
Not on the map. Why?
Abstract (arXiv)
Monocular depth estimation remains challenging, as foundation models such as Depth Anything V2 (DA-V2) struggle with real-world images that are far from the training distribution. We introduce Re-Depth Anything, a test-time self-supervision framework that bridges this domain gap by fusing foundation models with the powerful priors of large-scale 2D diffusion models. Our method performs label-free refinement directly on the input image by re-lighting the predicted depth map and augmenting the input. This re-synthesis method replaces classical photometric reconstruction by leveraging shape from shading (SfS) cues in a new, generative context with Score Distillation Sampling (SDS). To prevent optimization collapse, our framework updates only intermediate embeddings and the decoder's weights, rather than optimizing the depth tensor directly or fine-tuning the full model. Across diverse benchmarks, Re-Depth Anything yields substantial gains in depth accuracy and realism over DA-V2, and applied on top of Depth Anything 3 (DA3) achieves state-of-the-art results, showcasing new avenues for self-supervision by geometric reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 63 references that are in the map. First posted on arXiv 19 Dec 2025.
Builds on
46 of 63 references.
References · 46
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
34 more
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 234
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 153
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
- 2019FastDepth: Fast Monocular Depth Estimation on Embedded Systemscited by 94
- 2023ATT3D: Amortized Text-to-3D Object Synthesiscited by 87
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimationcited by 45
- 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
- 2023GEDepth: Ground Embedding for Monocular Depth Estimationcited by 26
- 2024Test-Time Adaptation for Depth Completioncited by 26
- 2024GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyondcited by 25
- 2022The Relative Importance of Depth Cues and Semantic Edges for Indoor Mobility Using Simulated Prosthetic Vision in Immersive Virtual Realitycited by 10
- 2024A Simple yet Effective Test-Time Adaptation for Zero-Shot Monocular Metric Depth Estimationcited by 6
- 2025DreamTexture: Shape from Virtual Texture with Analysis by Augmentationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions
- 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Task
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation
- 2021Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimation
- 2025Dream-to-Recon: Monocular 3D Reconstruction with Diffusion-Depth Distillation from Single Images
- 2023Monocular Depth Estimation using Diffusion Models
- 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusion
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation