mlsanityData to 14 Oct 2026

ReDepth Anything: Test-Time Depth Refinement via Self-Supervised Re-lighting

arXiv 2512.17908 ↗First posted 19 Dec 2025cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Monocular depth estimation remains challenging, as foundation models such as Depth Anything V2 (DA-V2) struggle with real-world images that are far from the training distribution. We introduce Re-Depth Anything, a test-time self-supervision framework that bridges this domain gap by fusing foundation models with the powerful priors of large-scale 2D diffusion models. Our method performs label-free refinement directly on the input image by re-lighting the predicted depth map and augmenting the input. This re-synthesis method replaces classical photometric reconstruction by leveraging shape from shading (SfS) cues in a new, generative context with Score Distillation Sampling (SDS). To prevent optimization collapse, our framework updates only intermediate embeddings and the decoder's weights, rather than optimizing the depth tensor directly or fine-tuning the full model. Across diverse benchmarks, Re-Depth Anything yields substantial gains in depth accuracy and realism over DA-V2, and applied on top of Depth Anything 3 (DA3) achieves state-of-the-art results, showcasing new avenues for self-supervision by geometric reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 63 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

46 of 63 references.

References · 46

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  9. 2021Vision Transformers for Dense Predictioncited by 1,803
  10. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
34 more
  1. 2024Depth Anything V2cited by 1,422
  2. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  3. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  4. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  6. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  7. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  8. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  9. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  10. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  11. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  12. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  13. 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
  14. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  15. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  16. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  17. 2023Text-to-3D using Gaussian Splattingcited by 299
  18. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  19. 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 234
  20. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
  21. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
  22. 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 153
  23. 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
  24. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
  25. 2019FastDepth: Fast Monocular Depth Estimation on Embedded Systemscited by 94
  26. 2023ATT3D: Amortized Text-to-3D Object Synthesiscited by 87
  27. 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimationcited by 45
  28. 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
  29. 2023GEDepth: Ground Embedding for Monocular Depth Estimationcited by 26
  30. 2024Test-Time Adaptation for Depth Completioncited by 26
  31. 2024GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyondcited by 25
  32. 2022The Relative Importance of Depth Cues and Semantic Edges for Indoor Mobility Using Simulated Prosthetic Vision in Immersive Virtual Realitycited by 10
  33. 2024A Simple yet Effective Test-Time Adaptation for Zero-Shot Monocular Metric Depth Estimationcited by 6
  34. 2025DreamTexture: Shape from Virtual Texture with Analysis by Augmentationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions
  2. 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Task
  3. 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation
  4. 2021Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimation
  5. 2025Dream-to-Recon: Monocular 3D Reconstruction with Diffusion-Depth Distillation from Single Images
  6. 2023Monocular Depth Estimation using Diffusion Models
  7. 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusion
  8. 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation