OpenDepth: Repurposing Image Editing Priors for Robust Open-World Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Recently, the integration of generative priors has revolutionized Monocular Depth Estimation (MDE), achieving state-of-the-art (SOTA) performance with remarkably high data efficiency. However, although methods based on Text-to-Image (T2I) models excel in general scenes, their efficacy degrades sharply when confronted with open-world environmental perturbations, such as illumination variations and adverse weather. Since T2I priors are optimized for semantic synthesis rather than preserving pixel-level structure, they struggle to decouple geometry from appearance under severe visual shifts, easily triggering structural hallucinations. Therefore, our core insight is to model open-world depth estimation as consistent geometric inference across multi-style images, fully leveraging the powerful structure-preserving editing priors of Image-to-Image (I2I) models. Based on this, we propose OpenDepth, a robust open-world MDE framework that introduces "Intra-Domain Awareness" -- the capability to map diverse stylistic inputs sharing identical geometry into a unified latent space. To achieve this, we first align shallow features within the Diffusion Transformer (DiT) to anchor degraded observations to unified geometric representations. Additionally, we introduce a joint RGB latent reconstruction task, requiring the model to recover clean RGB information from degraded inputs. This multi-stage strategy effectively decouples environmental style interference, compelling the model to focus strictly on underlying geometric recovery. Extensive evaluations show that OpenDepth sets new SOTA records for robust zero-shot depth estimation across standard and extreme weather benchmarks, demonstrating exceptional structural integrity and adaptability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 74 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
39 of 74 references.
References · 39
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
27 more
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2020Virtual KITTI 2cited by 353
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 166
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 61
- 2021Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Darkcited by 58
- 2017Socially Compliant Navigation through Raw Depth Inputs with Generative Adversarial Imitation Learningcited by 52
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 52
- 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptionscited by 49
- 2023STEPS: Joint Self-supervised Nighttime Image Enhancement and Depth Estimationcited by 37
- 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 34
- 2025From Editor to Dense Geometry Estimatorcited by 24
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priorscited by 22
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimationcited by 21
- 2025Always Clear Depth: Robust Monocular Depth Estimation under Adverse Weathercited by 6
- 2023EC-Depth: Exploring the consistency of self-supervised monocular depth estimation in challenging scenescited by 5
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 5
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceiverscited by 5
- 2024Diff-2-in-1: Bridging Generation and Dense Perception with Diffusion Modelscited by 4
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimationcited by 4
- 2024Multi-Modality Driven LoRA for Adverse Condition Depth Estimationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning
- 2026Beyond Visual Ambiguity: Guiding Robust Monocular Depth Estimation in Challenging Scenarios via Detailed Long Captions
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation
- 2024Iris: Integrating Language into Diffusion-based Monocular Depth Estimation
- 2025Leveraging Stable Diffusion for Monocular Depth Estimation via Image Semantic Encoding
- 2026Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation
- 2024Structure-Centric Robust Monocular Depth Estimation via Knowledge Distillation
- 2025VistaDepth: Improving far-range Depth Estimation with Spectral Modulation and Adaptive Reweighting