Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
In this paper, we propose Iris, a deterministic framework for Monocular Depth Estimation (MDE) that integrates real-world priors into the diffusion model. Conventional feed-forward methods rely on massive training data, yet still miss details. Previous diffusion-based methods leverage rich generative priors yet struggle with synthetic-to-real domain transfer. Iris, in contrast, preserves fine details, generalizes strongly from synthetic to real scenes, and remains efficient with limited training data. To this end, we introduce a two-stage Priors-to-Geometry Deterministic (PGD) schedule: the prior stage uses Spectral-Gated Distillation (SGD) to transfer low-frequency real priors while leaving high-frequency details unconstrained, and the geometry stage applies Spectral-Gated Consistency (SGC) to enforce high-frequency fidelity while refining with synthetic ground truth. The two stages share weights and are executed with a high-to-low timestep schedule. Extensive experimental results confirm that Iris achieves significant improvements in MDE performance with strong in-the-wild generalization.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 50 of its 59 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
50 of 59 references.
Closest ancestors · 7
Same direction, newest first
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformers8 Oct
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation1 Dec
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think17 Sep
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage13 Sep
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normal24 Jun
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image18 Mar
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation2 Jun
Other references · 43
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023Segment Anythingcited by 8,158
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
31 more
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2021Variational Diffusion Modelscited by 1,145
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2020Virtual KITTI 2cited by 345
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2023Investigating the Catastrophic Forgetting in Multimodal Large Language Modelscited by 119
- 2023Diffusion Model as Representation Learnercited by 95
- 2023Open-vocabulary Object Segmentation with Diffusion Modelscited by 82
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 60
- 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 51
- 2024Foster Adaptivity and Balance in Learning with Noisy Labelscited by 9
- 2025Semi-supervised Semantic Segmentation with Multi-Constraint Consistency Learningcited by 8
- 2024Uncertainty-Participation Context Consistency Learning for Semi-supervised Semantic Segmentationcited by 6
- 2025Unbiased Object Detection Beyond Frequency with Visually Prompted Image Synthesiscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation
- 2025VistaDepth: Improving far-range Depth Estimation with Spectral Modulation and Adaptive Reweighting
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation
- 2024Iris: Integrating Language into Diffusion-based Monocular Depth Estimation
- 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimation
- 2023Monocular Depth Estimation using Diffusion Models
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation