mlsanityData to 7 Oct 2026

Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation

arXiv 2603.16340 ↗First posted 17 Mar 2026cs.CVcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

In this paper, we propose Iris, a deterministic framework for Monocular Depth Estimation (MDE) that integrates real-world priors into the diffusion model. Conventional feed-forward methods rely on massive training data, yet still miss details. Previous diffusion-based methods leverage rich generative priors yet struggle with synthetic-to-real domain transfer. Iris, in contrast, preserves fine details, generalizes strongly from synthetic to real scenes, and remains efficient with limited training data. To this end, we introduce a two-stage Priors-to-Geometry Deterministic (PGD) schedule: the prior stage uses Spectral-Gated Distillation (SGD) to transfer low-frequency real priors while leaving high-frequency details unconstrained, and the geometry stage applies Spectral-Gated Consistency (SGC) to enforce high-frequency fidelity while refining with synthetic ground truth. The two stages share weights and are executed with a high-to-low timestep schedule. Extensive experimental results confirm that Iris achieves significant improvements in MDE performance with strong in-the-wild generalization.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 50 of its 59 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

50 of 59 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformers8 Oct
  2. 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation1 Dec
  3. 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think17 Sep
  4. 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage13 Sep
  5. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normal24 Jun
  6. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image18 Mar
  7. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation2 Jun

Other references · 43

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2023Segment Anythingcited by 8,158
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  12. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
31 more
  1. 2021Vision Transformers for Dense Predictioncited by 1,789
  2. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  3. 2024Depth Anything V2cited by 1,385
  4. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  5. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  6. 2021Variational Diffusion Modelscited by 1,145
  7. 2022Planning-oriented Autonomous Drivingcited by 1,068
  8. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  9. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  10. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  11. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  12. 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
  13. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  14. 2020Virtual KITTI 2cited by 345
  15. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  16. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
  17. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  18. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
  19. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  20. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
  21. 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
  22. 2023Investigating the Catastrophic Forgetting in Multimodal Large Language Modelscited by 119
  23. 2023Diffusion Model as Representation Learnercited by 95
  24. 2023Open-vocabulary Object Segmentation with Diffusion Modelscited by 82
  25. 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
  26. 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 60
  27. 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 51
  28. 2024Foster Adaptivity and Balance in Learning with Noisy Labelscited by 9
  29. 2025Semi-supervised Semantic Segmentation with Multi-Constraint Consistency Learningcited by 8
  30. 2024Uncertainty-Participation Context Consistency Learning for Semi-supervised Semantic Segmentationcited by 6
  31. 2025Unbiased Object Detection Beyond Frequency with Visually Prompted Image Synthesiscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation
  2. 2025VistaDepth: Improving far-range Depth Estimation with Spectral Modulation and Adaptive Reweighting
  3. 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions
  4. 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation
  5. 2024Iris: Integrating Language into Diffusion-based Monocular Depth Estimation
  6. 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimation
  7. 2023Monocular Depth Estimation using Diffusion Models
  8. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation