mlsanityData to 7 Oct 2026

ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning

arXiv 2607.12433 ↗First posted 14 Jul 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Diffusion models have recently become the dominant paradigm for monocular depth estimation (MDE). However, they implicitly assume that depth can be recovered as a globally smooth field through iterative denoising, which does not explicitly reflect the piecewise and scale-dependent organization of scene geometry. In practice, geometric structure emerges progressively across spatial scales, where coarse layout, surfaces, and boundaries are constructed in a hierarchical manner. Motivated by this observation, we introduce ARDepth, which formulates depth estimation as structured auto-regressive generation. Instead of recovering depth through global refinement, ARDepth progressively constructs depth representations as spatial resolution increases. To support this generative process, we introduce Scale-Progressive Conditioning (SPC) to inject multi-scale visual features at each generation stage, and Semantic-Aware Guidance (SAG) to provide scene-level semantic priors that enhance global structural consistency. Together, these designs enable the model to capture fine-grained local details while maintaining coherent global geometry. Empirical results demonstrate that our approach achieves strong performance and produces structurally consistent depth predictions across scales, validating auto-regressive generation as a promising alternative paradigm for geometric modeling.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 52 of its 59 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

52 of 59 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation5 Jan
  2. 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusion18 Dec
  3. 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Task23 Sep
  4. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image18 Mar
  5. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation4 Dec

Other references · 47

  1. 2023Segment Anythingcited by 8,158
  2. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  7. 2021Vision Transformers for Dense Predictioncited by 1,789
  8. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  9. 2024Depth Anything V2cited by 1,385
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  11. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  12. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
35 more
  1. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  2. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  3. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  4. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  5. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  6. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
  7. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  8. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  9. 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
  10. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  11. 2020Virtual KITTI 2cited by 345
  12. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  13. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  14. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
  15. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
  16. 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
  17. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  18. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
  19. 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
  20. 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 110
  21. 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
  22. 2022Can Language Understand Depth?cited by 66
  23. 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 60
  24. 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 51
  25. 2023All for One, and One for All: UrbanSyn Dataset, the third Musketeer of Synthetic Driving Scenescited by 40
  26. 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40
  27. 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
  28. 2025Visual Autoregressive Modeling for Instruction-Guided Image Editingcited by 21
  29. 2025Vision-Language Embodiment for Monocular Depth Estimationcited by 16
  30. 2024Scalable Autoregressive Monocular Depth Estimationcited by 9
  31. 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generationcited by 5
  32. 2023EC-Depth: Exploring the consistency of self-supervised monocular depth estimation in challenging scenescited by 4
  33. 2024Plane2Depth: Hierarchical Adaptive Plane Guidance for Monocular Depth Estimationcited by 4
  34. 2026World Models as Group Actionscited by 3
  35. 2026OptiMVMap: Offline Vectorized Map Construction via Optimal Multi-vehicle Perspectivescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions
  2. 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation
  3. 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimation
  4. 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage
  5. 2026EagleDepth: Efficient Fine-Grained Depth Estimation via Pixel Diffusion Decoder
  6. 2026Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation
  7. 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation
  8. 2025VistaDepth: Improving far-range Depth Estimation with Spectral Modulation and Adaptive Reweighting