Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Not on the map. Why?
Cited by 74 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Predicting depth is an essential component in understanding the 3D geometry of a scene. While for stereo images local correspondence suffices for estimation, finding depth relations from a single image is less straightforward, requiring integration of both global and local information from various cues. Moreover, the task is inherently ambiguous, with a large source of uncertainty coming from the overall scale. In this paper, we present a new method that addresses this task by employing two deep network stacks: one that makes a coarse global prediction based on the entire image, and another that refines this prediction locally. We also apply a scale-invariant error to help measure depth relations rather than scale. By leveraging the raw datasets as large sources of training data, our method achieves state-of-the-art results on both NYU Depth and KITTI, and matches detailed depth boundaries without the need for superpixelation.
Key facts. Cited by 1,264 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 225; 2022: 213; 2023: 224; 2024: 226; 2025: 200; 2026: 176.
1,264 papers.
Sort:
By area:
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
38 more
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2023A Cookbook of Self-Supervised Learningcited by 248
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2021Probabilistic and Geometric Depth: Detecting Objects in Perspectivecited by 190
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2021Delving into Deep Imbalanced Regressioncited by 157
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2021PENet: Towards Precise and Efficient Image Guided Depth Completioncited by 146
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 126
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
- 2022Revealing the Dark Secrets of Masked Image Modelingcited by 117
- 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 116
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
50 most cited of 1,264 All 1,264 (JSON)
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation29 Sep 2026
- 2026Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision28 Sep 2026
- 2026EpiTransfer: Sparse, Training-Free Long-Range Depth Estimation from Temporal Monocular Aerial Frames27 Sep 2026
- 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Models25 Sep 2026
- 2026PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation25 Sep 2026
- 2026Self-Supervised Perceptually Interpretable Monocular Depth Estimation25 Sep 2026
- 2026M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesis24 Sep 2026
- 2026WildHSR: Metric Feed-Forward 4D People-Scene Reconstruction from a 3D Foundation Model24 Sep 2026
- 2026GTR: Gated Token Recurrence for Efficient Dense Prediction22 Sep 2026
- 2026LiFR v2: Completion-Augmented Event Propagation for High-Rate Dense Prediction22 Sep 2026
- 2026CMAMBADEPTH: Self-supervised Monocular Depth Estimation with Channel Mamba and Hybrid Attention21 Sep 2026
- 2026Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement15 Sep 2026
38 more
- 2026OmniPoint: Universal Monocular Metric Pointcloud from Any Camera8 Sep 2026
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation8 Sep 2026
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation6 Sep 2026
- 2026UniFusion: Sparse-View 4D Reconstruction via Unified Spatio-temporal Depth Alignment5 Sep 2026
- 2026CrossDepth: Geometry-Constrained Attention for Generalizable Multi-View Surround Depth Estimation4 Sep 2026
- 2026Object Concepts Emerge from Motion3 Sep 2026
- 2026Cooperative Multi-Task Semantic Communication for Joint Classification and Regression Tasks3 Sep 2026
- 2026Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations3 Sep 2026
- 2026Seeing the World and the Self from Egocentric Video1 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention31 Aug 2026
- 2026Video Generative Models as Geometry Learner28 Aug 2026
- 2026PhysicsBench: A Unified Leaderboard for Generative and Predictive Models in Engineering Design and Simulation25 Aug 2026
- 2026SiZeUp: Fast 3D Proxy from Aerial Images via Depth Ordinal Loss24 Aug 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation17 Aug 2026
- 2026Depth-guided Multi-view Exposure Bracketing for HDR Robot Vision17 Aug 2026
- 2026RigidBench: Evaluating Rigid-Body Physics in Video Generation Models16 Aug 2026
- 2026Repurposing RGB-based Foundation Model for Depth Estimation on Thermal Images Using Hierarchical Supervision12 Aug 2026
- 2026View-Adaptive Renderer for View-Consistent 2D-to-3D Generation10 Aug 2026
- 2026An active-learning framework for real-time depth perception from monocular vision streams5 Aug 2026
- 2026LiteMVS: Efficient Multi-View Stereo with Foundation Distillation and Expert Aggregation4 Aug 2026
- 2026XiDepth: a Lightweight and Efficient Network for Self-supervised Monocular Depth Estimation4 Aug 2026
- 2026FeDepth: Federated Learning for Depth Estimation under Robot Heterogeneity2 Aug 2026
- 2026JEPADepth: Masked Predictive Representation Learning for Self-Supervised Monocular Depth Estimation29 Jul 2026
- 2026DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving28 Jul 2026
- 2026Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving23 Jul 2026
- 2026DAPM: UAV Monocular Depth Estimation from Any Height, Pitch, Roll and FOV23 Jul 2026
- 2026DPNeXt: A Lightweight Multi-Scale Feature Fusion Framework for Efficient ViT-Based Multi-Task Dense Prediction17 Jul 2026
- 2026Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth17 Jul 2026
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Cameras14 Jul 2026
- 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry13 Jul 2026
- 2026ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device9 Jul 2026
- 2026Gen4U: Unifying Video Generation and Understanding via Diffusion7 Jul 2026
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching7 Jul 2026
- 2026The Multipath Blind Spot: K-Agnostic Robust Calibration for Sparse-Anchor Metric Depth from Frozen Foundations5 Jul 2026
- 2026RayTun3R: Online Camera Adaptation in 3D Foundation Models2 Jul 2026
- 2026PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation2 Jul 2026
50 newest of 1,264 All 1,264 (JSON)
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100
- 2023Monocular Depth Estimation using Diffusion Modelscited by 87
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 82
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2023Generative Models: What Do They Know? Do They Know Things? Let's Find Out!cited by 50
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 47
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimationcited by 45
12 most cited of 72 All 72 (JSON)
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation8 Sep 2026
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation6 Sep 2026
- 2026Video Generative Models as Geometry Learner28 Aug 2026
- 2026Gen4U: Unifying Video Generation and Understanding via Diffusion7 Jul 2026
- 2026PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation2 Jul 2026
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible11 Jun 2026
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026
- 2026AtteConDA: Attention-Based Conflict Suppression in Multi-Condition Diffusion Models and Synthetic Data Augmentation10 May 2026
- 2026Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation17 Mar 2026
- 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment14 Mar 2026
- 2025Lotus-2: Advancing Geometric Dense Prediction with Powerful Image Generative Model30 Nov 2025
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation21 Oct 2025
12 newest of 72 All 72 (JSON)
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
- 2023VCoder: Versatile Vision Encoders for Multimodal Large Language Modelscited by 42
- 2025PAI-Bench: A Comprehensive Benchmark For Physical AIcited by 30
- 2024Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillationcited by 9
- 2026On the Generalization Capacities of MLLMs for Spatial Intelligencecited by 7
- 2024Proximity QA: Unleashing the Power of Multi-Modal Large Language Models for Spatial Proximity Analysiscited by 6
- 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillationcited by 4
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technologycited by 2
- 2026Unlocking Dense Metric Depth Estimation in VLMscited by 2
- 2026Ill-Posed by Design: Probing Evidence Use in VLMscited by 2
- 2026Lightweight Prompt-Guided CLIP Adaptation for Monocular Depth Estimationcited by 0
- 2026EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Datacited by 0
12 most cited of 14 All 14 (JSON)
- 2026Ill-Posed by Design: Probing Evidence Use in VLMs23 Jun 2026
- 2026Anchored, Not Graded: Vision-Language Models Fail at Slant-from-Texture Perception4 Jun 2026
- 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models4 Jun 2026
- 2026EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Data18 May 2026
- 2026Unlocking Dense Metric Depth Estimation in VLMs15 May 2026
- 2026Lightweight Prompt-Guided CLIP Adaptation for Monocular Depth Estimation1 Apr 2026
- 2026On the Generalization Capacities of MLLMs for Spatial Intelligence5 Mar 2026
- 2025PAI-Bench: A Comprehensive Benchmark For Physical AI1 Dec 2025
- 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation11 Jun 2025
- 2024Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation12 Dec 2024
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology21 Sep 2024
- 2024Proximity QA: Unleashing the Power of Multi-Modal Large Language Models for Spatial Proximity Analysis31 Jan 2024
12 newest of 14 All 14 (JSON)
- 2026A Frame is Worth One Token: Efficient Generative World Modeling with Delta Tokenscited by 9
- 2026GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulationcited by 7
- 2025Dreamland: Controllable World Creation with Simulator and Generative Modelscited by 5
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planningcited by 4
- 2026Flow Matching in Feature Space for Stochastic World Modelingcited by 4
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 2
- 2026PhyEdit: Towards Real-World Object Manipulation via Physically-Grounded Image Editingcited by 1
- 2026Stepper: Stepwise Immersive Scene Generation with Multiview Panoramascited by 0
- 2026Flow Matching in Feature Space for Stochastic World Modeling27 Jun 2026
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning23 Jun 2026
- 2026GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation20 May 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2026PhyEdit: Towards Real-World Object Manipulation via Physically-Grounded Image Editing8 Apr 2026
- 2026A Frame is Worth One Token: Efficient Generative World Modeling with Delta Tokens6 Apr 2026
- 2026Stepper: Stepwise Immersive Scene Generation with Multiview Panoramas30 Mar 2026
- 2025Dreamland: Controllable World Creation with Simulator and Generative Models9 Jun 2025
- 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoningcited by 44
- 2022Toward 3D Spatial Reasoning for Human-like Text-based Visual Question Answeringcited by 24
- 2025LLaFEA: Frame-Event Complementary Fusion for Fine-Grained Spatiotemporal Understanding in LMMscited by 5
- 2025Drones that Think on their Feet: Sudden Landing Decisions with Embodied AIcited by 1
- 2025Embodied Spatial Intelligence: from Implicit Scene Modeling to Spatial Reasoningcited by 0
- 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Modelscited by 0
- 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Models25 Sep 2026
- 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoning15 Oct 2025
- 2025Drones that Think on their Feet: Sudden Landing Decisions with Embodied AI30 Sep 2025
- 2025Embodied Spatial Intelligence: from Implicit Scene Modeling to Spatial Reasoning30 Aug 2025
- 2025LLaFEA: Frame-Event Complementary Fusion for Fine-Grained Spatiotemporal Understanding in LMMs10 Mar 2025
- 2022Toward 3D Spatial Reasoning for Human-like Text-based Visual Question Answering21 Sep 2022
- 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimationcited by 4
- 2025LMDepth: Lightweight Mamba-based Monocular Depth Estimation for Real-World Deploymentcited by 0
- 2025Tree-Mamba: A Tree-Aware Mamba for Underwater Monocular Depth Estimationcited by 0
- 2026CMAMBADEPTH: Self-supervised Monocular Depth Estimation with Channel Mamba and Hybrid Attentioncited by 0
- 2026CMAMBADEPTH: Self-supervised Monocular Depth Estimation with Channel Mamba and Hybrid Attention21 Sep 2026
- 2025Tree-Mamba: A Tree-Aware Mamba for Underwater Monocular Depth Estimation10 Jul 2025
- 2025LMDepth: Lightweight Mamba-based Monocular Depth Estimation for Real-World Deployment2 May 2025
- 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation6 Jun 2024
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
12 most cited of 1,155 All 1,155 (JSON)
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation29 Sep 2026
- 2026Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision28 Sep 2026
- 2026EpiTransfer: Sparse, Training-Free Long-Range Depth Estimation from Temporal Monocular Aerial Frames27 Sep 2026
- 2026PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation25 Sep 2026
- 2026Self-Supervised Perceptually Interpretable Monocular Depth Estimation25 Sep 2026
- 2026M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesis24 Sep 2026
- 2026WildHSR: Metric Feed-Forward 4D People-Scene Reconstruction from a 3D Foundation Model24 Sep 2026
- 2026GTR: Gated Token Recurrence for Efficient Dense Prediction22 Sep 2026
- 2026LiFR v2: Completion-Augmented Event Propagation for High-Rate Dense Prediction22 Sep 2026
- 2026Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement15 Sep 2026
- 2026OmniPoint: Universal Monocular Metric Pointcloud from Any Camera8 Sep 2026
- 2026UniFusion: Sparse-View 4D Reconstruction via Unified Spatio-temporal Depth Alignment5 Sep 2026
12 newest of 1,155 All 1,155 (JSON)