Single-Image Depth Perception in the Wild
Not on the map. Why?
Abstract (arXiv)
This paper studies single-image depth perception in the wild, i.e., recovering depth from a single image taken in unconstrained settings. We introduce a new dataset "Depth in the Wild" consisting of images in the wild annotated with relative depth between pairs of random points. We also propose a new algorithm that learns to estimate metric depth using annotations of relative depth. Compared to the state of the art, our algorithm is simpler and performs better. Experiments show that our algorithm, combined with existing RGB-D data and our new relative depth annotations, significantly improves single-image depth perception in the wild.
Key facts. Cited by 180 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 42; 2022: 33; 2023: 28; 2024: 39; 2025: 25; 2026: 13.
180 papers.
Sort:
By area:
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
38 more
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 142
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
- 2022Learning to generate line drawings that convey geometry and semanticscited by 83
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 72
- 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Modelscited by 71
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2021Consistent Depth of Moving Objects in Videocited by 56
- 2023VA-DepthNet: A Variational Approach to Single Image Depth Predictioncited by 54
- 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 52
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 52
- 2023All in Tokens: Unifying Output Space of Visual Tasks via Soft Tokencited by 52
- 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
- 2021Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Predictioncited by 48
- 2021SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpaintingcited by 48
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 47
- 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 43
- 2022Towards Accurate Reconstruction of 3D Scene Shape from A Single Monocular Imagecited by 42
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2022FWD: Real-time Novel View Synthesis with Forward Warping and Depthcited by 39
- 2024Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentationcited by 38
- 2023Music-Driven Group Choreographycited by 37
- 2023HairStep: Transfer Synthetic to Real Using Strand and Depth Maps for Single-View 3D Hair Modelingcited by 36
- 2021Single Image Depth Estimation: An Overviewcited by 35
- 2023Booster: a Benchmark for Depth from Images of Specular and Transparent Surfacescited by 33
- 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 31
- 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
- 2025MVSAnywhere: Zero-Shot Multi-View Stereocited by 26
- 2023DaRF: Boosting Radiance Fields from Sparse Inputs with Monocular Depth Adaptationcited by 25
- 2024KiVA: Kid-inspired Visual Analogies for Testing Large Multimodal Modelscited by 24
- 2022From colouring-in to pointillism: revisiting semantic segmentation supervisioncited by 22
- 2021Learning Depth via Leveraging Semantics: Self-supervised Monocular Depth Estimation with Both Implicit and Explicit Semantic Guidancecited by 19
- 2021Fast and Accurate Single-Image Depth Estimation on Mobile Devices, Mobile AI 2021 Challenge: Reportcited by 19
- 2021Improving 360 Monocular Depth Estimation via Non-local Dense Prediction Transformer and Joint Supervised and Self-supervised Learningcited by 19
50 most cited of 180 All 180 (JSON)
- 2026GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidance9 Oct 2026
- 2026PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models14 Sep 2026
- 2026Data-Driven Risk Fields for Safer End-to-End Autonomous Driving9 Sep 2026
- 2026M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo21 Aug 2026
- 2026ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device9 Jul 2026
- 2026Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Task1 Jul 2026
- 2026One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models28 Jun 2026
- 2026In Depth We Trust: Reliable Monocular Depth Supervision for Gaussian Splatting7 Apr 2026
- 2026Depth-Guided Metric-Aware Temporal Consistency for Monocular Video Human Mesh Recovery4 Feb 2026
- 2026SHED Light on Segmentation for Dense Prediction30 Jan 2026
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources29 Jan 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
38 more
- 2026AnyDepth: Depth Estimation Made Easy6 Jan 2026
- 2025The 3D Mirage: Probing and Taming 3D Hallucinations17 Dec 2025
- 2025Accuracy Does Not Guarantee Human-Likeness: Cross-Domain Human-Centered Benchmark in Monocular Depth Estimation9 Dec 2025
- 2025Motion4D: Learning 3D-Consistent Motion and Semantics for 4D Scene Understanding3 Dec 2025
- 2025Understanding Task Transfer in Vision-Language Models24 Nov 2025
- 2025Toward A Better Understanding of Monocular Depth Evaluation22 Oct 2025
- 2025PFDepth: Heterogeneous Pinhole-Fisheye Joint Depth Estimation via Distortion-aware Gaussian-Splatted Volumetric Fusion30 Sep 2025
- 2025BRIDGE -- Building Reinforcement-Learning Depth-to-Image Data Generation Engine for Monocular Depth Estimation29 Sep 2025
- 2025EfficientDepth: A Fast and Detail-Preserving Monocular Depth Estimation Model26 Sep 2025
- 2025MedBLINK: Probing Basic Perception in Multimodal Language Models for Medicine4 Aug 2025
- 2025UniCT Depth: Event-Image Fusion Based Monocular Depth Estimation with Convolution-Compensated ViT Dual SA Block26 Jul 2025
- 2025Monocular One-Shot Metric-Depth Alignment for RGB-Based Robot Grasping20 Jun 2025
- 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation11 Jun 2025
- 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfaces6 Jun 2025
- 2025Enhancing Monocular Height Estimation via Weak Supervision from Imperfect Labels3 Jun 2025
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priors30 May 2025
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation30 May 2025
- 2025Bridging Geometric and Semantic Foundation Models for Generalized Monocular Depth Estimation29 May 2025
- 2025Boosting Zero-shot Stereo Matching using Large-scale Mixed Images Sources in the Real World13 May 2025
- 2025The Fourth Monocular Depth Estimation Challenge24 Apr 2025
- 2025MVSAnywhere: Zero-Shot Multi-View Stereo28 Mar 2025
- 2025QuartDepth: Post-Training Quantization for Real-Time Depth Estimation on the Edge20 Mar 2025
- 2025Towards Open-World Generation of Stereo Images and Unsupervised Matching17 Mar 2025
- 2025Towards Ambiguity-Free Spatial Foundation Model: Rethinking and Decoupling Depth Ambiguity8 Mar 2025
- 2025Survey on Monocular Metric Depth Estimation21 Jan 2025
- 2025A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation14 Jan 2025
- 2024MetricDepth: Enhancing Monocular Depth Estimation with Deep Metric Learning29 Dec 2024
- 2024Explanatory Instructions: Towards Unified Vision Tasks Understanding and Zero-shot Generalization24 Dec 2024
- 2024GVDepth: Zero-Shot Monocular Depth Estimation for Ground Vehicles based on Probabilistic Cue Fusion8 Dec 2024
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Fail5 Dec 2024
- 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Models4 Dec 2024
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation1 Dec 2024
- 2024DepthCues: Evaluating Monocular Depth Perception in Large Vision Models26 Nov 2024
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving31 Oct 2024
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervision24 Oct 2024
- 2024FrugalNeRF: Fast Convergence for Extreme Few-shot Novel View Synthesis without Learned Priors21 Oct 2024
- 2024Towards Foundation Models for 3D Vision: How Close Are We?14 Oct 2024
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Second2 Oct 2024
50 newest of 180 All 180 (JSON)
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 31
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimagecited by 12
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimationcited by 9
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimationcited by 5
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation30 May 2025
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation1 Dec 2024
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think17 Sep 2024
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage13 Sep 2024
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation4 Dec 2023
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimators5 Oct 2023
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Views29 Nov 2022
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillationcited by 5
- 2025Understanding Task Transfer in Vision-Language Modelscited by 3
- 2025MedBLINK: Probing Basic Perception in Multimodal Language Models for Medicinecited by 1
- 2026Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Taskcited by 1
- 2026PhysBrain 1.5: From Vision-Language Models to Physical Foundation Modelscited by 0
- 2026PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models14 Sep 2026
- 2026Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Task1 Jul 2026
- 2025Understanding Task Transfer in Vision-Language Models24 Nov 2025
- 2025MedBLINK: Probing Basic Perception in Multimodal Language Models for Medicine4 Aug 2025
- 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation11 Jun 2025
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priors30 May 2025
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceive18 Apr 2024
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 142
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
12 most cited of 162 All 162 (JSON)
- 2026GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidance9 Oct 2026
- 2026M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo21 Aug 2026
- 2026ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device9 Jul 2026
- 2026One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models28 Jun 2026
- 2026In Depth We Trust: Reliable Monocular Depth Supervision for Gaussian Splatting7 Apr 2026
- 2026Depth-Guided Metric-Aware Temporal Consistency for Monocular Video Human Mesh Recovery4 Feb 2026
- 2026SHED Light on Segmentation for Dense Prediction30 Jan 2026
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources29 Jan 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
- 2026AnyDepth: Depth Estimation Made Easy6 Jan 2026
- 2025The 3D Mirage: Probing and Taming 3D Hallucinations17 Dec 2025
- 2025Accuracy Does Not Guarantee Human-Likeness: Cross-Domain Human-Centered Benchmark in Monocular Depth Estimation9 Dec 2025
12 newest of 162 All 162 (JSON)