Single Image Depth Estimation: An Overview
Not on the map. Why?
Abstract (arXiv)
We review solutions to the problem of depth estimation, arguably the most important subtask in scene understanding. We focus on the single image depth estimation problem. Due to its properties, the single image depth estimation problem is currently best tackled with machine learning methods, most successfully with convolutional neural networks. We provide an overview of the field by examining key works. We examine non-deep learning approaches that mostly predate deep learning and utilize hand-crafted features and assumptions, and more recent works that mostly use deep learning techniques. The single image depth estimation problem is tackled first in a supervised fashion with absolute or relative depth information acquired from human or sensor-labeled data, or in an unsupervised way using unlabelled stereo images or video datasets. We also study multitask approaches that combine the depth estimation problem with related tasks such as semantic segmentation and surface normal estimation. Finally, we discuss investigations into the mechanisms, principles, and failure cases of contemporary solutions.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 45 of its 80 references that are in the map. First posted on arXiv 13 Apr 2021.
Builds on
45 of 80 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
33 more
- 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 184
- 2016Single-Image Depth Perception in the Wildcited by 179
- 2017Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Imagecited by 159
- 2017Learning Depth from Monocular Videos using Direct Methodscited by 154
- 2019Pattern-Affinitive Propagation across Depth, Surface Normal and Semantic Segmentationcited by 141
- 2017Neural Expectation Maximizationcited by 123
- 2019Stochastic Optimization of Sorting Networks via Continuous Relaxationscited by 111
- 2017Semi-Supervised Deep Learning for Monocular Depth Map Predictioncited by 109
- 2020CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistencycited by 107
- 2014Deep Convolutional Neural Fields for Depth Estimation from a Single Imagecited by 106
- 2016Estimating Depth from Monocular Images as Classification Using Deep Fully Convolutional Residual Networkscited by 91
- 2019How do neural networks see depth in single images?cited by 82
- 2016IM2CADcited by 78
- 2020Don't Forget The Past: Recurrent Depth Estimation from Monocular Videocited by 71
- 2018T2Net: Synthetic-to-Realistic Translation for Solving Single-Image Depth Estimation Taskscited by 70
- 2019Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimationcited by 61
- 2019DepthTransfer: Depth Extraction from Video Using Non-parametric Samplingcited by 60
- 2020Multi-view Depth Estimation using Epipolar Spatio-Temporal Networkscited by 59
- 2017Cross-Domain Self-supervised Multi-task Feature Learning using Synthetic Imagerycited by 56
- 2019Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depthcited by 50
- 2020Single Image Depth Estimation Trained via Depth from Defocus Cuescited by 45
- 2016The Curious Robot: Learning Visual Representations via Physical Interactionscited by 37
- 2016SceneNet RGB-D: 5M Photorealistic Images of Synthetic Indoor Trajectories with Ground Truthcited by 31
- 2018Learning Single-Image Depth from Videos using Quality Assessment Networkscited by 25
- 2019Visualization of Convolutional Neural Networks for Monocular Depth Estimationcited by 24
- 2020Taskology: Utilizing Task Relations at Scalecited by 19
- 2016Unified Depth Prediction and Intrinsic Image Decomposition from a Single Image via Joint Convolutional Neural Fieldscited by 17
- 2016Parse Geometry from a Line: Monocular Depth Estimation with Partial Laser Observationcited by 14
- 2020Monocular Depth Estimation via Listwise Ranking using the Plackett-Luce Modelcited by 12
- 2016RGBD Datasets: Past, Present and Futurecited by 11
- 2019Temporally Consistent Depth Prediction with Flow-Guided Memory Unitscited by 10
- 2020A New Distributional Ranking Loss With Uncertainty: Illustrated in Relative Depth Estimationcited by 5
- 2020Relative Depth Estimation as a Ranking Problemcited by 4
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 12; 2024: 12; 2025: 5; 2026: 2.
35 papers.
Sort:
By area:
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2022K-Radar: 4D Radar Object Detection for Autonomous Driving in Various Weather Conditionscited by 107
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2025Ovis-U1 Technical Reportcited by 65
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
- 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospectscited by 30
- 2024DepthLab: From Partial to Completecited by 27
- 2021Visual and Object Geo-localization: A Comprehensive Surveycited by 13
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 13
- 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modelingcited by 12
23 more
- 2023Spatial and Visual Perspective-Taking via View Rotation and Relation Reasoning for Embodied Reference Understandingcited by 10
- 2021Estimating Image Depth in the Comics Domaincited by 8
- 2023Metrically Scaled Monocular Depth Estimation through Sparse Priors for Underwater Robotscited by 8
- 2023FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scenecited by 7
- 2024Depth Awakens: A Depth-perceptual Attention Fusion Network for RGB-D Camouflaged Object Detectioncited by 7
- 2024UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detectioncited by 7
- 2021Deep-Learning-Based Single-Image Height Reconstruction from Very-High-Resolution SAR Intensity Datacited by 6
- 2023S2Net: Accurate Panorama Depth Estimation on Spherical Surfacecited by 6
- 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Imagecited by 6
- 2023Camera-Independent Single Image Depth Estimation from Defocus Blurcited by 5
- 2024Amodal Depth Anything: Amodal Depth Estimation in the Wildcited by 4
- 2024Self-supervised Photographic Image Layout Representation Learningcited by 3
- 2023How to turn your camera into a perfect pinhole modelcited by 2
- 2025FreqPDE: Rethinking Positional Depth Embedding for Multi-View 3D Object Detection Transformerscited by 2
- 2023FLODCAST: Flow and Depth Forecasting via Multimodal Recurrent Architecturescited by 1
- 2024Virtually Enriched NYU Depth V2 Dataset for Monocular Depth Estimation: Do We Need Artificial Augmentation?cited by 1
- 2024FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fieldscited by 1
- 2026Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Trackingcited by 1
- 2023Image Stabilization for Hololens Camera in Remote Collaborationcited by 0
- 2024Depth Estimation Algorithm Based on Transformer-Encoder and Feature Fusioncited by 0
- 2025A Dual-Feature Extractor Framework for Accurate Back Depth and Spine Morphology Estimation from Monocular RGB Imagescited by 0
- 2025Online Video Depth Anything: Temporally-Consistent Depth Prediction with Low Memory Consumptioncited by 0
- 2026Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentationcited by 0
- 2026Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentation16 Jul 2026
- 2026Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking12 Jun 2026
- 2025FreqPDE: Rethinking Positional Depth Embedding for Multi-View 3D Object Detection Transformers17 Oct 2025
- 2025Online Video Depth Anything: Temporally-Consistent Depth Prediction with Low Memory Consumption10 Oct 2025
- 2025A Dual-Feature Extractor Framework for Accurate Back Depth and Spine Morphology Estimation from Monocular RGB Images30 Jul 2025
- 2025Ovis-U1 Technical Report29 Jun 2025
- 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Image16 Apr 2025
- 2024DepthLab: From Partial to Complete24 Dec 2024
- 2024Amodal Depth Anything: Amodal Depth Estimation in the Wild3 Dec 2024
- 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modeling2 Sep 2024
- 2024FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fields3 Aug 2024
- 2024UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detection7 Jun 2024
23 more
- 2024Depth Awakens: A Depth-perceptual Attention Fusion Network for RGB-D Camouflaged Object Detection9 May 2024
- 2024Virtually Enriched NYU Depth V2 Dataset for Monocular Depth Estimation: Do We Need Artificial Augmentation?15 Apr 2024
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single View4 Apr 2024
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matching20 Mar 2024
- 2024Self-supervised Photographic Image Layout Representation Learning6 Mar 2024
- 2024Depth Estimation Algorithm Based on Transformer-Encoder and Feature Fusion3 Mar 2024
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shot22 Feb 2024
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images22 Nov 2023
- 2023Camera-Independent Single Image Depth Estimation from Defocus Blur21 Nov 2023
- 2023FLODCAST: Flow and Depth Forecasting via Multimodal Recurrent Architectures31 Oct 2023
- 2023Metrically Scaled Monocular Depth Estimation through Sparse Priors for Underwater Robots25 Oct 2023
- 2023How to turn your camera into a perfect pinhole model20 Sep 2023
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Driving12 Sep 2023
- 2023Spatial and Visual Perspective-Taking via View Rotation and Relation Reasoning for Embodied Reference Understanding3 Sep 2023
- 2023FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scene27 Jul 2023
- 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospects12 May 2023
- 2023Image Stabilization for Hololens Camera in Remote Collaboration5 Apr 2023
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depth23 Feb 2023
- 2023S2Net: Accurate Panorama Depth Estimation on Spherical Surface14 Jan 2023
- 2022K-Radar: 4D Radar Object Detection for Autonomous Driving in Various Weather Conditions16 Jun 2022
- 2021Visual and Object Geo-localization: A Comprehensive Survey30 Dec 2021
- 2021Deep-Learning-Based Single-Image Height Reconstruction from Very-High-Resolution SAR Intensity Data3 Nov 2021
- 2021Estimating Image Depth in the Comics Domain7 Oct 2021
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matching20 Mar 2024
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2022K-Radar: 4D Radar Object Detection for Autonomous Driving in Various Weather Conditionscited by 107
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
- 2025Ovis-U1 Technical Reportcited by 65
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
- 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospectscited by 30
- 2024DepthLab: From Partial to Completecited by 27
- 2021Visual and Object Geo-localization: A Comprehensive Surveycited by 13
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 13
- 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modelingcited by 12
- 2023Spatial and Visual Perspective-Taking via View Rotation and Relation Reasoning for Embodied Reference Understandingcited by 10
12 most cited of 33 All 33 (JSON)
- 2026Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking12 Jun 2026
- 2025FreqPDE: Rethinking Positional Depth Embedding for Multi-View 3D Object Detection Transformers17 Oct 2025
- 2025Online Video Depth Anything: Temporally-Consistent Depth Prediction with Low Memory Consumption10 Oct 2025
- 2025A Dual-Feature Extractor Framework for Accurate Back Depth and Spine Morphology Estimation from Monocular RGB Images30 Jul 2025
- 2025Ovis-U1 Technical Report29 Jun 2025
- 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Image16 Apr 2025
- 2024DepthLab: From Partial to Complete24 Dec 2024
- 2024Amodal Depth Anything: Amodal Depth Estimation in the Wild3 Dec 2024
- 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modeling2 Sep 2024
- 2024FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fields3 Aug 2024
- 2024UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detection7 Jun 2024
- 2024Depth Awakens: A Depth-perceptual Attention Fusion Network for RGB-D Camouflaged Object Detection9 May 2024
12 newest of 33 All 33 (JSON)