Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
This paper addresses the problem of depth estimation from a single still image. Inspired by recent works on multi- scale convolutional neural networks (CNN), we propose a deep model which fuses complementary information derived from multiple CNN side outputs. Different from previous methods, the integration is obtained by means of continuous Conditional Random Fields (CRFs). In particular, we propose two different variations, one based on a cascade of multiple CRFs, the other on a unified graphical model. By designing a novel CNN implementation of mean-field updates for continuous CRFs, we show that both proposed models can be regarded as sequential deep networks and that training can be performed end-to-end. Through extensive experimental evaluation we demonstrate the effective- ness of the proposed approach and establish new state of the art results on publicly available datasets.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 16; 2023: 13; 2024: 11; 2025: 2; 2026: 2.
70 papers.
Sort:
By area:
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimationcited by 100
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2023LDM3D: Latent Diffusion Model for 3Dcited by 53
- 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
- 2021MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutionscited by 43
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2021HCRF-Flow: Scene Flow from Point Clouds with Continuous High-order CRFs and Position-aware Flow Embeddingcited by 36
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2021SOSD-Net: Joint Semantic Object Segmentation and Depth Estimation from Monocular imagescited by 33
- 2021Learning to Relate Depth and Semantics for Unsupervised Domain Adaptationcited by 32
38 more
- 2024Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Drivingcited by 30
- 2022DELTAR: Depth Estimation from a Light-weight ToF Sensor and RGB Imagecited by 26
- 2021S2R-DepthNet: Learning a Generalizable Depth-specific Structural Representationcited by 23
- 2023DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 20
- 2021Generalizing to the Open World: Deep Visual Odometry with Online Adaptationcited by 19
- 2022Depth Map Decomposition for Monocular Depth Estimationcited by 16
- 2022Continual Attentive Fusion for Incremental Learning in Semantic Segmentationcited by 15
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimationcited by 15
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Surveycited by 15
- 2023Single Image Depth Prediction Made Better: A Multivariate Gaussian Takecited by 14
- 2024Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Imagescited by 14
- 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videoscited by 14
- 2021PLNet: Plane and Line Priors for Unsupervised Indoor Depth Estimationcited by 12
- 2022AR-NeRF: Unsupervised Learning of Depth and Defocus Effects from Natural Images with Aperture Rendering Neural Radiance Fieldscited by 12
- 2024Quantifying Task Priority for Multi-Task Optimizationcited by 10
- 2021EdgeConv with Attention Module for Monocular Depth Estimationcited by 9
- 2022GeoFill: Reference-Based Image Inpainting with Better Geometric Understandingcited by 9
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planningcited by 9
- 2023WS-SfMLearner: Self-supervised Monocular Depth and Ego-motion Estimation on Surgical Videos with Unknown Camera Parameterscited by 9
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokenscited by 9
- 2021Probabilistic Graph Attention Network with Conditional Kernels for Pixel-Wise Predictioncited by 8
- 2021Boundary-induced and scene-aggregated network for monocular depth predictioncited by 8
- 2023Contrastive Multi-Task Dense Predictioncited by 8
- 2021Self-supervised Depth Estimation Leveraging Global Perception and Geometric Smoothness Using On-board Videoscited by 7
- 2022Vision-Based Environmental Perception for Autonomous Drivingcited by 7
- 2023Deeper into Self-Supervised Monocular Indoor Depth Estimationcited by 7
- 2024Self-supervised Monocular Depth Estimation on Water Scenes via Specular Reflection Priorcited by 7
- 2022Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimationcited by 6
- 2024Masked Spatial Propagation Network for Sparsity-Adaptive Depth Refinementcited by 5
- 2021Unsupervised Learning of Depth and Depth-of-Field Effect from Natural Images with Aperture Rendering Generative Adversarial Networkscited by 4
- 2021Unsupervised Monocular Depth Perception: Focusing on Moving Objectscited by 4
- 2022UAMD-Net: A Unified Adaptive Multimodal Neural Network for Dense Depth Completioncited by 4
- 2022Beyond Visual Field of View: Perceiving 3D Environment with Echoes and Visioncited by 4
- 2023Depth Estimation from a Single Optical Encoded Image using a Learned Colored-Coded Aperturecited by 3
- 2024Large Language Models Can Understanding Depth from Monocular Imagescited by 3
- 2021Variational Structured Attention Networks for Deep Visual Representation Learningcited by 2
- 2021A Novel 3D-UNet Deep Learning Framework Based on High-Dimensional Bilateral Grid for Edge Consistent Single Image Depth Estimationcited by 2
- 2021CI-Net: Contextual Information for Joint Semantic Segmentation and Depth Estimationcited by 2
50 most cited of 70 All 70 (JSON)
- 2026Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth17 Jul 2026
- 2026Depth from Defocus via Direct Optimization18 Feb 2026
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025Depth as Points: Center Point-based Depth Estimation26 Apr 2025
- 2024MetricDepth: Enhancing Monocular Depth Estimation with Deep Metric Learning29 Dec 2024
- 2024Large Language Models Can Understanding Depth from Monocular Images2 Sep 2024
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Survey28 Jun 2024
- 2024Quantifying Task Priority for Multi-Task Optimization5 Jun 2024
- 2024Masked Spatial Propagation Network for Sparsity-Adaptive Depth Refinement30 Apr 2024
- 2024Self-supervised Monocular Depth Estimation on Water Scenes via Specular Reflection Prior10 Apr 2024
- 2024MaGRITTe: Manipulative and Generative 3D Realization from Image, Topview and Text30 Mar 2024
- 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videos26 Mar 2024
38 more
- 2024Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving12 Mar 2024
- 2024Depth Estimation Algorithm Based on Transformer-Encoder and Feature Fusion3 Mar 2024
- 2024Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Images8 Feb 2024
- 2023Deeper into Self-Supervised Monocular Indoor Depth Estimation3 Dec 2023
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimation15 Oct 2023
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation26 Sep 2023
- 2023Depth Estimation from a Single Optical Encoded Image using a Learned Colored-Coded Aperture14 Sep 2023
- 2023WS-SfMLearner: Self-supervised Monocular Depth and Ego-motion Estimation on Surgical Videos with Unknown Camera Parameters22 Aug 2023
- 2023Contrastive Multi-Task Dense Prediction16 Jul 2023
- 2023Self-supervised Multi-task Learning Framework for Safety and Health-Oriented Connected Driving Environment Perception using Onboard Camera20 Jun 2023
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planning3 Jun 2023
- 2023LDM3D: Latent Diffusion Model for 3D18 May 2023
- 2023DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generation10 May 2023
- 20233 Dimensional Dense Reconstruction: A Review of Algorithms and Dataset19 Apr 2023
- 2023Single Image Depth Prediction Made Better: A Multivariate Gaussian Take31 Mar 2023
- 2023Versatile Depth Estimator Based on Common Relative Depth Estimation and Camera-Specific Relative-to-Metric Depth Conversion20 Mar 2023
- 2022Vision-Based Environmental Perception for Autonomous Driving22 Dec 2022
- 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimation23 Nov 2022
- 2022LightDepth: A Resource Efficient Depth Estimation Approach for Dealing with Ground Truth Sparsity via Curriculum Learning16 Nov 2022
- 2022Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Image24 Oct 2022
- 2022DELTAR: Depth Estimation from a Light-weight ToF Sensor and RGB Image27 Sep 2022
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimation7 Sep 2022
- 2022Depth Map Decomposition for Monocular Depth Estimation23 Aug 2022
- 2022Beyond Visual Field of View: Perceiving 3D Environment with Echoes and Vision3 Jul 2022
- 2022MEStereo-Du2CNN: A Novel Dual Channel CNN for Learning Robust Depth Estimates from Multi-exposure Stereo Images for HDR 3D Applications21 Jun 2022
- 2022AR-NeRF: Unsupervised Learning of Depth and Defocus Effects from Natural Images with Aperture Rendering Neural Radiance Fields13 Jun 2022
- 2022UAMD-Net: A Unified Adaptive Multimodal Neural Network for Dense Depth Completion16 Apr 2022
- 2022Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimation5 Apr 2022
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributions28 Mar 2022
- 2022Joint Learning of Frequency and Spatial Domains for Dense Predictions18 Feb 2022
- 2022Continual Attentive Fusion for Incremental Learning in Semantic Segmentation1 Feb 2022
- 2022GeoFill: Reference-Based Image Inpainting with Better Geometric Understanding20 Jan 2022
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescue15 Dec 2021
- 2021Sparse Depth Completion with Semantic Mesh Deformation Optimization10 Dec 2021
- 2021Object-aware Monocular Depth Prediction with Instance Convolutions2 Dec 2021
- 2021Pseudo Supervised Monocular Depth Estimation with Teacher-Student Network22 Oct 2021
- 2021Monocular Depth Estimation with Sharp Boundary12 Oct 2021
- 2021PLNet: Plane and Line Priors for Unsupervised Indoor Depth Estimation12 Oct 2021
50 newest of 70 All 70 (JSON)
- 2023LDM3D: Latent Diffusion Model for 3Dcited by 53
- 2023LDM3D: Latent Diffusion Model for 3D18 May 2023
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimationcited by 100
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
- 2021MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutionscited by 43
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2021HCRF-Flow: Scene Flow from Point Clouds with Continuous High-order CRFs and Position-aware Flow Embeddingcited by 36
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2021SOSD-Net: Joint Semantic Object Segmentation and Depth Estimation from Monocular imagescited by 33
- 2021Learning to Relate Depth and Semantics for Unsupervised Domain Adaptationcited by 32
- 2024Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Drivingcited by 30
12 most cited of 69 All 69 (JSON)
- 2026Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth17 Jul 2026
- 2026Depth from Defocus via Direct Optimization18 Feb 2026
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025Depth as Points: Center Point-based Depth Estimation26 Apr 2025
- 2024MetricDepth: Enhancing Monocular Depth Estimation with Deep Metric Learning29 Dec 2024
- 2024Large Language Models Can Understanding Depth from Monocular Images2 Sep 2024
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Survey28 Jun 2024
- 2024Quantifying Task Priority for Multi-Task Optimization5 Jun 2024
- 2024Masked Spatial Propagation Network for Sparsity-Adaptive Depth Refinement30 Apr 2024
- 2024Self-supervised Monocular Depth Estimation on Water Scenes via Specular Reflection Prior10 Apr 2024
- 2024MaGRITTe: Manipulative and Generative 3D Realization from Image, Topview and Text30 Mar 2024
- 2024Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videos26 Mar 2024
12 newest of 69 All 69 (JSON)