Adaptive Surface Normal Constraint for Depth Estimation
Not on the map. Why?
Abstract (arXiv)
We present a novel method for single image depth estimation using surface normal constraints. Existing depth estimation methods either suffer from the lack of geometric constraints, or are limited to the difficulty of reliably capturing geometric context, which leads to a bottleneck of depth estimation quality. We therefore introduce a simple yet effective method, named Adaptive Surface Normal (ASN) constraint, to effectively correlate the depth estimation with geometric consistency. Our key idea is to adaptively determine the reliable local geometry from a set of randomly sampled candidates to derive surface normal constraint, for which we measure the consistency of the geometric contextual features. As a result, our method can faithfully reconstruct the 3D geometry and is robust to local shape variations, such as boundaries, sharp corners and noises. We conduct extensive evaluations and comparisons using public datasets. The experimental results demonstrate our method outperforms the state-of-the-art methods and has superior efficiency and robustness.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 29 Mar 2021.
Builds on
26 of 49 references.
References · 26
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 234
- 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
- 2015Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fieldscited by 169
14 more
- 2018Revisiting Single Image Depth Estimation: Toward Higher Resolution Maps with Accurate Object Boundariescited by 145
- 2019Pattern-Affinitive Propagation across Depth, Surface Normal and Semantic Segmentationcited by 142
- 2018DeepLiDAR: Deep Surface Normal Guided Depth Prediction for Outdoor Scene from Sparse LiDAR Data and Single Color Imagecited by 129
- 2019Pixel-Adaptive Convolutional Neural Networkscited by 126
- 2019Depth Completion from Sparse LiDAR Data with Depth-Normal Constraintscited by 108
- 2015EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flowcited by 80
- 2017Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimationcited by 70
- 2019DepthTransfer: Depth Extraction from Video Using Non-parametric Samplingcited by 60
- 2014Designing Deep Networks for Surface Normal Estimationcited by 59
- 2019Normal Assisted Stereo Depth Estimationcited by 49
- 2020Occlusion-Aware Depth Estimation with Adaptive Normal Constraintscited by 41
- 2020GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimationcited by 36
- 2018EdgeStereo: A Context Integrated Residual Pyramid Network for Stereo Matchingcited by 32
- 2016Depth from a Single Image by Harmonizing Overcomplete Local Network Predictionscited by 16
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 12; 2024: 11; 2025: 6; 2026: 2.
43 papers.
Sort:
By area:
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 177
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 107
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologiescited by 63
- 2023VA-DepthNet: A Variational Approach to Single Image Depth Predictioncited by 54
- 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimationcited by 54
- 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimationcited by 45
31 more
- 2021Self-supervised Monocular Depth Estimation for All Day Images using Domain Separationcited by 44
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2022IronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertaintycited by 30
- 2023GEDepth: Ground Embedding for Monocular Depth Estimationcited by 26
- 2024OGNI-DC: Robust Depth Completion with Optimization-Guided Neural Iterationscited by 24
- 2023URCDC-Depth: Uncertainty Rectified Cross-Distillation with CutFlip for Monocular Depth Estimationcited by 16
- 2025Vision-Language Embodiment for Monocular Depth Estimationcited by 16
- 2023Single Image Depth Prediction Made Better: A Multivariate Gaussian Takecited by 14
- 2023PolyMaX: General Dense Prediction with Mask Transformercited by 14
- 2024Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Imagescited by 14
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimagecited by 12
- 2024DCDepth: Progressive Monocular Depth Estimation in Discrete Cosine Domaincited by 12
- 2021Facial Depth and Normal Estimation using Single Dual-Pixel Cameracited by 11
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimation and Completioncited by 9
- 2024Embodiment: Self-Supervised Depth Estimation Based on Camera Modelscited by 9
- 2021PlaneRecNet: Multi-Task Learning with Cross-Task Consistency for Piece-Wise Plane Detection and Reconstruction from a Single RGB Imagecited by 8
- 2023Multi-task learning with cross-task consistency for improved depth estimation in colonoscopycited by 8
- 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Imagecited by 8
- 2021Towards Comprehensive Monocular Depth Estimation: Multiple Heads Are Better Than Onecited by 7
- 2022NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstructioncited by 5
- 2024Digging Into Normal Incorporated Stereo Matchingcited by 5
- 20223D endoscopic depth estimation using 3D surface-aware constraintscited by 3
- 2024Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360deg Imagescited by 3
- 2025Propagating Sparse Depth via Depth Foundation Model for Out-of-Distribution Depth Completioncited by 2
- 2025Occlusion Boundary and Depth: Mutual Enhancement via Multi-Task Learningcited by 1
- 2024EDADepth: Enhanced Data Augmentation for Monocular Depth Estimationcited by 0
- 2024MobiFuse: A High-Precision On-device Depth Perception System with Multi-Data Fusioncited by 0
- 2025VGLD: Visually-Guided Linguistic Disambiguation for Monocular Depth Scale Recoverycited by 0
- 2025WEDepth: Efficient Adaptation of World Knowledge for Monocular Depth Estimationcited by 0
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Predictioncited by 0
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimationcited by 0
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation29 Apr 2026
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction3 Apr 2026
- 2025WEDepth: Efficient Adaptation of World Knowledge for Monocular Depth Estimation11 Nov 2025
- 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image3 Nov 2025
- 2025Propagating Sparse Depth via Depth Foundation Model for Out-of-Distribution Depth Completion7 Aug 2025
- 2025Occlusion Boundary and Depth: Mutual Enhancement via Multi-Task Learning27 May 2025
- 2025VGLD: Visually-Guided Linguistic Disambiguation for Monocular Depth Scale Recovery5 May 2025
- 2025Vision-Language Embodiment for Monocular Depth Estimation18 Mar 2025
- 2024MobiFuse: A High-Precision On-device Depth Perception System with Multi-Data Fusion18 Dec 2024
- 2024Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360deg Images4 Nov 2024
- 2024DCDepth: Progressive Monocular Depth Estimation in Discrete Cosine Domain19 Oct 2024
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage13 Sep 2024
31 more
- 2024EDADepth: Enhanced Data Augmentation for Monocular Depth Estimation10 Sep 2024
- 2024Embodiment: Self-Supervised Depth Estimation Based on Camera Models2 Aug 2024
- 2024OGNI-DC: Robust Depth Completion with Optimization-Guided Neural Iterations17 Jun 2024
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimation4 Apr 2024
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation22 Mar 2024
- 2024Digging Into Normal Incorporated Stereo Matching28 Feb 2024
- 2024Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Images8 Feb 2024
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers14 Dec 2023
- 2023Multi-task learning with cross-task consistency for improved depth estimation in colonoscopy30 Nov 2023
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimation and Completion13 Nov 2023
- 2023PolyMaX: General Dense Prediction with Mask Transformer9 Nov 2023
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct 2023
- 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimation25 Sep 2023
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimation19 Sep 2023
- 2023GEDepth: Ground Embedding for Monocular Depth Estimation18 Sep 2023
- 2023iDisc: Internal Discretization for Monocular Depth Estimation13 Apr 2023
- 2023Single Image Depth Prediction Made Better: A Multivariate Gaussian Take31 Mar 2023
- 2023URCDC-Depth: Uncertainty Rectified Cross-Distillation with CutFlip for Monocular Depth Estimation16 Feb 2023
- 2023VA-DepthNet: A Variational Approach to Single Image Depth Prediction13 Feb 2023
- 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies25 Nov 2022
- 2022NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstruction13 Oct 2022
- 2022IronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertainty7 Oct 2022
- 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objects7 Aug 2022
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors27 Jun 2022
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Views12 Jun 2022
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Prior5 Apr 2022
- 20223D endoscopic depth estimation using 3D surface-aware constraints4 Mar 2022
- 2021Facial Depth and Normal Estimation using Single Dual-Pixel Camera25 Nov 2021
- 2021Towards Comprehensive Monocular Depth Estimation: Multiple Heads Are Better Than One16 Nov 2021
- 2021PlaneRecNet: Multi-Task Learning with Cross-Task Consistency for Piece-Wise Plane Detection and Reconstruction from a Single RGB Image21 Oct 2021
- 2021Self-supervised Monocular Depth Estimation for All Day Images using Domain Separation17 Aug 2021
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimagecited by 12
- 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Imagecited by 8
- 2024EDADepth: Enhanced Data Augmentation for Monocular Depth Estimationcited by 0
- 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image3 Nov 2025
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage13 Sep 2024
- 2024EDADepth: Enhanced Data Augmentation for Monocular Depth Estimation10 Sep 2024
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct 2023
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 177
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 107
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologiescited by 63
- 2023VA-DepthNet: A Variational Approach to Single Image Depth Predictioncited by 54
- 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimationcited by 54
- 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimationcited by 45
- 2021Self-supervised Monocular Depth Estimation for All Day Images using Domain Separationcited by 44
12 most cited of 39 All 39 (JSON)
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation29 Apr 2026
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction3 Apr 2026
- 2025WEDepth: Efficient Adaptation of World Knowledge for Monocular Depth Estimation11 Nov 2025
- 2025Propagating Sparse Depth via Depth Foundation Model for Out-of-Distribution Depth Completion7 Aug 2025
- 2025Occlusion Boundary and Depth: Mutual Enhancement via Multi-Task Learning27 May 2025
- 2025VGLD: Visually-Guided Linguistic Disambiguation for Monocular Depth Scale Recovery5 May 2025
- 2025Vision-Language Embodiment for Monocular Depth Estimation18 Mar 2025
- 2024MobiFuse: A High-Precision On-device Depth Perception System with Multi-Data Fusion18 Dec 2024
- 2024Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360deg Images4 Nov 2024
- 2024DCDepth: Progressive Monocular Depth Estimation in Discrete Cosine Domain19 Oct 2024
- 2024Embodiment: Self-Supervised Depth Estimation Based on Camera Models2 Aug 2024
- 2024OGNI-DC: Robust Depth Completion with Optimization-Guided Neural Iterations17 Jun 2024
12 newest of 39 All 39 (JSON)