Enforcing geometric constraints of virtual normal for depth prediction
Not on the map. Why?
Abstract (arXiv)
Monocular depth prediction plays a crucial role in understanding 3D scene geometry. Although recent methods have achieved impressive progress in evaluation metrics such as the pixel-wise relative error, most methods neglect the geometric constraints in the 3D space. In this work, we show the importance of the high-order 3D geometric constraints for depth prediction. By designing a loss term that enforces one simple type of geometric constraints, namely, virtual normal directions determined by randomly sampled three points in the reconstructed 3D space, we can considerably improve the depth prediction accuracy. Significantly, the byproduct of this predicted depth being sufficiently accurate is that we are now able to recover good 3D structures of the scene such as the point cloud and surface normal directly from the depth, eliminating the necessity of training new sub-models as was previously done. Experiments on two benchmarks: NYU Depth-V2 and KITTI demonstrate the effectiveness of our method and state-of-the-art performance.
Key facts. Cited by 233 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 57; 2022: 57; 2023: 45; 2024: 40; 2025: 21; 2026: 13.
233 papers.
Sort:
By area:
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
38 more
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 116
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
- 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2022Attention Attention Everywhere: Monocular Depth Prediction with Skip Attentioncited by 92
- 2023Monocular Depth Estimation using Diffusion Modelscited by 87
- 2022SimpleRecon: 3D Reconstruction Without 3D Convolutionscited by 83
- 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
- 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 81
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 71
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2021Ground-aware Monocular 3D Object Detection for Autonomous Drivingcited by 65
- 2022Multi-Frame Self-Supervised Depth with Transformerscited by 64
- 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
- 2021Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Darkcited by 57
- 2024AffordanceLLM: Grounding Affordance from Vision Language Modelscited by 55
- 2023VA-DepthNet: A Variational Approach to Single Image Depth Predictioncited by 54
- 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimationcited by 53
- 2023All in Tokens: Unifying Output Space of Visual Tasks via Soft Tokencited by 52
- 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 51
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 50
- 2024VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstructioncited by 50
- 2021Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Predictioncited by 48
- 2021Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometrycited by 46
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimationcited by 45
- 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
- 2021MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutionscited by 43
- 2021Toward Practical Monocular Indoor Depth Estimationcited by 42
- 2022Towards Accurate Reconstruction of 3D Scene Shape from A Single Monocular Imagecited by 42
- 2021Sparse Auxiliary Networks for Unified Monocular Depth Prediction and Completioncited by 39
- 2021Deep Two-View Structure-from-Motion Revisitedcited by 39
- 2021MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 38
- 2021Pano3D: A Holistic Benchmark and a Solid Baseline for 360o Depth Estimationcited by 37
- 2021StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimationcited by 36
- 2022RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimationcited by 36
- 2023Improving Depth Gradient Continuity in Transformers: A Comparative Study on Monocular Depth Estimation with CNNcited by 35
50 most cited of 233 All 233 (JSON)
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention31 Aug 2026
- 2026From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation28 Aug 2026
- 2026Repurposing RGB-based Foundation Model for Depth Estimation on Thermal Images Using Hierarchical Supervision12 Aug 2026
- 2026SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry19 Jun 2026
- 2026Towards Consistent Video Geometry Estimation28 May 2026
- 2026SeeGroup: Multi-Layer Depth Estimation of Transparent Surfaces via Self-Determined Grouping27 May 2026
- 2026Improved monocular depth prediction using distance transform over pre-semantic contours with self-supervised neural networks8 May 2026
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction3 Apr 2026
- 2026PAS3R: Pose-Adaptive Streaming 3D Reconstruction for Long Video Sequences22 Mar 2026
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Driving22 Mar 2026
- 2026LiDAR Prompted Spatio-Temporal Multi-View Stereo for Autonomous Driving4 Mar 2026
- 2026SHED Light on Segmentation for Dense Prediction30 Jan 2026
38 more
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources29 Jan 2026
- 2025ReDepth Anything: Test-Time Depth Refinement via Self-Supervised Re-lighting19 Dec 2025
- 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimation10 Oct 2025
- 2025TRIDE: A Text-assisted Radar-Image weather-aware fusion network for Depth Estimation11 Aug 2025
- 2025Reprojection-Guided 3D Gaussian Splatting Diffusion for Weakly Supervised Single-Image Normal Estimation8 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025Monocular Depth Estimation with Global-Aware Discretization and Local Context Modeling5 Aug 2025
- 2025DepthDark: Robust Monocular Depth Estimation for Low-Light Environments24 Jul 2025
- 2025Region-aware Depth Scale Adaptation with Sparse Measurements20 Jul 2025
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Details3 Jul 2025
- 2025HRGS: Hierarchical Gaussian Splatting for Memory-Efficient High-Resolution 3D Reconstruction17 Jun 2025
- 2025Vision-based Lifting of 2D Object Detections for Automated Driving13 Jun 2025
- 2025Aerial Multi-View Stereo via Adaptive Depth Range Inference and Normal Cues6 Jun 2025
- 2025Structure-Aware Radar-Camera Depth Estimation5 Jun 2025
- 2025M3Depth: Wavelet-Enhanced Depth Estimation on Mars via Mutual Boosting of Dual-Modal Data20 May 2025
- 2025LMDepth: Lightweight Mamba-based Monocular Depth Estimation for Real-World Deployment2 May 2025
- 2025MP-Mat: A 3D-and-Instance-Aware Human Matting and Editing Framework with Multiplane Representation20 Apr 2025
- 2025Vision-Language Embodiment for Monocular Depth Estimation18 Mar 2025
- 2025Niagara: Normal-Integrated Geometric Affine Field for Scene Reconstruction from a Single View16 Mar 2025
- 2025PromptMono: Cross Prompting Attention for Self-Supervised Monocular Depth Estimation in Challenging Environments23 Jan 2025
- 2025MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priors15 Jan 2025
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation5 Jan 2025
- 2024Buffer Anytime: Zero-Shot Video Depth and Normal from Image Priors26 Nov 2024
- 2024PMPNet: Pixel Movement Prediction Network for Monocular Depth Estimation in Dynamic Scenes4 Nov 2024
- 2024Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving31 Oct 2024
- 2024DCDepth: Progressive Monocular Depth Estimation in Discrete Cosine Domain19 Oct 2024
- 2024A Practical Approach to Underwater Depth and Surface Normals Estimation2 Oct 2024
- 2024Optical Lens Attack on Deep Learning Based Monocular Depth Estimation25 Sep 2024
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage13 Sep 2024
- 2024Boosting Generalizability towards Zero-Shot Cross-Dataset Single-Image Indoor Depth by Meta-Initialization4 Sep 2024
- 2024InSpaceType: Dataset and Benchmark for Reconsidering Cross-Space Type Performance in Indoor Monocular Depth25 Aug 2024
- 2024Floating No More: Object-Ground Reconstruction from a Single Image26 Jul 2024
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions23 Jul 2024
- 2024GroundUp: Rapid Sketch-Based 3D City Massing17 Jul 2024
- 2024ProDepth: Boosting Self-Supervised Multi-Frame Monocular Depth with Probabilistic Fusion12 Jul 2024
- 2024ScaleDepth: Decomposing Metric Depth Estimation into Scale Prediction and Relative Depth Estimation11 Jul 2024
- 2024SCIPaD: Incorporating Spatial Clues into Unsupervised Pose-Depth Joint Learning7 Jul 2024
- 2024Depth Anything V213 Jun 2024
50 newest of 233 All 233 (JSON)
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2023Monocular Depth Estimation using Diffusion Modelscited by 87
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 29
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translationcited by 24
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimationcited by 18
- 2023MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Modelcited by 12
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimagecited by 11
- 2024Implicit and Explicit Language Guidance for Diffusion-based Visual Perceptioncited by 3
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation5 Jan 2025
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage13 Sep 2024
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions23 Jul 2024
- 2024Implicit and Explicit Language Guidance for Diffusion-based Visual Perception11 Apr 2024
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image18 Mar 2024
- 2023MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Model13 Nov 2023
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimators5 Oct 2023
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translation26 Aug 2023
- 2023DDP: Diffusion Model for Dense Visual Prediction30 Mar 2023
- 2023Monocular Depth Estimation using Diffusion Models28 Feb 2023
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
12 most cited of 220 All 220 (JSON)
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention31 Aug 2026
- 2026From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation28 Aug 2026
- 2026Repurposing RGB-based Foundation Model for Depth Estimation on Thermal Images Using Hierarchical Supervision12 Aug 2026
- 2026SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry19 Jun 2026
- 2026Towards Consistent Video Geometry Estimation28 May 2026
- 2026SeeGroup: Multi-Layer Depth Estimation of Transparent Surfaces via Self-Determined Grouping27 May 2026
- 2026Improved monocular depth prediction using distance transform over pre-semantic contours with self-supervised neural networks8 May 2026
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction3 Apr 2026
- 2026PAS3R: Pose-Adaptive Streaming 3D Reconstruction for Long Video Sequences22 Mar 2026
- 2026LiDAR Prompted Spatio-Temporal Multi-View Stereo for Autonomous Driving4 Mar 2026
- 2026SHED Light on Segmentation for Dense Prediction30 Jan 2026
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources29 Jan 2026
12 newest of 220 All 220 (JSON)