In Depth We Trust: Reliable Monocular Depth Supervision for Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Using accurate depth priors in 3D Gaussian Splatting helps mitigate artifacts caused by sparse training data and textureless surfaces. However, acquiring accurate depth maps requires specialized acquisition systems. Foundation monocular depth estimation models offer a cost-effective alternative, but they suffer from scale ambiguity, multi-view inconsistency, and local geometric inaccuracies, which can degrade rendering performance when applied naively. This paper addresses the challenge of reliably leveraging monocular depth priors for Gaussian Splatting (GS) rendering enhancement. To this end, we introduce a training framework integrating scale-ambiguous and noisy depth priors into geometric supervision. We highlight the importance of learning from weakly aligned depth variations. We introduce a method to isolate ill-posed geometry for selective monocular depth regularization, restricting the propagation of depth inaccuracies into well-reconstructed 3D structures. Extensive experiments across diverse datasets show consistent improvements in geometric accuracy, leading to more faithful depth estimation and higher rendering quality across different GS variants and monocular depth backbones tested.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 49 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
41 of 49 references.
References · 41
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
29 more
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 216
- 2016Single-Image Depth Perception in the Wildcited by 180
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 101
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
- 2019CAM-Convs: Camera-Aware Multi-Scale Convolutions for Single-View Depthcited by 75
- 2021TermiNeRF: Ray Termination Prediction for Efficient Neural Renderingcited by 70
- 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 61
- 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
- 2023NeRF-Supervised Deep Stereocited by 46
- 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splattingcited by 18
- 2023Perceptual Quality Assessment of NeRF and Neural View Synthesis Methods for Front-Facing Viewscited by 17
- 2024Self-Evolving Depth-Supervised 3D Gaussian Splatting from Rendered Stereo Pairscited by 11
- 2025GS-2DGS: Geometrically Supervised 2DGS for Reflective Object Reconstructioncited by 11
- 2025DCHM: Depth-Consistent Human Modeling for Multiview Detectioncited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.