Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a method to optimize Gaussian splatting with a limited number of images while avoiding overfitting. Representing a 3D scene by combining numerous Gaussian splats has yielded outstanding visual quality. However, it tends to overfit the training views when only a small number of images are available. To address this issue, we introduce a dense depth map as a geometry guide to mitigate overfitting. We obtained the depth map using a pre-trained monocular depth estimation model and aligning the scale and offset using sparse COLMAP feature points. The adjusted depth aids in the color-based optimization of 3D Gaussian splatting, mitigating floating artifacts, and ensuring adherence to geometric constraints. We verify the proposed method on the NeRF-LLFF dataset with varying numbers of few images. Our approach demonstrates robust geometry compared to the original method that relies solely on images. Project page: robot0321.github.io/DepthRegGS
Key facts. Cited by 173 papers in the map (data through 14 Oct 2026). Builds on 43 of its 59 references that are in the map. First posted on arXiv 22 Nov 2023.
Builds on
43 of 59 references.
References · 43
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
31 more
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2021Advances in Neural Renderingcited by 365
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
- 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
- 2021Point-Based Neural Rendering with Per-View Optimizationcited by 190
- 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 182
- 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 158
- 2021Real-time Neural Radiance Caching for Path Tracingcited by 91
- 2019Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Eracited by 87
- 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
- 2022Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Cameracited by 57
- 2021Single Image Depth Estimation: An Overviewcited by 35
- 2022DINER: Depth-aware Image-based NEural Radiance fieldscited by 19
- 2023NeRFVS: Neural Radiance Fields for Free View Synthesis via Geometry Scaffoldscited by 16
- 2022Mip-NeRF RGB-D: Depth Assisted Fast Neural Radiance Fieldscited by 11
Built on by
Citing papers per year: 2024: 54; 2025: 66; 2026: 53.
173 papers.
Sort:
By area:
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
- 2024Reducing the Memory Footprint of 3D Gaussian Splattingcited by 133
- 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 113
- 20243D Gaussian as a New Era: A Surveycited by 104
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
- 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 75
- 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
- 2024LP-3DGS: Learning to Prune 3D Gaussian Splattingcited by 55
- 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
38 more
- 2024Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splattingcited by 43
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 43
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
- 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 37
- 2025Depth Anything with Any Priorcited by 36
- 2024EndoGS: Deformable Endoscopic Tissues Reconstruction with Gaussian Splattingcited by 33
- 20243D Vision-Language Gaussian Splattingcited by 31
- 2025FatesGS: Fast and Accurate Sparse-View Surface Reconstruction using Gaussian Splatting with Depth-Feature Consistencycited by 31
- 2024OMNI-DC: Highly Robust Depth Completion with Multiresolution Depth Integrationcited by 30
- 2025Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigationcited by 30
- 2025DropoutGS: Dropping Out Gaussians for Better Sparse-view Renderingcited by 29
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2024Lighting Every Darkness with 3DGS: Fast Training and Real-Time Rendering for HDR View Synthesiscited by 27
- 2024A Construct-Optimize Approach to Sparse View Synthesis without Camera Posecited by 25
- 2024Novel View Extrapolation with Video Diffusion Priorscited by 25
- 2025S2Gaussian: Sparse-View Super-Resolution 3D Gaussian Splattingcited by 24
- 2025DroneSplat: 3D Gaussian Splatting for Robust 3D Reconstruction from In-the-Wild Drone Imagerycited by 22
- 2024GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priorscited by 20
- 2024ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splattingscited by 20
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
- 2024Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstructioncited by 19
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splattingcited by 18
- 2024FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Trainingcited by 18
- 2024Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusioncited by 17
- 2026Faster-GS: Analyzing and Improving Gaussian Splatting Optimizationcited by 17
- 2024Touch-GS: Visual-Tactile Supervised 3D Gaussian Splattingcited by 16
- 2024MVG-Splatting: Multi-View Guided Gaussian Splatting with Adaptive Quantile-Based Geometric Consistency Densificationcited by 16
- 2024Robust 3D Gaussian Splatting for Novel View Synthesis in Presence of Distractorscited by 15
- 2025FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstructioncited by 15
- 2025ReSplat: Learning Recurrent Gaussian Splattingcited by 15
- 2025GigaSLAM: Large-Scale Monocular SLAM with Hierarchical Gaussian Splatscited by 14
- 2025Quantifying and Alleviating Co-Adaptation in Sparse-View 3D Gaussian Splattingcited by 14
- 2024ThermalGaussian: Thermal 3D Gaussian Splattingcited by 13
- 2024Extrapolated Urban View Synthesis Benchmarkcited by 13
- 2025Revisiting Depth Representations for Feed-Forward 3D Gaussian Splattingcited by 12
- 2024Self-Evolving Depth-Supervised 3D Gaussian Splatting from Rendered Stereo Pairscited by 11
- 2025Pro3D-Editor : A Progressive-Views Perspective for Consistent and Precise 3D Editingcited by 11
50 most cited of 173 All 173 (JSON)
- 2026Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Rendering28 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026ClearGS: Reliability-Aware Gaussian Splatting from Handheld Videos25 Sep 2026
- 2026TV-SGS: Gaussian Splatting with Geometric Information Propagation via Tensor Voting under sparse views7 Sep 2026
- 2026Filling the Unseen: Scene Extrapolation via 3D Gaussian Splatting6 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026GSPotential: Camera Potential Field for Sparse-View 3D Gaussian Splatting29 Aug 2026
- 2026ReconSplat: Generalizable 3D Scene Reconstruction Beyond Observed Views28 Aug 2026
- 2026GaussianDS: Depth-supervised Semantic Gaussian Splatting for Scene Understanding22 Aug 2026
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors22 Aug 2026
- 2026HiCo-GS: Hierarchical Context Aggregation and Geometric Consistency for Octree Gaussian Splatting14 Aug 2026
- 2026UniqueSplat: View-conditioned 3D Gaussian Splatting for Generalizable 3D Reconstruction3 Aug 2026
38 more
- 2026D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting3 Aug 2026
- 20264DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humans30 Jul 2026
- 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstruction12 Jul 2026
- 2026Depth Estimators Are Implicit Neural Fields for 3D Scene Geometry Inpainting and Reconstruction11 Jul 2026
- 2026Improving Sparse-View 3DGS Generalization via Flat Minima Optimization1 Jul 2026
- 2026Intrinsic decomposition and editing of 3D Gaussian splats30 Jun 2026
- 2026Reliability-Aware Monocular Depth Supervision for Sparse-View Neural Reconstruction27 Jun 2026
- 2026Open-Vocabulary BEV Segmentation with 3D-Aware Geometric Constraints23 Jun 2026
- 2026From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information18 Jun 2026
- 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity17 Jun 2026
- 2026KC-3DGS: Kurtosis-Constrained Gaussian Splatting for High-Fidelity View Synthesis2 Jun 2026
- 2026Supercharging Thermal Gaussian Splatting with Depth Estimation28 May 2026
- 2026F-RNG: Feed-Forward Relightable Neural Gaussians25 May 2026
- 2026TWINGS: Thin Plate Splines Warp-aligned Initialization for Sparse-View Gaussian Splatting21 May 2026
- 2026PairDropGS: Paired Dropout-Induced Consistency Regularization for Sparse-View Gaussian Splatting12 May 2026
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes10 May 2026
- 2026Difix3D-W: Distractor-Free Few-Shot 3D Gaussian Splatting in the Wild30 Apr 2026
- 2026Color-Encoded Illumination for High-Speed Volumetric Scene Reconstruction29 Apr 2026
- 2026EnerGS: Energy-Based Gaussian Splatting with Partial Geometric Priors29 Apr 2026
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenes23 Apr 2026
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction22 Apr 2026
- 2026ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models14 Apr 2026
- 2026GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors13 Apr 2026
- 2026In Depth We Trust: Reliable Monocular Depth Supervision for Gaussian Splatting7 Apr 2026
- 2026Lifting Unlabeled Internet-level Data for 3D Scene Understanding2 Apr 2026
- 2026SGS-Intrinsic: Semantic-Invariant Gaussian Splatting for Sparse-View Indoor Inverse Rendering29 Mar 2026
- 2026Predictive Photometric Uncertainty in Gaussian Splatting for Novel View Synthesis24 Mar 2026
- 2026SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation23 Mar 2026
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis16 Mar 2026
- 2026Ego-1K -- A Large-Scale Multiview Video Dataset for Egocentric Vision14 Mar 2026
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splatting3 Mar 2026
- 2026Multimodal-Prior-Guided Importance Sampling for Hierarchical Gaussian Splatting in Sparse-View Novel View Synthesis3 Mar 2026
- 2026HeroGS: Hierarchical Guidance for Robust 3D Gaussian Splatting under Sparse Views1 Mar 2026
- 2026Pseudo-View Enhancement via Confidence Fusion for Unposed Sparse-View Reconstruction25 Feb 2026
- 2026Monocular Endoscopic Tissue 3D Reconstruction with Multi-Level Geometry Regularization24 Feb 2026
- 2026Variation-aware Flexible 3D Gaussian Editing12 Feb 2026
- 2026Faster-GS: Analyzing and Improving Gaussian Splatting Optimization10 Feb 2026
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Sampling10 Feb 2026
50 newest of 173 All 173 (JSON)
- 2024Novel View Extrapolation with Video Diffusion Priorscited by 25
- 2024GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priorscited by 20
- 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priorscited by 8
- 2024Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priorscited by 7
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillationcited by 3
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splattingcited by 3
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesiscited by 3
- 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelitycited by 1
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priorscited by 1
- 2025OGGSplat: Open Gaussian Growing for Generalizable Reconstruction with Expanded Field-of-Viewcited by 0
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Samplingcited by 0
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenescited by 0
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors22 Aug 2026
- 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity17 Jun 2026
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes10 May 2026
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis16 Mar 2026
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splatting3 Mar 2026
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Sampling10 Feb 2026
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation23 Sep 2025
- 2025OGGSplat: Open Gaussian Growing for Generalizable Reconstruction with Expanded Field-of-View5 Jun 2025
- 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priors24 Nov 2024
- 2024Novel View Extrapolation with Video Diffusion Priors21 Nov 2024
- 2024GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priors14 Jun 2024
- 2024Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priors26 May 2024
- 20243D Vision-Language Gaussian Splattingcited by 31
- 20243D Vision-Language Gaussian Splatting10 Oct 2024
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
- 2024Reducing the Memory Footprint of 3D Gaussian Splattingcited by 133
- 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 113
- 20243D Gaussian as a New Era: A Surveycited by 104
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
- 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 75
- 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
- 2024LP-3DGS: Learning to Prune 3D Gaussian Splattingcited by 55
- 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
12 most cited of 159 All 159 (JSON)
- 2026Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Rendering28 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026ClearGS: Reliability-Aware Gaussian Splatting from Handheld Videos25 Sep 2026
- 2026TV-SGS: Gaussian Splatting with Geometric Information Propagation via Tensor Voting under sparse views7 Sep 2026
- 2026Filling the Unseen: Scene Extrapolation via 3D Gaussian Splatting6 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026GSPotential: Camera Potential Field for Sparse-View 3D Gaussian Splatting29 Aug 2026
- 2026ReconSplat: Generalizable 3D Scene Reconstruction Beyond Observed Views28 Aug 2026
- 2026GaussianDS: Depth-supervised Semantic Gaussian Splatting for Scene Understanding22 Aug 2026
- 2026HiCo-GS: Hierarchical Context Aggregation and Geometric Consistency for Octree Gaussian Splatting14 Aug 2026
- 2026UniqueSplat: View-conditioned 3D Gaussian Splatting for Generalizable 3D Reconstruction3 Aug 2026
- 2026D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting3 Aug 2026
12 newest of 159 All 159 (JSON)