Depth-Consistent 3D Gaussian Splatting via Physical Defocus Modeling and Multi-View Geometric Supervision
Not on the map. Why?
Abstract (arXiv)
Three-dimensional reconstruction in scenes with extreme depth variations remains challenging due to inconsistent supervisory signals between near-field and far-field regions. Existing methods fail to simultaneously address inaccurate depth estimation in distant areas and structural degradation in close-range regions. This paper proposes a novel computational framework that integrates depth-of-field supervision and multi-view consistency supervision to advance 3D Gaussian Splatting. Our approach comprises two core components: (1) Depth-of-field Supervision employs a scale-recovered monocular depth estimator (e.g., Metric3D) to generate depth priors, leverages defocus convolution to synthesize physically accurate defocused images, and enforces geometric consistency through a novel depth-of-field loss, thereby enhancing depth fidelity in both far-field and near-field regions; (2) Multi-View Consistency Supervision employing LoFTR-based semi-dense feature matching to minimize cross-view geometric errors and enforce depth consistency via least squares optimization of reliable matched points. By unifying defocus physics with multi-view geometric constraints, our method achieves superior depth fidelity, demonstrating a 0.8 dB PSNR improvement over the state-of-the-art method on the Waymo Open Dataset. This framework bridges physical imaging principles and learning-based depth regularization, offering a scalable solution for complex depth stratification in urban environments.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 46 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
35 of 46 references.
References · 35
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
23 more
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
- 2017Learning a Multi-View Stereo Machinecited by 194
- 2023EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingScited by 191
- 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 190
- 2021Deblur-NeRF: Neural Radiance Fields from Blurry Imagescited by 179
- 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
- 2017SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsiscited by 128
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
- 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
- 2024StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Renderingcited by 107
- 2019Multi-Scale Geometric Consistency Guided Multi-View Stereocited by 105
- 2022DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priorscited by 70
- 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
- 2019SelfVIO: Self-Supervised Deep Monocular Visual-Inertial Odometry and Depth Estimationcited by 23
- 2023CVRecon: Rethinking 3D Geometric Feature Learning For Neural Reconstructioncited by 16
- 2022AR-NeRF: Unsupervised Learning of Depth and Defocus Effects from Natural Images with Aperture Rendering Neural Radiance Fieldscited by 12
- 2024Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Fieldcited by 12
- 2024SS3DM: Benchmarking Street-View Surface Reconstruction with a Synthetic 3D Mesh Datasetcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.