mlsanityData to 7 Oct 2026

Depth-Consistent 3D Gaussian Splatting via Physical Defocus Modeling and Multi-View Geometric Supervision

arXiv 2511.10316 ↗First posted 13 Nov 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Three-dimensional reconstruction in scenes with extreme depth variations remains challenging due to inconsistent supervisory signals between near-field and far-field regions. Existing methods fail to simultaneously address inaccurate depth estimation in distant areas and structural degradation in close-range regions. This paper proposes a novel computational framework that integrates depth-of-field supervision and multi-view consistency supervision to advance 3D Gaussian Splatting. Our approach comprises two core components: (1) Depth-of-field Supervision employs a scale-recovered monocular depth estimator (e.g., Metric3D) to generate depth priors, leverages defocus convolution to synthesize physically accurate defocused images, and enforces geometric consistency through a novel depth-of-field loss, thereby enhancing depth fidelity in both far-field and near-field regions; (2) Multi-View Consistency Supervision employing LoFTR-based semi-dense feature matching to minimize cross-view geometric errors and enforce depth consistency via least squares optimization of reliable matched points. By unifying defocus physics with multi-view geometric constraints, our method achieves superior depth fidelity, demonstrating a 0.8 dB PSNR improvement over the state-of-the-art method on the Waymo Open Dataset. This framework bridges physical imaging principles and learning-based depth regularization, offering a scalable solution for complex depth stratification in urban environments.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 46 references that are in the map. First posted on arXiv 13 Nov 2025.

Builds on

35 of 46 references.

References · 35

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  7. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  8. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  9. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  10. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  11. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  12. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
23 more
  1. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
  2. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  3. 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
  4. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  5. 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
  6. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
  7. 2017Learning a Multi-View Stereo Machinecited by 194
  8. 2023EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingScited by 191
  9. 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 190
  10. 2021Deblur-NeRF: Neural Radiance Fields from Blurry Imagescited by 179
  11. 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
  12. 2017SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsiscited by 128
  13. 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
  14. 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
  15. 2024StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Renderingcited by 107
  16. 2019Multi-Scale Geometric Consistency Guided Multi-View Stereocited by 105
  17. 2022DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priorscited by 70
  18. 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
  19. 2019SelfVIO: Self-Supervised Deep Monocular Visual-Inertial Odometry and Depth Estimationcited by 23
  20. 2023CVRecon: Rethinking 3D Geometric Feature Learning For Neural Reconstructioncited by 16
  21. 2022AR-NeRF: Unsupervised Learning of Depth and Defocus Effects from Natural Images with Aperture Rendering Neural Radiance Fieldscited by 12
  22. 2024Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Fieldcited by 12
  23. 2024SS3DM: Benchmarking Street-View Surface Reconstruction with a Synthetic 3D Mesh Datasetcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.