mlsanityData to 14 Oct 2026

Gaussian Splatting with Discretized SDF for Relightable Assets

arXiv 2507.15629 ↗First posted 21 Jul 2025cs.GR cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

3D Gaussian splatting (3DGS) has shown its detailed expressive ability and highly efficient rendering speed in the novel view synthesis (NVS) task. The application to inverse rendering still faces several challenges, as the discrete nature of Gaussian primitives makes it difficult to apply geometry constraints. Recent works introduce the signed distance field (SDF) as an extra continuous representation to regularize the geometry defined by Gaussian primitives. It improves the decomposition quality, at the cost of increasing memory usage and complicating training. Unlike these works, we introduce a discretized SDF to represent the continuous SDF in a discrete manner by encoding it within each Gaussian using a sampled value. This approach allows us to link the SDF with the Gaussian opacity through an SDF-to-opacity transformation, enabling rendering the SDF via splatting and avoiding the computational cost of ray marching.The key challenge is to regularize the discrete samples to be consistent with the underlying SDF, as the discrete representation can hardly apply the gradient-based constraints (eg Eikonal loss). For this, we project Gaussians onto the zero-level set of SDF and enforce alignment with the surface from splatting, namely a projection-based consistency loss. Thanks to the discretized SDF, our method achieves higher relighting quality, while requiring no extra memory beyond GS and avoiding complex manually designed optimization. The experiments reveal that our method outperforms existing Gaussian-based inverse rendering methods. Our code is available at https://github.com/NK-CS-ZZL/DiscretizedSDF.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 38 of its 45 references that are in the map. First posted on arXiv 21 Jul 2025.

Builds on

38 of 45 references.

References · 38

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  4. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  5. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  6. 2018Open3D: A Modern Library for 3D Data Processingcited by 721
  7. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  8. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  9. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  10. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
  11. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
  12. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
26 more
  1. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
  2. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 252
  3. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
  4. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 205
  5. 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
  6. 2022Modeling Indirect Illumination for Inverse Renderingcited by 168
  7. 2023TensoIR: Tensorial Inverse Renderingcited by 168
  8. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  9. 2020Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfacescited by 147
  10. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 142
  11. 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
  12. 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 111
  13. 2023GIR: 3D Gaussian Inverse Rendering for Relightable Scene Factorizationcited by 87
  14. 2024GSDF: 3DGS Meets SDF for Improved Rendering and Reconstructioncited by 83
  15. 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 79
  16. 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 74
  17. 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
  18. 2022Critical Regularizations for Neural Surface Reconstruction in the Wildcited by 52
  19. 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
  20. 2023Neural-PBIR Reconstruction of Shape, Material, and Illuminationcited by 45
  21. 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 41
  22. 2023Neural-Singular-Hessian: Implicit Neural Representation of Unoriented Point Clouds by Enforcing Singular Hessiancited by 35
  23. 2024TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstructioncited by 26
  24. 2024Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fieldscited by 16
  25. 2024TAR3D: Creating High-Quality 3D Assets via Next-Part Predictioncited by 16
  26. 2025AR-1-to-3: Single Image to Consistent 3D Object Generation via Next-View Predictioncited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 11.

13 papers.

Sort:

By area: