mlsanityData to 14 Oct 2026

RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflection

arXiv 2507.07733 ↗First posted 10 Jul 2025cs.GR cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting (3DGS) has demonstrated impressive capabilities in novel view synthesis. However, rendering reflective objects remains a significant challenge, particularly in inverse rendering and relighting. We introduce RTR-GS, a novel inverse rendering framework capable of robustly rendering objects with arbitrary reflectance properties, decomposing BRDF and lighting, and delivering credible relighting results. Given a collection of multi-view images, our method effectively recovers geometric structure through a hybrid rendering model that combines forward rendering for radiance transfer with deferred rendering for reflections. This approach successfully separates high-frequency and low-frequency appearances, mitigating floating artifacts caused by spherical harmonic overfitting when handling high-frequency details. We further refine BRDF and lighting decomposition using an additional physically-based deferred rendering branch. Experimental results show that our method enhances novel view synthesis, normal estimation, decomposition, and relighting while maintaining efficient training inference process.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 40 of its 66 references that are in the map. First posted on arXiv 10 Jul 2025.

Builds on

40 of 66 references.

References · 40

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  7. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  8. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  9. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  10. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  11. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  12. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
28 more
  1. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
  2. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
  3. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
  4. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  5. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
  6. 2021NeRV: Neural Representations for Videoscited by 256
  7. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 252
  8. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 205
  9. 2022Modeling Indirect Illumination for Inverse Renderingcited by 168
  10. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  11. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  12. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 142
  13. 2024Recent Advances in 3D Gaussian Splattingcited by 131
  14. 2022NeILF: Neural Incident Light Field for Physically-based Material Estimationcited by 105
  15. 2020Deep Reflectance Volumes: Relightable Reconstructions from Multi-View Photometric Imagescited by 98
  16. 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 74
  17. 2020Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Imagescited by 65
  18. 20243D Gaussian Splatting with Deferred Reflectioncited by 63
  19. 2019Inverse Path Tracing for Joint Material and Lighting Estimationcited by 62
  20. 2023Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmarkcited by 51
  21. 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 41
  22. 2024TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstructioncited by 26
  23. 2023SIRe-IR: Inverse Rendering for BRDF Reconstruction with Shadow and Illumination Removal in High-Illuminance Scenescited by 19
  24. 2024PRTGS: Precomputed Radiance Transfer of Gaussian Splats for Real-Time High-Quality Relightingcited by 18
  25. 2024GUS-IR: Gaussian Splatting with Unified Shading for Inverse Renderingcited by 11
  26. 20243D Gaussian Editing with A Single Imagecited by 8
  27. 2024Progressive Radiance Distillation for Inverse Rendering with Gaussian Splattingcited by 5
  28. 2024Phys3DGS: Physically-based 3D Gaussian Splatting for Inverse Renderingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 9.

10 papers.

  1. 2026LuxRemix: Lighting Decomposition and Remixing for Indoor Scenescited by 9
  2. 2026ViewSplat: View-Adaptive 3D Gaussian Splatting for Feed-Forward Synthesiscited by 2
  3. 2026TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Renderingcited by 1
  4. 2025GS-2M: Material-aware Gaussian Splatting for High-fidelity Mesh Reconstructioncited by 0
  5. 2026SSR-GS: Separating Specular Reflection in Gaussian Splatting for Glossy Surface Reconstructioncited by 0
  6. 20263DSS: 3D Surface Splatting for Inverse Renderingcited by 0
  7. 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructionscited by 0
  8. 2026From Sparse and Imperfect 2D Anchors to Consistent 3D Gaussian Street Scenes: Support-Aware Appearancecited by 0
  9. 2026STARS-GS: Structure-Aware Regularized Gaussian Splatting for Large-Scale Aerial Surface Reconstructioncited by 0
  10. 2026Casual Flash Lighting for Gaussian Splat Inverse Renderingcited by 0