Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis
Not on the map. Why?
Abstract (arXiv)
We propose GRGS, a generalizable and relightable 3D Gaussian framework for high-fidelity human novel view synthesis under diverse lighting conditions. Unlike existing methods that rely on per-character optimization or ignore physical constraints, GRGS adopts a feed-forward, fully supervised strategy projecting geometry, material, and illumination cues from multi-view 2D observations into 3D Gaussian representations. To recover accurate geometry under diverse lighting conditions, we introduce a Lighting-robust Geometry Refinement (LGR) module trained on synthetically relit data to predict precise depth and surface normals. Based on the high-quality geometry, a Physically Grounded Neural Rendering (PGNR) module is further proposed to integrate neural prediction with physics-based shading, supporting editable relighting with shadows and indirect illumination. Moreover, we design a 2D-to-3D projection training scheme leveraging differentiable supervision from ambient occlusion, direct, and indirect lighting maps, alleviating the computational cost of ray tracing. Extensive experiments demonstrate that GRGS achieves superior visual quality, geometric consistency, and generalization across characters and lighting conditions.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 43 of its 85 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
43 of 85 references.
References · 43
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
- 2019Neural Point-Based Graphicscited by 327
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 252
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
31 more
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
- 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 205
- 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023TensoIR: Tensorial Inverse Renderingcited by 168
- 2019Single Image Portrait Relightingcited by 152
- 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 142
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
- 2023Relightable Gaussian Codec Avatarscited by 127
- 2022NeILF: Neural Incident Light Field for Physically-based Material Estimationcited by 105
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 74
- 2024SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relightingcited by 67
- 2020Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Imagescited by 65
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 57
- 2024IRGS: Inter-Reflective Gaussian Splatting with 2D Gaussian Ray Tracingcited by 54
- 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
- 2022Relighting4D: Neural Relightable Human from Videoscited by 41
- 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 41
- 2022Geometry-aware Single-image Full-body Human Relightingcited by 34
- 2023Towards Practical Capture of High-Fidelity Relightable Avatarscited by 34
- 2024MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videoscited by 34
- 2021Single-image Full-body Human Relightingcited by 30
- 2023Relightable and Animatable Neural Avatar from Sparse-View Videocited by 28
- 2023Animatable and Relightable Gaussians for High-fidelity Human Avatar Modelingcited by 27
- 2024TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstructioncited by 26
- 2021Relighting Humans in the Wild: Monocular Full-Body Human Relighting with Domain Adaptationcited by 21
- 2023IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracingcited by 20
- 2023Relightable and Animatable Neural Avatars from Videoscited by 13
- 2024Interactive Rendering of Relightable and Animatable Gaussian Avatarscited by 6
- 2025BEAM: Bridging Physically-based Rendering and Gaussian Modeling for Relightable Volumetric Videocited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Learning Unified Representation of 3D Gaussian Splattingcited by 2
- 2026Instant Colorization of Gaussian Splatscited by 0
- 2026Relightable Gaussian Splatting for Virtual Production Using Image-Based Illuminationcited by 0
- 2026LumiTokens: 3D Relighting via Token-Space Lighting Transformationcited by 0
- 2026LumiTokens: 3D Relighting via Token-Space Lighting Transformation18 Aug 2026
- 2026Relightable Gaussian Splatting for Virtual Production Using Image-Based Illumination9 May 2026
- 2026Instant Colorization of Gaussian Splats18 Apr 2026
- 2025Learning Unified Representation of 3D Gaussian Splatting26 Sep 2025