MetaGS: A Meta-Learned Gaussian-Phong Model for Out-of-Distribution 3D Scene Relighting
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) 3D relighting requires novel view synthesis under unseen lighting conditions that differ significantly from the observed images. Existing relighting methods, which assume consistent light source distributions between training and testing, often degrade in OOD scenarios. We introduce MetaGS to tackle this challenge from two perspectives. First, we propose a meta-learning approach to train 3D Gaussian splatting, which explicitly promotes learning generalizable Gaussian geometries and appearance attributes across diverse lighting conditions, even with biased training data. Second, we embed fundamental physical priors from the Blinn-Phong reflection model into Gaussian splatting, which enhances the decoupling of shading components and leads to more accurate 3D scene reconstruction. Results on both synthetic and real-world datasets demonstrate the effectiveness of MetaGS in challenging OOD relighting tasks, supporting efficient point-light relighting and generalizing well to unseen environment lighting maps.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 31 May 2024.
Builds on
23 of 41 references.
References · 23
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2020Neural Sparse Voxel Fieldscited by 959
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
11 more
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 252
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
- 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 111
- 2023ENVIDR: Implicit Differentiable Renderer with Neural Environment Lightingcited by 65
- 2023ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objectscited by 42
- 2023Relighting Neural Radiance Fields with Shadow and Highlight Hintscited by 42
- 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 41
- 2023WildLight: In-the-wild Inverse Rendering with a Flashlightcited by 21
- 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objectscited by 14
- 2023Learning Visibility Field for Detailed 3D Human Reconstruction and Relightingcited by 11
- 2023Fast Sun-aligned Outdoor Scene Relighting based on TensoRFcited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 3.
4 papers.
- 2024BiGS: Bidirectional Gaussian Primitives for Relightable 3D Gaussian Splattingcited by 8
- 2026SwiftGS: Episodic Priors for Immediate Satellite Surface Recoverycited by 0
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructionscited by 0
- 2026PhyMRI-SR: Toward Physics-Aware MRI Image Super-Resolutioncited by 0
- 2026PhyMRI-SR: Toward Physics-Aware MRI Image Super-Resolution7 Jul 2026
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructions9 Jun 2026
- 2026SwiftGS: Episodic Priors for Immediate Satellite Surface Recovery19 Mar 2026
- 2024BiGS: Bidirectional Gaussian Primitives for Relightable 3D Gaussian Splatting23 Aug 2024