mlsanityData to 14 Oct 2026

MetaGS: A Meta-Learned Gaussian-Phong Model for Out-of-Distribution 3D Scene Relighting

arXiv 2405.20791 ↗First posted 31 May 2024cs.CV cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Out-of-distribution (OOD) 3D relighting requires novel view synthesis under unseen lighting conditions that differ significantly from the observed images. Existing relighting methods, which assume consistent light source distributions between training and testing, often degrade in OOD scenarios. We introduce MetaGS to tackle this challenge from two perspectives. First, we propose a meta-learning approach to train 3D Gaussian splatting, which explicitly promotes learning generalizable Gaussian geometries and appearance attributes across diverse lighting conditions, even with biased training data. Second, we embed fundamental physical priors from the Blinn-Phong reflection model into Gaussian splatting, which enhances the decoupling of shading components and leads to more accurate 3D scene reconstruction. Results on both synthetic and real-world datasets demonstrate the effectiveness of MetaGS in challenging OOD relighting tasks, supporting efficient point-light relighting and generalizing well to unseen environment lighting maps.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 31 May 2024.

Builds on

23 of 41 references.

References · 23

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  5. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  6. 2020Neural Sparse Voxel Fieldscited by 959
  7. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  8. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  9. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  10. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  11. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  12. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
11 more
  1. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 252
  2. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
  3. 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 111
  4. 2023ENVIDR: Implicit Differentiable Renderer with Neural Environment Lightingcited by 65
  5. 2023ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objectscited by 42
  6. 2023Relighting Neural Radiance Fields with Shadow and Highlight Hintscited by 42
  7. 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 41
  8. 2023WildLight: In-the-wild Inverse Rendering with a Flashlightcited by 21
  9. 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objectscited by 14
  10. 2023Learning Visibility Field for Detailed 3D Human Reconstruction and Relightingcited by 11
  11. 2023Fast Sun-aligned Outdoor Scene Relighting based on TensoRFcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 3.

4 papers.