mlsanityData to 7 Oct 2026

HeadLighter: Disentangling Illumination in Generative 3D Gaussian Heads via Lightstage Captures

arXiv 2601.02103 ↗First posted 5 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent 3D-aware head generative models based on 3D Gaussian Splatting achieve real-time, photorealistic and view-consistent head synthesis. However, a fundamental limitation persists: the deep entanglement of illumination and intrinsic appearance prevents controllable relighting. Existing disentanglement methods rely on strong assumptions to enable weakly supervised learning, which restricts their capacity for complex illumination. To address this challenge, we introduce HeadLighter, a novel supervised framework that learns a physically plausible decomposition of appearance and illumination in head generative models. Specifically, we design a dual-branch architecture that separately models lighting-invariant head attributes and physically grounded rendering components. A progressive disentanglement training is employed to gradually inject head appearance priors into the generative architecture, supervised by multi-view images captured under controlled light conditions with a light stage setup. We further introduce a distillation strategy to generate high-quality normals for realistic rendering. Experiments demonstrate that our method preserves high-quality generation and real-time rendering, while simultaneously supporting explicit lighting and viewpoint editing. We will publicly release our code and dataset.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 60 references that are in the map. First posted on arXiv 5 Jan 2026.

Builds on

35 of 60 references.

References · 35

  1. 2023Segment Anythingcited by 8,158
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  5. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  6. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  7. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
  8. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  9. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  10. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  11. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
  12. 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 219
23 more
  1. 2023Relightable Gaussian Codec Avatarscited by 126
  2. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  3. 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
  4. 2021GAN-Control: Explicitly Controllable GANscited by 91
  5. 2021A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesiscited by 72
  6. 2022Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptationcited by 67
  7. 2024SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relightingcited by 66
  8. 2024GGHead: Fast and Generalizable 3D Gaussian Headscited by 51
  9. 2022Face Relighting with Geometrically Consistent Shadowscited by 43
  10. 2022VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relightingcited by 37
  11. 2024LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relightingcited by 37
  12. 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Imagecited by 32
  13. 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Datasetcited by 28
  14. 2024Lite2Relight: 3D-aware Single Image Portrait Relightingcited by 25
  15. 2025SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Facescited by 24
  16. 20223DFaceShop: Explicitly Controllable 3D-Aware Portrait Generationcited by 22
  17. 2024Real-time 3D-aware Portrait Video Relightingcited by 21
  18. 2023FaceLit: Neural 3D Relightable Facescited by 20
  19. 2024GenLit: Reformulating Single-Image Relighting as Video Generationcited by 20
  20. 2023LumiGAN: Unconditional Generation of Relightable 3D Human Facescited by 14
  21. 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonizationcited by 12
  22. 2025High-Fidelity Relightable Monocular Portrait Animation with Lighting-Controllable Video Diffusion Modelcited by 8
  23. 2025CGS-GAN: 3D Consistent Gaussian Splatting GANs for High Resolution Human Head Synthesiscited by 6

Built on by

Not cited yet.