Light Up Your Face: A Physically Consistent Dataset and Diffusion Model for Face Fill-Light Enhancement
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Face fill-light enhancement (FFE) brightens underexposed faces by adding virtual fill light while keeping the original scene illumination and background unchanged. Most face relighting methods aim to reshape overall lighting, which can suppress the input illumination or modify the entire scene, leading to foreground-background inconsistency and mismatching practical FFE needs. To support scalable learning, we introduce LightYourFace-160K (LYF-160K), a large-scale paired dataset built with a physically consistent renderer that injects a disk-shaped area fill light controlled by six disentangled factors, producing 160K before-and-after pairs. We first pretrain a physics-aware lighting prompt (PALP) that embeds the 6D parameters into conditioning tokens, using an auxiliary planar-light reconstruction objective. Building on a pretrained diffusion backbone, we then train a fill-light diffusion (FiLitDiff), an efficient one-step model conditioned on physically grounded lighting codes, enabling controllable and high-fidelity fill lighting at low computational cost. Experiments on held-out paired sets demonstrate strong perceptual quality and competitive full-reference metrics, while better preserving background illumination. The dataset and model will be at https://github.com/gobunu/Light-Up-Your-Face.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 25 of its 40 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
25 of 40 references.
Closest ancestors · 2
Same direction, newest first
- 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illumination17 Apr
- 2023DiFaReli++: Diffusion Face Relighting with Consistent Cast Shadows19 Apr
Other references · 23
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
11 more
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
- 2024SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relightingcited by 66
- 2022Face Relighting with Geometrically Consistent Shadowscited by 43
- 2021Towards High Fidelity Face Relighting with Realistic Shadowscited by 42
- 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Imagecited by 32
- 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 24
- 2023Learning a 3D Morphable Face Reflectance Model from Low-cost Datacited by 20
- 2024Unleashing the Power of One-Step Diffusion based Image Super-Resolution via a Large-Scale Diffusion Discriminatorcited by 18
- 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measurescited by 14
- 2025HAODiff: Human-Aware One-Step Diffusion via Dual-Prompt Guidancecited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024DifFRelight: Diffusion-Based Facial Performance Relighting
- 2025SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Faces
- 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset
- 2025LightLab: Controlling Light Sources in Images with Diffusion Models
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Models
- 2026Pixel Cube: Diffusion-based Portrait Video Relighting Through Realistic Lighting Reproduction
- 2026Learning Latent Proxies for Controllable Single-Image Relighting
- 2026BodyReLux: Temporally Consistent Full-Body Video Relighting