POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling
Not on the map. Why?
Abstract (arXiv)
Face relighting aims to synthesize realistic portraits under novel illumination while preserving identity and geometry. However, progress remains constrained by the limited availability of large-scale, physically consistent illumination data. To address this, we introduce POLAR, a large-scale and physically calibrated One-Light-at-a-Time (OLAT) dataset containing over 200 subjects captured under 156 lighting directions, multiple views, and diverse expressions. Building upon POLAR, we develop a flow-based generative model POLARNet that predicts per-light OLAT responses from a single portrait, capturing fine-grained and direction-aware illumination effects while preserving facial identity. Unlike diffusion or background-conditioned methods that rely on statistical or contextual cues, our formulation models illumination as a continuous, physically interpretable transformation between lighting states, enabling scalable and controllable relighting. Together, POLAR and POLARNet form a unified illumination learning framework that links real data, generative synthesis, and physically grounded relighting, establishing a self-sustaining "chicken-and-egg" cycle for scalable and reproducible portrait illumination. Our project page: https://rex0191.github.io/POLAR/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 66 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
45 of 66 references.
References · 45
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
- 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
- 2023TensoIR: Tensorial Inverse Renderingcited by 168
- 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
- 2019Single Image Portrait Relightingcited by 152
- 2023Relightable Gaussian Codec Avatarscited by 127
- 2017Deep Image Harmonizationcited by 120
- 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
- 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
33 more
- 2022Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptationcited by 67
- 2024SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relightingcited by 67
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 57
- 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
- 2015Learning a Discriminative Model for the Perception of Realism in Composite Imagescited by 52
- 2021Neural Video Portrait Relighting in Real-time via Consistency Modelingcited by 46
- 2022Face Relighting with Geometrically Consistent Shadowscited by 43
- 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
- 2023ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objectscited by 42
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2021NeLF: Neural Light-transport Field for Portrait View Synthesis and Relightingcited by 38
- 2024LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relightingcited by 38
- 2022VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relightingcited by 37
- 2025LBM: Latent Bridge Matching for Fast Image-to-Image Translationcited by 36
- 2024DifFRelight: Diffusion-Based Facial Performance Relightingcited by 35
- 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Imagecited by 32
- 2023OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objectscited by 31
- 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Datasetcited by 28
- 2023Semi-supervised Parametric Real-world Image Harmonizationcited by 26
- 2024Lite2Relight: 3D-aware Single Image Portrait Relightingcited by 25
- 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 25
- 2025SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Facescited by 24
- 2021A Light Stage on Every Deskcited by 21
- 2020Monocular Reconstruction of Neural Face Reflectance Fieldscited by 20
- 2023Dense Pixel-to-Pixel Harmonization via Continuous Image Representationcited by 19
- 2024URHand: Universal Relightable Handscited by 17
- 2023Relightable Neural Actor with Intrinsic Decomposition and Pose Controlcited by 11
- 2021Countering Racial Bias in Computer Graphics Researchcited by 8
- 2025DreamLight: Towards Harmonious and Consistent Image Relightingcited by 8
- 2025HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View Synthesiscited by 7
- 2025BecomingLit: Relightable Gaussian Avatars with Hybrid Neural Shadingcited by 6
- 2025OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Controlcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.