mlsanityData to 14 Oct 2026

POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling

arXiv 2512.13192 ↗First posted 15 Dec 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Face relighting aims to synthesize realistic portraits under novel illumination while preserving identity and geometry. However, progress remains constrained by the limited availability of large-scale, physically consistent illumination data. To address this, we introduce POLAR, a large-scale and physically calibrated One-Light-at-a-Time (OLAT) dataset containing over 200 subjects captured under 156 lighting directions, multiple views, and diverse expressions. Building upon POLAR, we develop a flow-based generative model POLARNet that predicts per-light OLAT responses from a single portrait, capturing fine-grained and direction-aware illumination effects while preserving facial identity. Unlike diffusion or background-conditioned methods that rely on statistical or contextual cues, our formulation models illumination as a continuous, physically interpretable transformation between lighting states, enabling scalable and controllable relighting. Together, POLAR and POLARNet form a unified illumination learning framework that links real data, generative synthesis, and physically grounded relighting, establishing a self-sustaining "chicken-and-egg" cycle for scalable and reproducible portrait illumination. Our project page: https://rex0191.github.io/POLAR/.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 66 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

45 of 66 references.

References · 45

  1. 2022Flow Matching for Generative Modelingcited by 5,702
  2. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  3. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
  4. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  5. 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
  6. 2023TensoIR: Tensorial Inverse Renderingcited by 168
  7. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  8. 2019Single Image Portrait Relightingcited by 152
  9. 2023Relightable Gaussian Codec Avatarscited by 127
  10. 2017Deep Image Harmonizationcited by 120
  11. 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
  12. 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
33 more
  1. 2022Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptationcited by 67
  2. 2024SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relightingcited by 67
  3. 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
  4. 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 57
  5. 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
  6. 2015Learning a Discriminative Model for the Perception of Realism in Composite Imagescited by 52
  7. 2021Neural Video Portrait Relighting in Real-time via Consistency Modelingcited by 46
  8. 2022Face Relighting with Geometrically Consistent Shadowscited by 43
  9. 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
  10. 2023ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objectscited by 42
  11. 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
  12. 2021NeLF: Neural Light-transport Field for Portrait View Synthesis and Relightingcited by 38
  13. 2024LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relightingcited by 38
  14. 2022VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relightingcited by 37
  15. 2025LBM: Latent Bridge Matching for Fast Image-to-Image Translationcited by 36
  16. 2024DifFRelight: Diffusion-Based Facial Performance Relightingcited by 35
  17. 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Imagecited by 32
  18. 2023OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objectscited by 31
  19. 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Datasetcited by 28
  20. 2023Semi-supervised Parametric Real-world Image Harmonizationcited by 26
  21. 2024Lite2Relight: 3D-aware Single Image Portrait Relightingcited by 25
  22. 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 25
  23. 2025SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Facescited by 24
  24. 2021A Light Stage on Every Deskcited by 21
  25. 2020Monocular Reconstruction of Neural Face Reflectance Fieldscited by 20
  26. 2023Dense Pixel-to-Pixel Harmonization via Continuous Image Representationcited by 19
  27. 2024URHand: Universal Relightable Handscited by 17
  28. 2023Relightable Neural Actor with Intrinsic Decomposition and Pose Controlcited by 11
  29. 2021Countering Racial Bias in Computer Graphics Researchcited by 8
  30. 2025DreamLight: Towards Harmonious and Consistent Image Relightingcited by 8
  31. 2025HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View Synthesiscited by 7
  32. 2025BecomingLit: Relightable Gaussian Avatars with Hybrid Neural Shadingcited by 6
  33. 2025OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Controlcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.