mlsanityData to 7 Oct 2026

PI-Light: Physics-Inspired Diffusion for Full-Image Relighting

arXiv 2601.22135 ↗First posted 29 Jan 2026cs.CVcited by 5

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Full-image relighting remains a challenging problem due to the difficulty of collecting large-scale structured paired data, the difficulty of maintaining physical plausibility, and the limited generalizability imposed by data-driven priors. Existing attempts to bridge the synthetic-to-real gap for full-scene relighting remain suboptimal. To tackle these challenges, we introduce Physics-Inspired diffusion for full-image reLight (π-Light, or PI-Light), a two-stage framework that leverages physics-inspired diffusion models. Our design incorporates (i) batch-aware attention, which improves the consistency of intrinsic predictions across a collection of images, (ii) a physics-guided neural rendering module that enforces physically plausible light transport, (iii) physics-inspired losses that regularize training dynamics toward a physically meaningful landscape, thereby enhancing generalizability to real-world image editing, and (iv) a carefully curated dataset of diverse objects and scenes captured under controlled lighting conditions. Together, these components enable efficient finetuning of pretrained diffusion models while also providing a solid benchmark for downstream evaluation. Experiments demonstrate that π-Light synthesizes specular highlights and diffuse reflections across a wide variety of materials, achieving superior generalization to real-world scenes compared with prior approaches.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 30 of its 42 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

30 of 42 references.

Closest ancestors · 11

Same direction, newest first

  1. 2024DifFRelight: Diffusion-Based Facial Performance Relighting10 Oct
  2. 2024A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesis13 Sep
  3. 2024Neural Gaffer: Relighting Any Object via Diffusion11 Jun
  4. 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models27 May
  5. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion models1 May
  6. 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illumination17 Apr
  7. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image18 Mar
  8. 2024LightIt: Illumination Modeling and Control for Diffusion Models15 Mar
  9. 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generation19 Feb
  10. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  11. 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Models10 May

Other references · 19

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  4. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  5. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  6. 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 202
  7. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
  8. 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
  9. 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
  10. 2023Intrinsic Image Diffusion for Indoor Single-view Material Estimationcited by 73
  11. 2020Do 2D GANs Know 3D Shape? Unsupervised 3D shape reconstruction from 2D Image GANscited by 63
  12. 2022OutCast: Outdoor Single-image Relighting with Cast Shadowscited by 30
7 more
  1. 2024IllumiNeRF: 3D Relighting Without Inverse Renderingcited by 29
  2. 2024ScribbleLight: Single Image Indoor Relighting with Scribblescited by 22
  3. 2021Relighting Humans in the Wild: Monocular Full-Body Human Relighting with Domain Adaptationcited by 21
  4. 2023MAIR: Multi-view Attention Inverse Rendering with 3D Spatially-Varying Lighting Estimationcited by 12
  5. 2023Controllable Light Diffusion for Portraitscited by 11
  6. 2023Diffusion Reflectance Map: Single-Image Stochastic Inverse Rendering of Illumination and Reflectancecited by 11
  7. 2023Lasagna: Layered Score Distillation for Disentangled Object Relightingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024SpotLight: Shadow-Guided Object Relighting via Diffusion
  2. 2025LightLab: Controlling Light Sources in Images with Diffusion Models
  3. 2025LightSwitch: Multi-view Relighting with Material-guided Diffusion
  4. 2025UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedback
  5. 2026Learning Illumination Control in Diffusion Models
  6. 2026Learning Latent Proxies for Controllable Single-Image Relighting
  7. 2024Retinex-Diffusion: On Controlling Illumination Conditions in Diffusion Models via Retinex Theory
  8. 2026LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting