mlsanityData to 14 Oct 2026

WildRelight: A Real-World Benchmark and Physics-Guided Adaptation for Single-Image Relighting

arXiv 2605.11696 ↗First posted 12 May 2026cs.CV cs.AI cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent single-image relighting methods, powered by advanced generative models, have achieved impressive photorealism on synthetic benchmarks. However, their effectiveness in the complex visual landscape of the real world remains largely unverified. A critical gap exists, as current datasets are typically designed for multi-view reconstruction and fail to address the unique challenges of single-image relighting. To bridge this synthetic-to-real gap, we introduce WildRelight, the first in-the-wild dataset specifically created for evaluating single-image relighting models. WildRelight features a diverse collection of high-resolution outdoor scenes, captured under strictly aligned, temporally varying natural illuminations, each paired with a high-dynamic-range environment map. Using this data, we establish a rigorous benchmark revealing that state-of-the-art models trained on synthetic data suffer from severe domain shifts. The strictly aligned temporal structure of WildRelight enables a new paradigm for domain adaptation. We demonstrate this by introducing a physics-guided inference framework that leverages the captured natural light evolution as a self-supervised constraint. By integrating Diffusion Posterior Sampling (DPS) with temporal Sampling-Aware Test-Time Adaptation (TTA), we show that the dataset allows synthetic models to align with real-world statistics on-the-fly, transforming the intractable sim-to-real challenge into a tractable self-supervised task. The dataset and code will be made publicly available to foster robust, physically-grounded relighting research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 47 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

25 of 47 references.

References · 25

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  4. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  5. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
  6. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
  7. 2022Modeling Indirect Illumination for Inverse Renderingcited by 168
  8. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  9. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 161
  10. 2021NeRF for Outdoor Scene Relightingcited by 114
  11. 2019Neural Inverse Rendering of an Indoor Scene from a Single Imagecited by 101
  12. 2020OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasetscited by 74
13 more
  1. 2022Physically-Based Editing of Indoor Scene Lighting from a Single Imagecited by 62
  2. 2022IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenescited by 62
  3. 2023Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmarkcited by 51
  4. 2019A Dataset of Multi-Illumination Images in the Wildcited by 45
  5. 2023ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objectscited by 42
  6. 2023OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objectscited by 31
  7. 2024IllumiNeRF: 3D Relighting Without Inverse Renderingcited by 29
  8. 2024Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relightingcited by 18
  9. 2022SIMBAR: Single Image-Based Scene Relighting For Effective Data Augmentation For Automated Driving Vision Taskscited by 15
  10. 2023Weakly-supervised Single-view Image Relightingcited by 14
  11. 2025Materialist: Physically Based Editing Using Single-Image Inverse Renderingcited by 10
  12. 2025HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View Synthesiscited by 7
  13. 2025OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Controlcited by 5

Built on by

Not cited yet.