mlsanityData to 14 Oct 2026

HELIOS: From midnight to noon, continuous outdoor urban scene relighting

arXiv 2609.00901 ↗First posted 1 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Modifying the illumination of driving images is a fundamental challenge, as most datasets are captured at specific times of day. Existing methods rely on synthetic data or paired multi-illumination supervision, which limits their generalization to the diverse and challenging conditions of real-world scenarios. To address this, we propose HELIOS, a novel image relighting approach that relies on unlabeled real-world datasets without requiring any paired images for training. Our approach integrates albedo-based conditioning into a cycle-consistent diffusion pipeline to prevent identity collapse and ensure accurate domain translation. To handle low-visibility nighttime conditions, we introduce a robust albedo distillation strategy that transfers structural stability from the daytime domain. Additionally, we replace traditional text prompts with a fine-grained control mechanism based on GPS-derived solar angles, enabling smooth and continuous lighting manipulation across the day-night cycle. Through extensive evaluation and a user study, we demonstrate that HELIOS produces structurally consistent and realistic results in both night-to-day and day-to-night tasks, outperforming state-of-the-art methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 33 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

28 of 33 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  7. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  8. 2025Qwen-Image Technical Reportcited by 1,044
  9. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  10. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
  11. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
  12. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
16 more
  1. 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 190
  2. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 161
  3. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 142
  4. 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
  5. 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
  6. 2023Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenescited by 90
  7. 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 83
  8. 2023Intrinsic Image Diffusion for Indoor Single-view Material Estimationcited by 73
  9. 2025DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Modelscited by 57
  10. 2020Unpaired Image-to-Image Translation using Adversarial Consistency Losscited by 43
  11. 2023I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFscited by 42
  12. 2023CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulationcited by 41
  13. 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relightingcited by 40
  14. 2024LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relightingcited by 38
  15. 2023UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Videocited by 22
  16. 2025GroomLight: Hybrid Inverse Rendering for Relightable Human Hair Appearance Modelingcited by 7

Built on by

Not cited yet.