mlsanityData to 14 Oct 2026

OmniLight: One Model to Rule All Lighting Conditions

arXiv 2604.15170 ↗First posted 16 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Adverse lighting conditions, such as cast shadows and irregular illumination, pose significant challenges to computer vision systems by degrading visibility and color fidelity. Consequently, effective shadow removal and ALN are critical for restoring underlying image content, improving perceptual quality, and facilitating robust performance in downstream tasks. However, while achieving state-of-the-art results on specific benchmarks is a primary goal in image restoration challenges, real-world applications often demand robust models capable of handling diverse domains. To address this, we present a comprehensive study on lighting-related image restoration by exploring two contrasting strategies. We leverage a robust framework for ALN, DINOLight, as a specialized baseline to exploit the characteristics of each individual dataset, and extend it to OmniLight, a generalized alternative incorporating our proposed Wavelet Domain Mixture-of-Experts (WD-MoE) that is trained across all provided datasets. Through a comparative analysis of these two methods, we discuss the impact of data distribution on the performance of specialized and unified architectures in lighting-related image restoration. Notably, both approaches secured top-tier rankings across all three lighting-related tracks in the NTIRE 2026 Challenge, demonstrating their outstanding perceptual quality and generalization capabilities. Our codes are available at https://github.com/OBAKSA/Lighting-Restoration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 73 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

50 of 73 references.

References · 50

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  5. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  6. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  7. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  8. 2021Multi-Stage Progressive Image Restorationcited by 816
  9. 2022Simple Baselines for Image Restorationcited by 708
  10. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
  11. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  12. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
38 more
  1. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 244
  2. 2021HINet: Half Instance Normalization Network for Image Restorationcited by 237
  3. 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 231
  4. 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
  5. 2017Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removalcited by 161
  6. 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
  7. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 140
  8. 2020Meta-Transfer Learning for Zero-Shot Super-Resolutioncited by 116
  9. 2019Towards Ghost-free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GANcited by 103
  10. 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 103
  11. 2019Shadow Removal via Shadow Image Decompositioncited by 98
  12. 2024MambaIRv2: Attentive State Space Restorationcited by 94
  13. 2019Mask-ShadowGAN: Learning to Remove Shadows from Unpaired Datacited by 92
  14. 2020Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalizationcited by 92
  15. 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
  16. 2021Auto-Exposure Fusion for Single-Image Shadow Removalcited by 79
  17. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 77
  18. 2022NAFSSR: Stereo Image Super-Resolution Using NAFNetcited by 76
  19. 2022Swin2SR: SwinV2 Transformer for Compressed Image Super-Resolution and Restorationcited by 73
  20. 2022DC-ShadowNet: Single-Image Hard and Soft Shadow Removal Using Unsupervised Domain-Classifier Guided Networkcited by 69
  21. 2020From Shadow Segmentation to Shadow Removalcited by 59
  22. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 57
  23. 2017Direction-aware Spatial Context Features for Shadow Detectioncited by 56
  24. 2020Shadow Removal by a Lightness-Guided Network with Training on Unpaired Datacited by 38
  25. 2022DeS3: Adaptive Attention-driven Self and Soft Shadow Removal using ViT Similaritycited by 38
  26. 2023Latent Feature-Guided Diffusion Models for Shadow Removalcited by 29
  27. 2023Prompt-based Ingredient-Oriented All-in-One Image Restorationcited by 22
  28. 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
  29. 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representationcited by 21
  30. 2024ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformercited by 20
  31. 2024OmniSR: Shadow Removal under Direct and Indirect Lightingcited by 19
  32. 2024Regional Attention for Shadow Removalcited by 12
  33. 2025IDF: Iterative Dynamic Filtering Networks for Generalizable Image Denoisingcited by 12
  34. 2024Towards Image Ambient Lighting Normalizationcited by 9
  35. 2022SpA-Former: Transformer image shadow detection and removal via spatial attentioncited by 7
  36. 2024ShadowMaskFormer: Mask Augmented Patch Embeddings for Shadow Removalcited by 7
  37. 2025After the Party: Navigating the Mapping From Color to Ambient Lightingcited by 4
  38. 2026DINOLight: Robust Ambient Light Normalization with Self-supervised Visual Prior Integrationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DIME-Net: A Dual-Illumination Adaptive Enhancement Network Based on Retinex and Mixture-of-Experts
  2. 2025UniSER: A Foundation Model for Unified Soft Effects Removal
  3. 2025UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedback
  4. 2026IG-Diff: Complex Night Scene Restoration with Illumination-Guided Diffusion Model
  5. 2025Learning to See in the Extremely Dark
  6. 2026Retrieval-Augmented Generation-Based Color Restoration for Low-Light Image Enhancement
  7. 2026Towards Controllable Low-Light Image Enhancement: A Continuous Multi-illumination Dataset and Efficient State Space Framework
  8. 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting