mlsanityData to 7 Oct 2026

Zero-Shot Low Light Image Enhancement with Diffusion Prior

arXiv 2412.13401 ↗First posted 18 Dec 2024cs.CVcited by 3

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

In this paper, we present a simple yet highly effective "free lunch" solution for low-light image enhancement (LLIE), which aims to restore low-light images as if acquired in well-illuminated environments. Our method necessitates no optimization, training, fine-tuning, text conditioning, or hyperparameter adjustments, yet it consistently reconstructs low-light images with superior fidelity. Specifically, we leverage a pre-trained text-to-image diffusion prior, learned from training on a large collection of natural images, and the features present in the model itself to guide the inference, in contrast to existing methods that depend on customized constraints. Comprehensive quantitative evaluations demonstrate that our approach outperforms SOTA methods on established datasets, while qualitative analyses indicate enhanced color accuracy and the rectification of subtle chromatic deviations. Furthermore, additional experiments reveal that our method, without any modifications, achieves SOTA-comparable performance in the auto white balance (AWB) task.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 64 of its 99 references that are in the map. First posted on arXiv 18 Dec 2024.

Builds on

64 of 99 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024LightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Models12 Jul
  2. 2023Global Structure-Aware Diffusion Process for Low-Light Image Enhancement26 Oct
  3. 2023PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance19 Sep
  4. 2023Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model25 Aug
  5. 2023ExposureDiffusion: Learning to Expose for Low-light Image Enhancement15 Jul
  6. 2023Low-Light Image Enhancement with Wavelet-based Diffusion Models1 Jun
  7. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement3 Apr
  8. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
  9. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction9 Dec

Other references · 55

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  10. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  12. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
38 more
  1. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  3. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  4. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  5. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  6. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  7. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  8. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  9. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
  10. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  11. 2015Holistically-Nested Edge Detectioncited by 590
  12. 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
  13. 2023Zero-shot Image-to-Image Translationcited by 503
  14. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  15. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
  16. 2019Kindling the Darkness: A Practical Low-light Image Enhancercited by 355
  17. 2023Pix2Video: Video Editing using Image Diffusioncited by 318
  18. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  19. 2020Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancementcited by 303
  20. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
  21. 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
  22. 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 228
  23. 2023Style Aligned Image Generation via Shared Attentioncited by 214
  24. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
  25. 2021Learning to Enhance Low-Light Image via Zero-Reference Deep Curve Estimationcited by 192
  26. 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
  27. 2023Iterative Prompt Learning for Unsupervised Backlit Image Enhancementcited by 107
  28. 2021R2RNet: Low-light Image Enhancement via Real-low to Real-normal Networkcited by 106
  29. 2023Implicit Neural Representation for Cooperative Low-light Image Enhancementcited by 92
  30. 2021Semantic-Guided Zero-Shot Learning for Low-Light Image/Video Enhancementcited by 60
  31. 2024Zero-Reference Low-Light Enhancement via Physical Quadruple Priorscited by 58
  32. 2019Handheld Mobile Photography in Very Low Lightcited by 56
  33. 2022Dancing under the stars: video denoising in starlightcited by 47
  34. 2024Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Taskscited by 47
  35. 2021Auto White-Balance Correction for Mixed-Illuminant Scenescited by 22
  36. 2024Fast Context-Based Low-Light Image Enhancement via Neural Implicit Representationscited by 21
  37. 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
  38. 2017Unsupervised Learning for Color Constancycited by 19

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion Models for Low-Light Image Enhancement: A Multi-Perspective Taxonomy and Performance Analysis
  2. 2024Low-Light Image Enhancement via Generative Perceptual Priors
  3. 2026DARD: Zero-Shot Degradation-Aware Retinex-Guided Diffusion for Low-Light Image Enhancement
  4. 2024Unsupervised Low-light Image Enhancement with Lookup Tables and Diffusion Priors
  5. 2026Retrieval-Augmented Generation-Based Color Restoration for Low-Light Image Enhancement
  6. 2023LLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image Enhancement
  7. 2024Zero-Reference Lighting Estimation Diffusion Model for Low-Light Image Enhancement
  8. 2023JoReS-Diff: Joint Retinex and Semantic Priors in Diffusion Model for Low-light Image Enhancement