# Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition

arXiv: https://arxiv.org/abs/2303.04291 · HTML: https://mlsanity.com/paper/2303.04291/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models.
- Builds on 73 of its 112 references that are in the map.
- First posted on arXiv 7 Mar 2023.

## Placed in

- Diffusion models / [Image generation, text-to-image and editing](https://mlsanity.com/diffusion/image-generation-text-to-image-and-editing/)

## Builds on (most cited first, 30 of 73)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [Diffusion Models Beat GANs on Image Synthesis](https://mlsanity.com/paper/2105.05233/) (2021)
- [Deep Unsupervised Learning using Nonequilibrium Thermodynamics](https://mlsanity.com/paper/1503.03585/) (2015)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Generative Modeling by Estimating Gradients of the Data Distribution](https://mlsanity.com/paper/1907.05600/) (2019)
- [GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models](https://mlsanity.com/paper/2112.10741/) (2021)
- [Elucidating the Design Space of Diffusion-Based Generative Models](https://mlsanity.com/paper/2206.00364/) (2022)
- [Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network](https://mlsanity.com/paper/1609.04802/) (2016)
- [Image Super-Resolution via Iterative Refinement](https://mlsanity.com/paper/2104.07636/) (2021)
- [RePaint: Inpainting using Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2201.09865/) (2022)
- [Palette: Image-to-Image Diffusion Models](https://mlsanity.com/paper/2111.05826/) (2021)
- [Demystifying MMD GANs](https://mlsanity.com/paper/1801.01401/) (2018)
- [Cascaded Diffusion Models for High Fidelity Image Generation](https://mlsanity.com/paper/2106.15282/) (2021)
- [Diffusion Models in Vision: A Survey](https://mlsanity.com/paper/2209.04747/) (2022)
- [Denoising Diffusion Restoration Models](https://mlsanity.com/paper/2201.11793/) (2022)
- [Deep Retinex Decomposition for Low-Light Enhancement](https://mlsanity.com/paper/1808.04560/) (2018)
- [ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2108.02938/) (2021)
- [Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement](https://mlsanity.com/paper/2001.06826/) (2020)
- [Solving Inverse Problems in Medical Imaging with Score-Based Generative Models](https://mlsanity.com/paper/2111.08005/) (2021)
- [Label-Efficient Semantic Segmentation with Diffusion Models](https://mlsanity.com/paper/2112.03126/) (2021)
- [EnlightenGAN: Deep Light Enhancement without Paired Supervision](https://mlsanity.com/paper/1906.06972/) (2019)
- [Learning to See in the Dark](https://mlsanity.com/paper/1805.01934/) (2018)
- [Blended Latent Diffusion](https://mlsanity.com/paper/2206.02779/) (2022)
- [Kindling the Darkness: A Practical Low-light Image Enhancer](https://mlsanity.com/paper/1905.04161/) (2019)
- [Diffusion Models already have a Semantic Latent Space](https://mlsanity.com/paper/2210.10960/) (2022)

## Built on by (most cited first, 20 of 20)

- [VideoCrafter1: Open Diffusion Models for High-Quality Video Generation](https://mlsanity.com/paper/2310.19512/) (2023)
- [Diffusion Models in Low-Level Vision: A Survey](https://mlsanity.com/paper/2406.11138/) (2024)
- [LoLI-Street: Benchmarking Low-Light Image Enhancement and Beyond](https://mlsanity.com/paper/2410.09831/) (2024)
- [TSCnet: A Text-driven Semantic-level Controllable Framework for Customized Low-Light Image Enhancement](https://mlsanity.com/paper/2503.08168/) (2025)
- [Enhancing Text-to-Image Diffusion Transformer via Split-Text Conditioning](https://mlsanity.com/paper/2505.19261/) (2025)
- [DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Model](https://mlsanity.com/paper/2311.11417/) (2023)
- [ItDPDM: Information-Theoretic Discrete Poisson Diffusion Model](https://mlsanity.com/paper/2505.05082/) (2025)
- [DiffuseRAW: End-to-End Generative RAW Image Processing for Low-Light Images](https://mlsanity.com/paper/2402.18575/) (2023)
- [Structure-guided Diffusion Transformer for Low-Light Image Enhancement](https://mlsanity.com/paper/2504.15054/) (2025)
- [Zero-Shot Low Light Image Enhancement with Diffusion Prior](https://mlsanity.com/paper/2412.13401/) (2024)
- [Tell Me What You See: Text-Guided Real-World Image Denoising](https://mlsanity.com/paper/2312.10191/) (2023)
- [ClassLIE: Structure- and Illumination-Adaptive Classification for Low-Light Image Enhancement](https://mlsanity.com/paper/2312.13265/) (2023)
- [TS-Diff: Two-Stage Diffusion Model for Low-Light RAW Image Enhancement](https://mlsanity.com/paper/2505.04281/) (2025)
- [DarkDiff: Advancing Low-Light Raw Enhancement by Retasking Diffusion Models for Camera ISP](https://mlsanity.com/paper/2505.23743/) (2025)
- [DRWKV: Focusing on Object Edges for Low-Light Image Enhancement](https://mlsanity.com/paper/2507.18594/) (2025)
- [DifuzCam: Replacing Camera Lens with a Mask and a Diffusion Model](https://mlsanity.com/paper/2408.07541/) (2024)
- [Personalized Generative Low-light Image Denoising and Enhancement](https://mlsanity.com/paper/2412.14327/) (2024)
- [Dual Degradation-Inspired Deep Unfolding Network for Low-Light Image Enhancement](https://mlsanity.com/paper/2308.02776/) (2023)
- [Diffusion Models for Low-Light Image Enhancement: A Multi-Perspective Taxonomy and Performance Analysis](https://mlsanity.com/paper/2510.05976/) (2025)
- [Reading in the Dark: Low-light Scene Text Recognition](https://mlsanity.com/paper/2604.23685/) (2026)

## Abstract (arXiv)

Capturing images is a key part of automation for high-level tasks such as scene text recognition. Low-light conditions pose a challenge for high-level perception stacks, which are often optimized on well-lit, artifact-free images. Reconstruction methods for low-light images can produce well-lit counterparts, but typically at the cost of high-frequency details critical for downstream tasks. We propose Diffusion in the Dark (DiD), a diffusion model for low-light image reconstruction for text recognition. DiD provides qualitatively competitive reconstructions with that of state-of-the-art (SOTA), while preserving high-frequency details even in extremely noisy, dark conditions. We demonstrate that DiD, without any task-specific optimization, can outperform SOTA low-light methods in low-light text recognition on real images, bolstering the potential of diffusion models to solve ill-posed inverse problems.
