mlsanityData to 7 Oct 2026

CodeEnhance: A Codebook-Driven Approach for Low-Light Image Enhancement

arXiv 2404.05253 ↗First posted 8 Apr 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Low-light image enhancement (LLIE) aims to improve low-illumination images. However, existing methods face two challenges: (1) uncertainty in restoration from diverse brightness degradations; (2) loss of texture and color information caused by noise suppression and light enhancement. In this paper, we propose a novel enhancement approach, CodeEnhance, by leveraging quantized priors and image refinement to address these challenges. In particular, we reframe LLIE as learning an image-to-code mapping from low-light images to discrete codebook, which has been learned from high-quality images. To enhance this process, a Semantic Embedding Module (SEM) is introduced to integrate semantic information with low-level features, and a Codebook Shift (CS) mechanism, designed to adapt the pre-learned codebook to better suit the distinct characteristics of our low-light dataset. Additionally, we present an Interactive Feature Transformation (IFT) module to refine texture and color information during image reconstruction, allowing for interactive enhancement based on user preferences. Extensive experiments on both real-world and synthetic benchmarks demonstrate that the incorporation of prior knowledge and controllable information transfer significantly enhances LLIE performance in terms of quality and fidelity. The proposed CodeEnhance exhibits superior robustness to various degradations, including uneven illumination, noise, and color distortion.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 69 references that are in the map. First posted on arXiv 8 Apr 2024.

Builds on

34 of 69 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  6. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  7. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  8. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  9. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  10. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
  11. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
  12. 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
22 more
  1. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  2. 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
  3. 2019Kindling the Darkness: A Practical Low-light Image Enhancercited by 355
  4. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
  5. 2015LLNet: A Deep Autoencoder Approach to Natural Low-light Image Enhancementcited by 224
  6. 2018Getting to Know Low-light Images with The Exclusively Dark Datasetcited by 157
  7. 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
  8. 2019Pyramid Feature Attention Network for Saliency detectioncited by 128
  9. 2022VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decodercited by 116
  10. 2021R2RNet: Low-light Image Enhancement via Real-low to Real-normal Networkcited by 106
  11. 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
  12. 2023Global Structure-Aware Diffusion Process for Low-Light Image Enhancementcited by 92
  13. 2021Image-Adaptive YOLO for Object Detection in Adverse Weather Conditionscited by 85
  14. 2023Low-Light Image Enhancement via Structure Modeling and Guidancecited by 78
  15. 2023RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priorscited by 73
  16. 2019Attention Guided Low-light Image Enhancement with a Large Scale Low-light Simulation Datasetcited by 65
  17. 2024Zero-Reference Low-Light Enhancement via Physical Quadruple Priorscited by 58
  18. 2023Towards High-quality HDR Deghosting with Conditional Diffusion Modelscited by 33
  19. 2018Joint Enhancement and Denoising Method via Sequential Decompositioncited by 32
  20. 2021Learning Deep Context-Sensitive Decomposition for Low-Light Image Enhancementcited by 23
  21. 2023JoReS-Diff: Joint Retinex and Semantic Priors in Diffusion Model for Low-light Image Enhancementcited by 8
  22. 2021DA-DRN: Degradation-Aware Deep Retinex Network for Low-Light Image Enhancementcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.