Make Explicit Calibration Implicit: Calibrate Denoiser Instead of the Noise Model
Not on the map. Why?
Abstract (arXiv)
Explicit calibration-based methods have dominated RAW image denoising under extremely low-light environments. However, these methods are impeded by several critical limitations: a) the explicit calibration process is both labor- and time-intensive, b) challenge exists in transferring denoisers across different camera models, and c) the disparity between synthetic and real noise is exacerbated by digital gain. To address these issues, we introduce a groundbreaking pipeline named Lighting Every Darkness (LED), which is effective regardless of the digital gain or the camera sensor. LED eliminates the need for explicit noise model calibration, instead utilizing an implicit fine-tuning process that allows quick deployment and requires minimal data. Structural modifications are also included to reduce the discrepancy between synthetic and real noise without extra computational demands. Our method surpasses existing methods in various camera models, including new ones not in public datasets, with just a few pairs per digital gain and only 0.5% of the typical iterations. Furthermore, LED also allows researchers to focus more on deep learning advancements while still utilizing sensor engineering benefits. Code and related materials can be found in https://srameo.github.io/projects/led-iccv23/ .
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 53 of its 72 references that are in the map. First posted on arXiv 7 Aug 2023.
Builds on
53 of 72 references.
References · 53
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2016Layer Normalizationcited by 5,579
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
38 more
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2017Deep Image Priorcited by 1,097
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022Simple Baselines for Image Restorationcited by 701
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
- 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 515
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
- 2018Learning to See in the Darkcited by 459
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2020CycleISP: Real Image Restoration via Improved Data Synthesiscited by 212
- 2019ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blockscited by 178
- 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
- 2019Noise Flow: Noise Modeling with Conditional Normalizing Flowscited by 108
- 2020Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalizationcited by 92
- 2021Diverse Branch Block: Building a Convolution as an Inception-like Unitcited by 87
- 2020NBNet: Noise Basis Learning for Image Denoising with Subspace Projectioncited by 77
- 2020Practical Deep Raw Image Denoising on Mobile Devicescited by 76
- 2022Representation Compensation Networks for Continual Semantic Segmentationcited by 72
- 2021Physics-based Noise Modeling for Extreme Low-light Photographycited by 67
- 2021Rethinking Noise Synthesis and Modeling in Raw Denoisingcited by 62
- 2022C2N: Practical Generative Noise Modeling for Real-World Denoisingcited by 56
- 2022Dancing under the stars: video denoising in starlightcited by 47
- 2023Instance Segmentation in the Darkcited by 45
- 2021A Survey of Self-Supervised and Few-Shot Object Detectioncited by 35
- 2021RepMLPNet: Hierarchical Vision MLP with Re-parameterized Localitycited by 32
- 2022Modeling sRGB Camera Noise with Normalizing Flowscited by 28
- 2014High-level numerical simulations of noise in CCD and CMOS photosensors: review and tutorialcited by 23
- 2022Learnability Enhancement for Low-light Raw Denoising: Where Paired Real Data Meets Noise Modelingcited by 23
- 2022Noise2NoiseFlow: Realistic Camera Noise Modeling without Clean Imagescited by 17
- 2021Few-Shot Learning with a Strong Teachercited by 16
- 2022Estimating Fine-Grained Noise Model via Contrastive Learningcited by 14
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.
- 2023Multi-task Image Restoration Guided By Robust DINO Featurescited by 14
- 2024Towards RAW Object Detection in Diverse Conditionscited by 9
- 2024Towards RAW Object Detection in Diverse Conditions24 Nov 2024
- 2023Multi-task Image Restoration Guided By Robust DINO Features4 Dec 2023