# C2N: Practical Generative Noise Modeling for Real-World Denoising

arXiv: https://arxiv.org/abs/2202.09533 · HTML: https://mlsanity.com/paper/2202.09533/

## Key facts

- Cited by 56 papers in the map (data through 14 Oct 2026).
- Builds on 35 of its 55 references that are in the map.
- First posted on arXiv 19 Feb 2022.

## Builds on (most cited first, 30 of 35)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Improved Training of Wasserstein GANs](https://mlsanity.com/paper/1704.00028/) (2017)
- [Conditional Generative Adversarial Nets](https://mlsanity.com/paper/1411.1784/) (2014)
- [Enhanced Deep Residual Networks for Single Image Super-Resolution](https://mlsanity.com/paper/1707.02921/) (2017)
- [Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising](https://mlsanity.com/paper/1608.03981/) (2016)
- [Generative Adversarial Text to Image Synthesis](https://mlsanity.com/paper/1605.05396/) (2016)
- [Noise2Noise: Learning Image Restoration without Clean Data](https://mlsanity.com/paper/1803.04189/) (2018)
- [FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising](https://mlsanity.com/paper/1710.04026/) (2017)
- [Noise2Void - Learning Denoising from Single Noisy Images](https://mlsanity.com/paper/1811.10980/) (2018)
- [Noise2Self: Blind Denoising by Self-Supervision](https://mlsanity.com/paper/1901.11365/) (2019)
- [Toward Convolutional Blind Denoising of Real Photographs](https://mlsanity.com/paper/1807.04686/) (2018)
- [Benchmarking Denoising Algorithms with Real Photographs](https://mlsanity.com/paper/1707.01313/) (2017)
- [Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration](https://mlsanity.com/paper/1508.02848/) (2015)
- [Multi-level Wavelet-CNN for Image Restoration](https://mlsanity.com/paper/1805.07071/) (2018)
- [Real Image Denoising with Feature Attention](https://mlsanity.com/paper/1904.07396/) (2019)
- [High-Quality Self-Supervised Deep Image Denoising](https://mlsanity.com/paper/1901.10277/) (2019)
- [Non-Local Recurrent Network for Image Restoration](https://mlsanity.com/paper/1806.02919/) (2018)
- [A Physics-based Noise Formation Model for Extreme Low-light Raw Denoising](https://mlsanity.com/paper/2003.12751/) (2020)
- [Noisier2Noise: Learning to Denoise from Unpaired Noisy Data](https://mlsanity.com/paper/1910.11908/) (2019)
- [Gradient Estimation Using Stochastic Computation Graphs](https://mlsanity.com/paper/1506.05254/) (2015)
- [Noise Flow: Noise Modeling with Conditional Normalizing Flows](https://mlsanity.com/paper/1908.08453/) (2019)
- [Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generation](https://mlsanity.com/paper/2007.05946/) (2020)
- [Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalization](https://mlsanity.com/paper/2002.11244/) (2020)
- [When AWGN-based Denoiser Meets Real Noises](https://mlsanity.com/paper/1904.03485/) (2019)
- [Seven ways to improve example-based single image super resolution](https://mlsanity.com/paper/1511.02228/) (2015)
- [Path-Restore: Learning Network Path Selection for Image Restoration](https://mlsanity.com/paper/1904.10343/) (2019)
- [Non-Local Color Image Denoising with Convolutional Neural Networks](https://mlsanity.com/paper/1611.06757/) (2016)
- [RENOIR - A Dataset for Real Low-Light Image Noise Reduction](https://mlsanity.com/paper/1409.8230/) (2014)

## Built on by (most cited first, 30 of 56)

- [AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot Network](https://mlsanity.com/paper/2203.11799/) (2022)
- [CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Image](https://mlsanity.com/paper/2203.13009/) (2022)
- [LG-BPN: Local and Global Blind-Patch Network for Self-Supervised Real-World Denoising](https://mlsanity.com/paper/2304.00534/) (2023)
- [Spatially Adaptive Self-Supervised Learning for Real-World Image Denoising](https://mlsanity.com/paper/2303.14934/) (2023)
- [Random Sub-Samples Generation for Self-Supervised Real Image Denoising](https://mlsanity.com/paper/2307.16825/) (2023)
- [MM-BSN: Self-Supervised Image Denoising for Real-World with Multi-Mask based on Blind-Spot Network](https://mlsanity.com/paper/2304.01598/) (2023)
- [Unsupervised Image Denoising in Real-World Scenarios via Self-Collaboration Parallel Generative Adversarial Branches](https://mlsanity.com/paper/2308.06776/) (2023)
- [Modeling sRGB Camera Noise with Normalizing Flows](https://mlsanity.com/paper/2206.00812/) (2022)
- [Learn from Unpaired Data for Image Restoration: A Variational Bayes Approach](https://mlsanity.com/paper/2204.10090/) (2022)
- [Noise2NoiseFlow: Realistic Camera Noise Modeling without Clean Images](https://mlsanity.com/paper/2206.01103/) (2022)
- [Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarios](https://mlsanity.com/paper/2303.16783/) (2023)
- [Stimulating Diffusion Model for Image Denoising via Adaptive Embedding and Ensembling](https://mlsanity.com/paper/2307.03992/) (2023)
- [Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review](https://mlsanity.com/paper/2308.00247/) (2023)
- [PUCA: Patch-Unshuffle and Channel Attention for Enhanced Self-Supervised Image Denoising](https://mlsanity.com/paper/2310.10088/) (2023)
- [Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoising](https://mlsanity.com/paper/2308.04682/) (2023)
- [Estimating Fine-Grained Noise Model via Contrastive Learning](https://mlsanity.com/paper/2204.01716/) (2022)
- [Self-supervised Image Denoising with Downsampled Invariance Loss and Conditional Blind-Spot Network](https://mlsanity.com/paper/2304.09507/) (2023)
- [Masked and Shuffled Blind Spot Denoising for Real-World Images](https://mlsanity.com/paper/2404.09389/) (2024)
- [IDF: Iterative Dynamic Filtering Networks for Generalizable Image Denoising](https://mlsanity.com/paper/2508.19649/) (2025)
- [LAN: Learning to Adapt Noise for Image Denoising](https://mlsanity.com/paper/2412.10651/) (2024)
- [Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising](https://mlsanity.com/paper/2404.07846/) (2024)
- [Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration](https://mlsanity.com/paper/2406.18516/) (2024)
- [Recurrent Self-Supervised Video Denoising with Denser Receptive Field](https://mlsanity.com/paper/2308.03608/) (2023)
- [Modular Degradation Simulation and Restoration for Under-Display Camera](https://mlsanity.com/paper/2209.11455/) (2022)
- [A Comparison of Image Denoising Methods](https://mlsanity.com/paper/2304.08990/) (2023)
- [Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restoration](https://mlsanity.com/paper/2408.09241/) (2024)
- [Asymmetric Mask Scheme for Self-Supervised Real Image Denoising](https://mlsanity.com/paper/2407.06514/) (2024)
- [Learning Task-Oriented Flows to Mutually Guide Feature Alignment in Synthesized and Real Video Denoising](https://mlsanity.com/paper/2208.11803/) (2022)
- [Realistic Noise Synthesis with Diffusion Models](https://mlsanity.com/paper/2305.14022/) (2023)
- [NoiseTransfer: Image Noise Generation with Contrastive Embeddings](https://mlsanity.com/paper/2301.13554/) (2023)

## Abstract (arXiv)

Learning-based image denoising methods have been bounded to situations where well-aligned noisy and clean images are given, or samples are synthesized from predetermined noise models, e.g., Gaussian. While recent generative noise modeling methods aim to simulate the unknown distribution of real-world noise, several limitations still exist. In a practical scenario, a noise generator should learn to simulate the general and complex noise distribution without using paired noisy and clean images. However, since existing methods are constructed on the unrealistic assumption of real-world noise, they tend to generate implausible patterns and cannot express complicated noise maps. Therefore, we introduce a Clean-to-Noisy image generation framework, namely C2N, to imitate complex real-world noise without using any paired examples. We construct the noise generator in C2N accordingly with each component of real-world noise characteristics to express a wide range of noise accurately. Combined with our C2N, conventional denoising CNNs can be trained to outperform existing unsupervised methods on challenging real-world benchmarks by a large margin.
