Image Denoising via Style Disentanglement
Not on the map. Why?
Abstract (arXiv)
Image denoising is a fundamental task in low-level computer vision. While recent deep learning-based image denoising methods have achieved impressive performance, they are black-box models and the underlying denoising principle remains unclear. In this paper, we propose a novel approach to image denoising that offers both clear denoising mechanism and good performance. We view noise as a type of image style and remove it by incorporating noise-free styles derived from clean images. To achieve this, we design novel losses and network modules to extract noisy styles from noisy images and noise-free styles from clean images. The noise-free style induces low-response activations for noise features and high-response activations for content features in the feature space. This leads to the separation of clean contents from noise, effectively denoising the image. Unlike disentanglement-based image editing tasks that edit semantic-level attributes using styles, our main contribution lies in editing pixel-level attributes through global noise-free styles. We conduct extensive experiments on synthetic noise removal and real-world image denoising datasets (SIDD and DND), demonstrating the effectiveness of our method in terms of both PSNR and SSIM metrics. Moreover, we experimentally validate that our method offers good interpretability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 60 references that are in the map. First posted on arXiv 26 Sep 2023.
Builds on
43 of 60 references.
References · 43
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2014Going Deeper with Convolutionscited by 4,241
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
- 2017Deep Image Priorcited by 1,098
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
31 more
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 533
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
- 2021Early Convolutions Help Transformers See Bettercited by 396
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
- 2018Noise2Void - Learning Denoising from Single Noisy Imagescited by 364
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2017Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)cited by 224
- 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
- 2018Residual Dense Network for Image Restorationcited by 181
- 2019Real Image Denoising with Feature Attentioncited by 176
- 2021Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Imagescited by 173
- 2017Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Losscited by 162
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2016Clearing the Skies: A deep network architecture for single-image rain removalcited by 136
- 2019Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Rainingcited by 117
- 2019Variational Denoising Network: Toward Blind Noise Modeling and Removalcited by 117
- 2020Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalizationcited by 92
- 2020NBNet: Noise Basis Learning for Image Denoising with Subspace Projectioncited by 77
- 2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
- 2019Unsupervised Domain-Specific Deblurring via Disentangled Representationscited by 37
- 2019Quadratic Autoencoder (Q-AE) for Low-dose CT Denoisingcited by 35
- 2020Learning Invariant Representation for Unsupervised Image Restorationcited by 28
- 2020EDCNN: Edge enhancement-based Densely Connected Network with Compound Loss for Low-Dose CT Denoisingcited by 26
- 2021Information-based Disentangled Representation Learning for Unsupervised MR Harmonizationcited by 16
- 2020Emerging Disentanglement in Auto-Encoder Based Unsupervised Image Content Transfercited by 15
- 2020Noise Conscious Training of Non Local Neural Network powered by Self Attentive Spectral Normalized Markovian Patch GAN for Low Dose CT Denoisingcited by 10
Built on by
Not cited yet.