Generalizable Denoising of Microscopy Images using Generative Adversarial Networks and Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Microscopy images often suffer from high levels of noise, which can hinder further analysis and interpretation. Content-aware image restoration (CARE) methods have been proposed to address this issue, but they often require large amounts of training data and suffer from over-fitting. To overcome these challenges, we propose a novel framework for few-shot microscopy image denoising. Our approach combines a generative adversarial network (GAN) trained via contrastive learning (CL) with two structure preserving loss terms (Structural Similarity Index and Total Variation loss) to further improve the quality of the denoised images using little data. We demonstrate the effectiveness of our method on three well-known microscopy imaging datasets, and show that we can drastically reduce the amount of training data while retaining the quality of the denoising, thus alleviating the burden of acquiring paired data and enabling few-shot learning. The proposed framework can be easily extended to other image restoration tasks and has the potential to significantly advance the field of microscopy image analysis.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 27 Mar 2023.
Builds on
25 of 48 references.
References · 25
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2022Generative Adversarial Networkscited by 5,603
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2020Supervised Contrastive Learningcited by 2,803
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2018Noise2Void - Learning Denoising from Single Noisy Imagescited by 359
13 more
- 2019Noise2Self: Blind Denoising by Self-Supervisioncited by 274
- 2019High-Quality Self-Supervised Deep Image Denoisingcited by 161
- 2019Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesiscited by 108
- 2019Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generationcited by 75
- 2018A Poisson-Gaussian Denoising Dataset with Real Fluorescence Microscopy Imagescited by 70
- 2020Noise2Same: Optimizing A Self-Supervised Bound for Image Denoisingcited by 56
- 2019Probabilistic Noise2Void: Unsupervised Content-Aware Denoisingcited by 51
- 2018Connecting Image Denoising and High-Level Vision Tasks via Deep Learningcited by 39
- 2021Rethinking Deep Image Prior for Denoisingcited by 38
- 2017Isotropic reconstruction of 3D fluorescence microscopy images using convolutional neural networkscited by 17
- 2021Cycle-free CycleGAN using Invertible Generator for Unsupervised Low-Dose CT Denoisingcited by 15
- 2019Noise as Domain Shift: Denoising Medical Images by Unpaired Image Translationcited by 8
- 2020Noise-Powered Disentangled Representation for Unsupervised Speckle Reduction of Optical Coherence Tomography Imagescited by 7
Built on by
Not cited yet.