mlsanityData to 14 Oct 2026

FM2S: Towards Spatially-Correlated Noise Modeling in Zero-Shot Fluorescence Microscopy Image Denoising

arXiv 2412.10031 ↗First posted 13 Dec 2024eess.IV cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Fluorescence microscopy image (FMI) denoising faces critical challenges due to the compound mixed Poisson-Gaussian noise with strong spatial correlation and the impracticality of acquiring paired noisy/clean data in dynamic biomedical scenarios. While supervised methods trained on synthetic noise (e.g., Gaussian/Poisson) suffer from out-of-distribution generalization issues, existing self-supervised approaches degrade under real FMI noise due to oversimplified noise assumptions and computationally intensive deep architectures. In this paper, we propose Fluorescence Micrograph to Self (FM2S), a zero-shot denoiser that achieves efficient FMI denoising through three key innovations: 1) A noise injection module that ensures training data sufficiency through adaptive Poisson-Gaussian synthesis while preserving spatial correlation and global statistics of FMI noise for robust model generalization; 2) A two-stage progressive learning strategy that first recovers structural priors via pre-denoised targets then refines high-frequency details through noise distribution alignment; 3) An ultra-lightweight network (3.5k parameters) enabling rapid convergence with 270× faster training and inference than SOTAs. Extensive experiments across FMI datasets demonstrate FM2S's superiority: It outperforms CVF-SID by 1.4dB PSNR on average while requiring 0.1% parameters of AP-BSN. Notably, FM2S maintains stable performance across varying noise levels, proving its practicality for microscopy platforms with diverse sensor characteristics. Code and datasets will be released.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 49 references that are in the map. First posted on arXiv 13 Dec 2024.

Builds on

28 of 49 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  4. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  5. 2017Deep Image Priorcited by 1,098
  6. 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 533
  7. 2018Noise2Void - Learning Denoising from Single Noisy Imagescited by 364
  8. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 312
  9. 2019Noise2Self: Blind Denoising by Self-Supervisioncited by 276
  10. 2019Real Image Denoising with Feature Attentioncited by 176
  11. 2021Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Imagescited by 173
  12. 2019Noisier2Noise: Learning to Denoise from Unpaired Noisy Datacited by 126
16 more
  1. 2022AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot Networkcited by 93
  2. 2022Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesiscited by 86
  3. 2022Blind2Unblind: Self-Supervised Image Denoising with Visible Blind Spotscited by 84
  4. 2018A Poisson-Gaussian Denoising Dataset with Real Fluorescence Microscopy Imagescited by 71
  5. 2023Zero-Shot Noise2Noise: Efficient Image Denoising without any Datacited by 61
  6. 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
  7. 2020Noise2Same: Optimizing A Self-Supervised Bound for Image Denoisingcited by 56
  8. 2022CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Imagecited by 45
  9. 2023LG-BPN: Local and Global Blind-Patch Network for Self-Supervised Real-World Denoisingcited by 37
  10. 2024Transfer CLIP for Generalizable Image Denoisingcited by 29
  11. 2021Noise2Fast: Fast Self-Supervised Single Image Blind Denoisingcited by 28
  12. 2023Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarioscited by 17
  13. 2023Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoisingcited by 15
  14. 2024Masked and Shuffled Blind Spot Denoising for Real-World Imagescited by 12
  15. 2024Asymmetric Mask Scheme for Self-Supervised Real Image Denoisingcited by 6
  16. 2024Masked Pre-training Enables Universal Zero-shot Denoisercited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.