Multi-scale Conditional Generative Modeling for Microscopic Image Restoration
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
The advance of diffusion-based generative models in recent years has revolutionized state-of-the-art (SOTA) techniques in a wide variety of image analysis and synthesis tasks, whereas their adaptation on image restoration, particularly within computational microscopy remains theoretically and empirically underexplored. In this research, we introduce a multi-scale generative model that enhances conditional image restoration through a novel exploitation of the Brownian Bridge process within wavelet domain. By initiating the Brownian Bridge diffusion process specifically at the lowest-frequency subband and applying generative adversarial networks at subsequent multi-scale high-frequency subbands in the wavelet domain, our method provides significant acceleration during training and sampling while sustaining a high image generation quality and diversity on par with SOTA diffusion models. Experimental results on various computational microscopy and imaging tasks confirm our method's robust performance and its considerable reduction in its sampling steps and time. This pioneering technique offers an efficient image restoration framework that harmonizes efficiency with quality, signifying a major stride in incorporating cutting-edge generative models into computational microscopy workflows.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 44 of its 73 references that are in the map. First posted on arXiv 7 Jul 2024.
Builds on
44 of 73 references.
Closest ancestors · 2
Same direction, newest first
- 2023Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Models17 Apr
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models30 Apr
Other references · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
30 more
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
- 2022Simple Baselines for Image Restorationcited by 701
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2020A Review on Generative Adversarial Networks: Algorithms, Theory, and Applicationscited by 209
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
- 2023Image Restoration with Mean-Reverting Stochastic Differential Equationscited by 182
- 2021On Fast Sampling of Diffusion Probabilistic Modelscited by 170
- 2017Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Losscited by 161
- 2017Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removalcited by 160
- 2022Wavelet Diffusion Models are fast and scalable Image Generatorscited by 116
- 2019Towards Ghost-free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GANcited by 102
- 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
- 2022DC-ShadowNet: Single-Image Hard and Soft Shadow Removal Using Unsupervised Domain-Classifier Guided Networkcited by 68
- 2022Wavelet Score-Based Generative Modelingcited by 61
- 2018Direction-aware Spatial Context Features for Shadow Detection and Removalcited by 58
- 2018Image Colorization with Generative Adversarial Networkscited by 24
- 2022Half Wavelet Attention on M-Net+ for Low-Light Image Enhancementcited by 20
- 2019Three-dimensional virtual refocusing of fluorescence microscopy images using deep learningcited by 11
- 2023Coupled Multiwavelet Neural Operator Learning for Coupled Partial Differential Equationscited by 10
- 2022DiffGAR: Model-Agnostic Restoration from Generative Artifacts Using Image-to-Image Diffusion Modelscited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement
- 2024Denoising diffusion models for high-resolution microscopy image restoration
- 2023Low-Light Image Enhancement with Wavelet-based Diffusion Models
- 2024Diffusion Models to Enhance the Resolution of Microscopy Images: A Tutorial
- 2024Diffusion Posterior Proximal Sampling for Image Restoration
- 2023A Unified Conditional Framework for Diffusion-based Image Restoration
- 2023Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge