# Unsupervised Deep Learning Methods for Biological Image Reconstruction and Enhancement

arXiv: https://arxiv.org/abs/2105.08040 · HTML: https://mlsanity.com/paper/2105.08040/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Builds on 43 of its 84 references that are in the map.
- First posted on arXiv 17 May 2021.

## Builds on (most cited first, 30 of 43)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Generative Modeling by Estimating Gradients of the Data Distribution](https://mlsanity.com/paper/1907.05600/) (2019)
- [Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distances](https://mlsanity.com/paper/1306.0895/) (2013)
- [Variational Inference with Normalizing Flows](https://mlsanity.com/paper/1505.05770/) (2015)
- [Conditional Generative Adversarial Nets](https://mlsanity.com/paper/1411.1784/) (2014)
- [Density estimation using Real NVP](https://mlsanity.com/paper/1605.08803/) (2016)
- [Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization](https://mlsanity.com/paper/1703.06868/) (2017)
- [Glow: Generative Flow with Invertible 1x1 Convolutions](https://mlsanity.com/paper/1807.03039/) (2018)
- [Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising](https://mlsanity.com/paper/1608.03981/) (2016)
- [Deep Image Prior](https://mlsanity.com/paper/1711.10925/) (2017)
- [NICE: Non-linear Independent Components Estimation](https://mlsanity.com/paper/1410.8516/) (2014)
- [Computational Optimal Transport](https://mlsanity.com/paper/1803.00567/) (2018)
- [Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey](https://mlsanity.com/paper/1902.06162/) (2019)
- [Noise2Noise: Learning Image Restoration without Clean Data](https://mlsanity.com/paper/1803.04189/) (2018)
- [f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization](https://mlsanity.com/paper/1606.00709/) (2016)
- [Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing](https://mlsanity.com/paper/1912.10557/) (2019)
- [Noise2Void - Learning Denoising from Single Noisy Images](https://mlsanity.com/paper/1811.10980/) (2018)
- [The Little Engine that Could: Regularization by Denoising (RED)](https://mlsanity.com/paper/1611.02862/) (2016)
- [Noise2Self: Blind Denoising by Self-Supervision](https://mlsanity.com/paper/1901.11365/) (2019)
- [Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applications](https://mlsanity.com/paper/1605.01710/) (2016)
- [High-Quality Self-Supervised Deep Image Denoising](https://mlsanity.com/paper/1901.10277/) (2019)
- [An Introduction to Deep Generative Modeling](https://mlsanity.com/paper/2103.05180/) (2021)
- [RARE: Image Reconstruction using Deep Priors Learned without Ground Truth](https://mlsanity.com/paper/1912.05854/) (2019)
- [Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising](https://mlsanity.com/paper/2010.11971/) (2020)
- [Zero-Shot Self-Supervised Learning for MRI Reconstruction](https://mlsanity.com/paper/2102.07737/) (2021)
- [Probabilistic Noise2Void: Unsupervised Content-Aware Denoising](https://mlsanity.com/paper/1906.00651/) (2019)
- [Explicitly disentangling image content from translation and rotation with spatial-VAE](https://mlsanity.com/paper/1909.11663/) (2019)
- [Unpaired Deep Learning for Accelerated MRI using Optimal Transport Driven CycleGAN](https://mlsanity.com/paper/2008.12967/) (2020)

## Built on by (most cited first, 17 of 17)

- [CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images](https://mlsanity.com/paper/2203.08138/) (2022)
- [Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstruction](https://mlsanity.com/paper/2209.00835/) (2022)
- [K-band: Self-supervised MRI Reconstruction via Stochastic Gradient Descent over K-space Subsets](https://mlsanity.com/paper/2308.02958/) (2023)
- [SelfCoLearn: Self-supervised collaborative learning for accelerating dynamic MR imaging](https://mlsanity.com/paper/2208.03904/) (2022)
- [PnP-CM: Consistency Models as Plug-and-Play Priors for Inverse Problems](https://mlsanity.com/paper/2509.22736/) (2025)
- [Unsupervised Knowledge-Transfer for Learned Image Reconstruction](https://mlsanity.com/paper/2107.02572/) (2021)
- [Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction](https://mlsanity.com/paper/2502.14009/) (2025)
- [UGoDIT: Unsupervised Group Deep Image Prior Via Transferable Weights](https://mlsanity.com/paper/2505.11720/) (2025)
- [Fast MRI for All: Bridging Access Gaps by Training without Raw Data](https://mlsanity.com/paper/2411.13022/) (2024)
- [Self-Supervised Deep Equilibrium Models for Inverse Problems with Theoretical Guarantees](https://mlsanity.com/paper/2210.03837/) (2022)
- [An Adaptive, Disentangled Representation for Multidimensional MRI Reconstruction](https://mlsanity.com/paper/2512.24674/) (2025)
- [Multi-Weight Respecification of Scan-specific Learning for Parallel Imaging](https://mlsanity.com/paper/2204.01979/) (2022)
- [Domino Denoise: An Accurate Blind Zero-Shot Denoiser using Domino Tilings](https://mlsanity.com/paper/2212.02439/) (2022)
- [Edge Computing for Physics-Driven AI in Computational MRI: A Feasibility Study](https://mlsanity.com/paper/2506.03183/) (2025)
- [PPFL-RDSN: Privacy-Preserving Federated Learning-based Residual Dense Spatial Networks for Encrypted Lossy Image Reconstruction](https://mlsanity.com/paper/2507.00230/) (2025)
- [Compressive Imaging Reconstruction via Tensor Decomposed Multi-Resolution Grid Encoding](https://mlsanity.com/paper/2507.07707/) (2025)
- [Harnessing Magnitude-Only and Complex Measurements for Improved Dynamic MRI Reconstruction with Learned Priors](https://mlsanity.com/paper/2608.18036/) (2026)

## Abstract (arXiv)

Recently, deep learning approaches have become the main research frontier for biological image reconstruction and enhancement problems thanks to their high performance, along with their ultra-fast inference times. However, due to the difficulty of obtaining matched reference data for supervised learning, there has been increasing interest in unsupervised learning approaches that do not need paired reference data. In particular, self-supervised learning and generative models have been successfully used for various biological imaging applications. In this paper, we overview these approaches from a coherent perspective in the context of classical inverse problems, and discuss their applications to biological imaging, including electron, fluorescence and deconvolution microscopy, optical diffraction tomography and functional neuroimaging.
