mlsanityData to 14 Oct 2026

DiffuseIR:Diffusion Models For Isotropic Reconstruction of 3D Microscopic Images

arXiv 2306.12109 ↗First posted 21 Jun 2023eess.IV cs.CVcited by 9

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Three-dimensional microscopy is often limited by anisotropic spatial resolution, resulting in lower axial resolution than lateral resolution. Current State-of-The-Art (SoTA) isotropic reconstruction methods utilizing deep neural networks can achieve impressive super-resolution performance in fixed imaging settings. However, their generality in practical use is limited by degraded performance caused by artifacts and blurring when facing unseen anisotropic factors. To address these issues, we propose DiffuseIR, an unsupervised method for isotropic reconstruction based on diffusion models. First, we pre-train a diffusion model to learn the structural distribution of biological tissue from lateral microscopic images, resulting in generating naturally high-resolution images. Then we use low-axial-resolution microscopy images to condition the generation process of the diffusion model and generate high-axial-resolution reconstruction results. Since the diffusion model learns the universal structural distribution of biological tissues, which is independent of the axial resolution, DiffuseIR can reconstruct authentic images with unseen low-axial resolutions into a high-axial resolution without requiring re-training. The proposed DiffuseIR achieves SoTA performance in experiments on EM data and can even compete with supervised methods.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 23 of its 33 references that are in the map. First posted on arXiv 21 Jun 2023.

Builds on

23 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Denoising Diffusion Restoration Models27 Jan

Other references · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  6. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  7. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  8. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  9. 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
  10. 2021Score-based diffusion models for accelerated MRIcited by 311
  11. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
  12. 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 192
10 more
  1. 2017Domain Adaptation for Visual Applications: A Comprehensive Surveycited by 128
  2. 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
  3. 2022Towards performant and reliable undersampled MR reconstruction via diffusion model samplingcited by 60
  4. 2017Isotropic reconstruction of 3D fluorescence microscopy images using convolutional neural networkscited by 17
  5. 2021Overfitting the Data: Compact Neural Video Delivery via Content-aware Feature Modulationcited by 15
  6. 2017Deep Learning for Isotropic Super-Resolution from Non-Isotropic 3D Electron Microscopycited by 12
  7. 2019Three-dimensional virtual refocusing of fluorescence microscopy images using deep learningcited by 11
  8. 2021Deep learning enables reference-free isotropic super-resolution for volumetric fluorescence microscopycited by 8
  9. 2022Efficient Meta-Tuning for Content-aware Neural Video Deliverycited by 8
  10. 2014Brain-wide 3D imaging of neuronal activity in Caenorhabditis elegans with sculpted lightcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 3; 2026: 3.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024MicroDiffusion: Implicit Representation-Guided Diffusion for 3D Reconstruction from Limited 2D Microscopy Projections
  2. 2023Reference-Free Isotropic 3D EM Reconstruction using Diffusion Models
  3. 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance
  4. 2024Leveraging Multimodal Diffusion Models to Accelerate Imaging with Side Information
  5. 2025ZipIR: Latent Pyramid Diffusion Transformer for High-Resolution Image Restoration
  6. 2022ADIR: Adaptive Diffusion for Image Reconstruction
  7. 2026Three-Step Conditional Diffusion 3D Reconstruction for Light-Field Microscopy
  8. 2024Diffusion Models to Enhance the Resolution of Microscopy Images: A Tutorial