DiffuseIR:Diffusion Models For Isotropic Reconstruction of 3D Microscopic Images
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Three-dimensional microscopy is often limited by anisotropic spatial resolution, resulting in lower axial resolution than lateral resolution. Current State-of-The-Art (SoTA) isotropic reconstruction methods utilizing deep neural networks can achieve impressive super-resolution performance in fixed imaging settings. However, their generality in practical use is limited by degraded performance caused by artifacts and blurring when facing unseen anisotropic factors. To address these issues, we propose DiffuseIR, an unsupervised method for isotropic reconstruction based on diffusion models. First, we pre-train a diffusion model to learn the structural distribution of biological tissue from lateral microscopic images, resulting in generating naturally high-resolution images. Then we use low-axial-resolution microscopy images to condition the generation process of the diffusion model and generate high-axial-resolution reconstruction results. Since the diffusion model learns the universal structural distribution of biological tissues, which is independent of the axial resolution, DiffuseIR can reconstruct authentic images with unseen low-axial resolutions into a high-axial resolution without requiring re-training. The proposed DiffuseIR achieves SoTA performance in experiments on EM data and can even compete with supervised methods.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 23 of its 33 references that are in the map. First posted on arXiv 21 Jun 2023.
Builds on
23 of 33 references.
Closest ancestors · 1
Same direction, newest first
- 2022Denoising Diffusion Restoration Models27 Jan
Other references · 22
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
- 2021Score-based diffusion models for accelerated MRIcited by 311
- 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 192
10 more
- 2017Domain Adaptation for Visual Applications: A Comprehensive Surveycited by 128
- 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
- 2022Towards performant and reliable undersampled MR reconstruction via diffusion model samplingcited by 60
- 2017Isotropic reconstruction of 3D fluorescence microscopy images using convolutional neural networkscited by 17
- 2021Overfitting the Data: Compact Neural Video Delivery via Content-aware Feature Modulationcited by 15
- 2017Deep Learning for Isotropic Super-Resolution from Non-Isotropic 3D Electron Microscopycited by 12
- 2019Three-dimensional virtual refocusing of fluorescence microscopy images using deep learningcited by 11
- 2021Deep learning enables reference-free isotropic super-resolution for volumetric fluorescence microscopycited by 8
- 2022Efficient Meta-Tuning for Content-aware Neural Video Deliverycited by 8
- 2014Brain-wide 3D imaging of neuronal activity in Caenorhabditis elegans with sculpted lightcited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 3.
9 papers.
- 2025TRACE: Temporally Reliable Anatomically-Conditioned 3D CT Generation with Enhanced Efficiencycited by 8
- 2024Super-resolution of biomedical volumes with 2D supervisioncited by 3
- 2024Reference-free Axial Super-resolution of 3D Microscopy Images using Implicit Neural Representation with a 2D Diffusion Priorcited by 3
- 2024From Diffusion to Resolution: Leveraging 2D Diffusion Models for 3D Super-Resolution Taskcited by 0
- 2025Volume Tells: Dual Cycle-Consistent Diffusion for 3D Fluorescence Microscopy De-noising and Super-Resolutioncited by 0
- 2025EMGauss: Continuous Slice-to-3D Reconstruction via Dynamic Gaussian Modeling in Volume Electron Microscopycited by 0
- 2026CRIS: Cross-Plane Self-Supervised Isotropic Restoration for Anisotropic Volumetric Imaging Across Modalitiescited by 0
- 2026SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopycited by 0
- 2026SWITi: Quantifying and Reducing Tiling Artifacts with Sliding Window Inner Tilingcited by 0
- 2026SWITi: Quantifying and Reducing Tiling Artifacts with Sliding Window Inner Tiling21 Jul 2026
- 2026SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopy29 Jun 2026
- 2026CRIS: Cross-Plane Self-Supervised Isotropic Restoration for Anisotropic Volumetric Imaging Across Modalities14 Jun 2026
- 2025EMGauss: Continuous Slice-to-3D Reconstruction via Dynamic Gaussian Modeling in Volume Electron Microscopy7 Dec 2025
- 2025TRACE: Temporally Reliable Anatomically-Conditioned 3D CT Generation with Enhanced Efficiency1 Jul 2025
- 2025Volume Tells: Dual Cycle-Consistent Diffusion for 3D Fluorescence Microscopy De-noising and Super-Resolution4 Mar 2025
- 2024From Diffusion to Resolution: Leveraging 2D Diffusion Models for 3D Super-Resolution Task25 Nov 2024
- 2024Reference-free Axial Super-resolution of 3D Microscopy Images using Implicit Neural Representation with a 2D Diffusion Prior16 Aug 2024
- 2024Super-resolution of biomedical volumes with 2D supervision15 Apr 2024
Similar, not cited
Close in wording, no citation either way
- 2024MicroDiffusion: Implicit Representation-Guided Diffusion for 3D Reconstruction from Limited 2D Microscopy Projections
- 2023Reference-Free Isotropic 3D EM Reconstruction using Diffusion Models
- 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance
- 2024Leveraging Multimodal Diffusion Models to Accelerate Imaging with Side Information
- 2025ZipIR: Latent Pyramid Diffusion Transformer for High-Resolution Image Restoration
- 2022ADIR: Adaptive Diffusion for Image Reconstruction
- 2026Three-Step Conditional Diffusion 3D Reconstruction for Light-Field Microscopy
- 2024Diffusion Models to Enhance the Resolution of Microscopy Images: A Tutorial