Diffusion assisted image reconstruction in optoacoustic tomography
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
In this paper we consider the problem of acoustic inversion in the context of the optoacoustic tomography image reconstruction problem. By leveraging the ability of the recently proposed diffusion models for image generative tasks among others, we devise an image reconstruction architecture based on a conditional diffusion process. The scheme makes use of an initial image reconstruction, which is preprocessed by an autoencoder to generate an adequate representation. This representation is used as conditional information in a generative diffusion process. Although the computational requirements for training and implementing the architecture are not low, several design choices discussed in the work were made to keep them manageable. Numerical results show that the conditional information allows to properly bias the parameters of the diffusion model to improve the quality of the initial reconstructed image, eliminating artifacts or even reconstructing finer details of the ground-truth image that are not recoverable by the initial image reconstruction method. We also tested the proposal under experimental conditions and the obtained results were in line with those corresponding to the numerical simulations. Improvements in image quality up to 17 % in terms of peak signal-to-noise ratio were observed.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 25 of its 59 references that are in the map. First posted on arXiv 16 Apr 2024.
Builds on
25 of 59 references.
Closest ancestors · 2
Same direction, newest first
- 2023SPIRiT-Diffusion: Self-Consistency Driven Diffusion Model for Accelerated MRI11 Apr
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Models15 Nov
Other references · 23
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2023Score-Based Diffusion Models as Principled Priors for Inverse Imagingcited by 126
11 more
- 2018Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removalcited by 56
- 2017Model based learning for accelerated, limited-view 3D photoacoustic tomographycited by 45
- 2023Solving Inverse Problems with Score-Based Generative Priors learned from Noisy Datacited by 40
- 2019Solving Bayesian Inverse Problems via Variational Autoencoderscited by 32
- 2020Deep Learning in Photoacoustic Tomography: Current approaches and future directionscited by 25
- 2022RAVIR: A Dataset and Methodology for the Semantic Segmentation and Quantitative Analysis of Retinal Arteries and Veins in Infrared Reflectance Imagingcited by 12
- 2022j-Wave: An open-source differentiable wave simulatorcited by 9
- 2022Utilizing variational autoencoders in the Bayesian inverse problem of photoacoustic tomographycited by 5
- 2021On the robustness of model-based algorithms for photoacoustic tomography: comparison between time and frequency domainscited by 2
- 2023Invariant Representations in Deep Learning for Optoacoustic Imagingcited by 2
- 2022Combining band-frequency separation and deep neural networks for optoacoustic imagingcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Score-Based Diffusion Models for Photoacoustic Tomography Image Reconstruction
- 2024Ultrasound Imaging based on the Variance of a Diffusion Restoration Model
- 2023Single PW takes a shortcut to compound PW in US imaging
- 2023Diffusion Reconstruction of Ultrasound Images with Informative Uncertainty
- 2026DiffSOS: Acoustic Conditional Diffusion Model for Speed-of-Sound Reconstruction in Ultrasound Computed Tomography
- 2023Fast Sampling generative model for Ultrasound image reconstruction
- 2024Diffusion Posterior Proximal Sampling for Image Restoration
- 2024Sequential Posterior Sampling with Diffusion Models