# Diffusion assisted image reconstruction in optoacoustic tomography

arXiv: https://arxiv.org/abs/2404.10239 · HTML: https://mlsanity.com/paper/2404.10239/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models.
- Builds on 25 of its 59 references that are in the map.
- First posted on arXiv 16 Apr 2024.

## Placed in

- Diffusion models / [Medical imaging and segmentation](https://mlsanity.com/diffusion/medical-imaging-and-segmentation/)

## Builds on (most cited first, 25 of 25)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [Denoising Diffusion Implicit Models](https://mlsanity.com/paper/2010.02502/) (2020)
- [Diffusion Models Beat GANs on Image Synthesis](https://mlsanity.com/paper/2105.05233/) (2021)
- [Deep Unsupervised Learning using Nonequilibrium Thermodynamics](https://mlsanity.com/paper/1503.03585/) (2015)
- [Improved Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2102.09672/) (2021)
- [Cascaded Diffusion Models for High Fidelity Image Generation](https://mlsanity.com/paper/2106.15282/) (2021)
- [Solving Inverse Problems in Medical Imaging with Score-Based Generative Models](https://mlsanity.com/paper/2111.08005/) (2021)
- [Score-Based Diffusion Models as Principled Priors for Inverse Imaging](https://mlsanity.com/paper/2304.11751/) (2023)
- [Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removal](https://mlsanity.com/paper/1808.10848/) (2018)
- [Model based learning for accelerated, limited-view 3D photoacoustic tomography](https://mlsanity.com/paper/1708.09832/) (2017)
- [Solving Inverse Problems with Score-Based Generative Priors learned from Noisy Data](https://mlsanity.com/paper/2305.01166/) (2023)
- [Solving Bayesian Inverse Problems via Variational Autoencoders](https://mlsanity.com/paper/1912.04212/) (2019)
- [Deep Learning in Photoacoustic Tomography: Current approaches and future directions](https://mlsanity.com/paper/2009.07608/) (2020)
- [RAVIR: A Dataset and Methodology for the Semantic Segmentation and Quantitative Analysis of Retinal Arteries and Veins in Infrared Reflectance Imaging](https://mlsanity.com/paper/2203.14928/) (2022)
- [SPIRiT-Diffusion: Self-Consistency Driven Diffusion Model for Accelerated MRI](https://mlsanity.com/paper/2304.05060/) (2023)
- [j-Wave: An open-source differentiable wave simulator](https://mlsanity.com/paper/2207.01499/) (2022)
- [Utilizing variational autoencoders in the Bayesian inverse problem of photoacoustic tomography](https://mlsanity.com/paper/2204.06270/) (2022)
- [On the robustness of model-based algorithms for photoacoustic tomography: comparison between time and frequency domains](https://mlsanity.com/paper/2109.14028/) (2021)
- [Invariant Representations in Deep Learning for Optoacoustic Imaging](https://mlsanity.com/paper/2305.00335/) (2023)
- [Combining band-frequency separation and deep neural networks for optoacoustic imaging](https://mlsanity.com/paper/2210.08099/) (2022)

## Built on by (most cited first, 1 of 1)

- [Using Spatial Diffusions for Optoacoustic Tomography Image Reconstruction](https://mlsanity.com/paper/2411.15156/) (2024)

## Abstract (arXiv)

In this paper we consider the problem of acoustic inversion in the context of the optoacoustic tomography image reconstruction problem. By leveraging the ability of the recently proposed diffusion models for image generative tasks among others, we devise an image reconstruction architecture based on a conditional diffusion process. The scheme makes use of an initial image reconstruction, which is preprocessed by an autoencoder to generate an adequate representation. This representation is used as conditional information in a generative diffusion process. Although the computational requirements for training and implementing the architecture are not low, several design choices discussed in the work were made to keep them manageable. Numerical results show that the conditional information allows to properly bias the parameters of the diffusion model to improve the quality of the initial reconstructed image, eliminating artifacts or even reconstructing finer details of the ground-truth image that are not recoverable by the initial image reconstruction method. We also tested the proposal under experimental conditions and the obtained results were in line with those corresponding to the numerical simulations. Improvements in image quality up to 17 % in terms of peak signal-to-noise ratio were observed.