# ReconU-Net: a direct PET image reconstruction using U-Net architecture with back projection-induced skip connection

arXiv: https://arxiv.org/abs/2312.02494 · HTML: https://mlsanity.com/paper/2312.02494/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 7 of its 36 references that are in the map.
- First posted on arXiv 5 Dec 2023.

## Builds on (most cited first, 7 of 7)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Image reconstruction by domain transform manifold learning](https://mlsanity.com/paper/1704.08841/) (2017)
- [DeepPET: A deep encoder-decoder network for directly solving the PET reconstruction inverse problem](https://mlsanity.com/paper/1804.07851/) (2018)
- [Iterative PET Image Reconstruction Using Convolutional Neural Network Representation](https://mlsanity.com/paper/1710.03344/) (2017)
- [Direct PET Image Reconstruction Incorporating Deep Image Prior and a Forward Projection Model](https://mlsanity.com/paper/2109.00768/) (2021)
- [List-Mode PET Image Reconstruction Using Deep Image Prior](https://mlsanity.com/paper/2204.13404/) (2022)
- [Fully 3D Implementation of the End-to-end Deep Image Prior-based PET Image Reconstruction Using Block Iterative Algorithm](https://mlsanity.com/paper/2212.11844/) (2022)

## Abstract (arXiv)

[Objective] This study aims to introduce a novel back projection-induced U-Net-shaped architecture, called ReconU-Net, for deep learning-based direct positron emission tomography (PET) image reconstruction. Additionally, our objective is to analyze the behavior of direct PET image reconstruction and gain deeper insights by comparing the proposed ReconU-Net architecture with other encoder-decoder architectures without skip connections. [Approach] The proposed ReconU-Net architecture uniquely integrates the physical model of the back projection operation into the skip connection. This distinctive feature facilitates the effective transfer of intrinsic spatial information from the input sinogram to the reconstructed image via an embedded physical model. The proposed ReconU-Net was trained using Monte Carlo simulation data from the Brainweb phantom and tested on both simulated and real Hoffman brain phantom data. [Main results] The proposed ReconU-Net method generated a reconstructed image with a more accurate structure compared to other deep learning-based direct reconstruction methods. Further analysis showed that the proposed ReconU-Net architecture has the ability to transfer features of multiple resolutions, especially non-abstract high-resolution information, through skip connections. Despite limited training on simulated data, the proposed ReconU-Net successfully reconstructed the real Hoffman brain phantom, unlike other deep learning-based direct reconstruction methods, which failed to produce a reconstructed image. [Significance] The proposed ReconU-Net can improve the fidelity of direct PET image reconstruction, even when dealing with small training datasets, by leveraging the synergistic relationship between data-driven modeling and the physics model of the imaging process.