mlsanityData to 14 Oct 2026

Cross-domain Self-supervised Framework for Photoacoustic Computed Tomography Image Reconstruction

arXiv 2301.06681 ↗First posted 17 Jan 2023eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate image reconstruction is crucial for photoacoustic (PA) computed tomography (PACT). Recently, deep learning has been used to reconstruct the PA image with a supervised scheme, which requires high-quality images as ground truth labels. In practice, there are inevitable trade-offs between cost and performance since the use of more channels is an expensive strategy to access more measurements. Here, we propose a cross-domain unsupervised reconstruction (CDUR) strategy with a pure transformer model, which overcomes the lack of ground truth labels from limited PA measurements. The proposed approach exploits the equivariance of PACT to achieve high performance with a smaller number of channels. We implement a self-supervised reconstruction in a model-based form. Meanwhile, we also leverage the self-supervision to enforce the measurement and image consistency on three partitions of measured PA data, by randomly masking different channels. We find that dynamically masking a high proportion of the channels, e.g., 80%, yields nontrivial self-supervisors in both image and signal domains, which decrease the multiplicity of the pseudo solution to efficiently reconstruct the image from fewer PA measurements with minimum error of the image. Experimental results on in-vivo PACT dataset of mice demonstrate the potential of our unsupervised framework. In addition, our method shows a high performance (0.83 structural similarity index (SSIM) in the extreme sparse case with 13 channels), which is close to that of supervised scheme (0.77 SSIM with 16 channels). On top of all the advantages, our method may be deployed on different trainable models in an end-to-end manner.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 69 references that are in the map. First posted on arXiv 17 Jan 2023.

Builds on

20 of 69 references.

References · 20

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2017Image reconstruction by domain transform manifold learningcited by 232
  6. 2022Inception Transformercited by 99
  7. 2018NETT: Solving Inverse Problems with Deep Neural Networkscited by 89
  8. 2021Equivariant Imaging: Learning Beyond the Range Spacecited by 83
  9. 2018Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removalcited by 57
  10. 2017Model based learning for accelerated, limited-view 3D photoacoustic tomographycited by 45
  11. 2020Deep Learning in Photoacoustic Tomography: Current approaches and future directionscited by 25
  12. 2017Deep Learning for Photoacoustic Tomography from Sparse Datacited by 17
8 more
  1. 2020Deep Learning for Biomedical Image Reconstruction: A Surveycited by 17
  2. 2019Limited View and Sparse Photoacoustic Tomography for Neuroimaging with Deep Learningcited by 11
  3. 2019A Partially Learned Algorithm for Joint Photoacoustic Reconstruction and Segmentationcited by 10
  4. 2019Simultaneous reconstruction of the initial pressure and sound speed in photoacoustic tomography using a deep-learning approachcited by 5
  5. 2020Deep-learning Image Reconstruction for Real-time Photoacoustic Systemcited by 5
  6. 2020Sinogram super-resolution and denoising convolutional neural network (SRCN) for limited data photoacoustic tomographycited by 4
  7. 2020Deep Learning Improves Contrast in Low-Fluence Photoacoustic Imagingcited by 3
  8. 2021AS-Net: Fast Photoacoustic Reconstruction with Multi-feature Fusion from Sparse Datacited by 3

Built on by

Not cited yet.