mlsanityData to 7 Oct 2026

Conditioning Generative Latent Optimization for Sparse-View CT Image Reconstruction

arXiv 2307.16670 ↗First posted 31 Jul 2023cs.CV eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Computed Tomography (CT) is a prominent example of Imaging Inverse Problem highlighting the unrivaled performances of data-driven methods in degraded measurements setups like sparse X-ray projections. Although a significant proportion of deep learning approaches benefit from large supervised datasets, they cannot generalize to new experimental setups. In contrast, fully unsupervised techniques, most notably using score-based generative models, have recently demonstrated similar or better performances compared to supervised approaches while being flexible at test time. However, their use cases are limited as they need considerable amounts of training data to have good generalization properties. Another unsupervised approach taking advantage of the implicit natural bias of deep convolutional networks, Deep Image Prior, has recently been adapted to solve sparse CT by reparameterizing the reconstruction problem. Although this methodology does not require any training dataset, it enforces a weaker prior on the reconstructions when compared to data-driven methods. To fill the gap between these two strategies, we propose an unsupervised conditional approach to the Generative Latent Optimization framework (cGLO). Similarly to DIP, without any training dataset, cGLO benefits from the structural bias of a decoder network. However, the prior is further reinforced as the effect of a likelihood objective shared between multiple slices being reconstructed simultaneously through the same decoder network. In addition, the parameters of the decoder may be initialized on an unsupervised, and eventually very small, training dataset to enhance the reconstruction. The resulting approach is tested on full-dose sparse-view CT using multiple training dataset sizes and varying numbers of viewing angles.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 61 references that are in the map. First posted on arXiv 31 Jul 2023.

Builds on

47 of 61 references.

References · 47

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Generative Adversarial Networkscited by 5,603
  7. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  9. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  10. 2023Consistency Modelscited by 1,778
  11. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  12. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
35 more
  1. 2017Deep Image Priorcited by 1,097
  2. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  3. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  4. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  5. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  6. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  7. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  8. 2021GAN Inversion: A Surveycited by 366
  9. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  10. 2016Adversarial Feature Learningcited by 350
  11. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  12. 2017Don't Decay the Learning Rate, Increase the Batch Sizecited by 313
  13. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
  14. 2015A note on the evaluation of generative modelscited by 291
  15. 2017Learned Primal-dual Reconstructioncited by 251
  16. 2017Image reconstruction by domain transform manifold learningcited by 231
  17. 2016Adversarially Learned Inferencecited by 216
  18. 2017Optimizing the Latent Space of Generative Networkscited by 157
  19. 2019Seeing What a GAN Cannot Generatecited by 148
  20. 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
  21. 2016Invertible Conditional GANs for image editingcited by 118
  22. 2022Parallel Diffusion Models of Operator and Image for Blind Inverse Problemscited by 113
  23. 2020Transforming and Projecting Images into Class-conditional Generative Networkscited by 76
  24. 2022DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstructioncited by 73
  25. 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
  26. 2018Deep Bayesian Inversioncited by 60
  27. 2020Computed Tomography Reconstruction Using Deep Image Prior and Learned Reconstruction Methodscited by 56
  28. 2018Deep-neural-network based sinogram synthesis for sparse-view CT image reconstructioncited by 47
  29. 2019Denoising and Regularization via Exploiting the Structural Bias of Convolutional Generatorscited by 40
  30. 2019The Spectral Bias of the Deep Image Priorcited by 20
  31. 2017It Takes (Only) Two: Adversarial Generator-Encoder Networkscited by 19
  32. 2018Non-Adversarial Image Synthesis with Generative Latent Nearest Neighborscited by 19
  33. 2021Prior Image-Constrained Reconstruction using Style-Based Generative Modelscited by 19
  34. 2019Disentangled Inference for GANs with Latently Invertible Autoencodercited by 10
  35. 20202-Step Sparse-View CT Reconstruction with a Domain-Specific Perceptual Networkcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Diffusion-Based Generative Prior Approach to Sparse-view Computed Tomography
  2. 2022Generative Modeling in Sinogram Domain for Sparse-view CT Reconstruction
  3. 2026Conditional Diffusion Posterior Alignment for Sparse-View CT Reconstruction
  4. 2025Pseudoinverse Diffusion Models for Generative CT Image Reconstruction from Low Dose Data
  5. 2023Data-iterative Optimization Score Model for Stable Ultra-Sparse-View CT Reconstruction
  6. 2026Towards reconstructing experimental sparse-view X-ray CT data with diffusion models
  7. 2024Iterative CT Reconstruction via Latent Variable Optimization of Shallow Diffusion Models
  8. 2024CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates