Conditioning Generative Latent Optimization for Sparse-View CT Image Reconstruction
Not on the map. Why?
Abstract (arXiv)
Computed Tomography (CT) is a prominent example of Imaging Inverse Problem highlighting the unrivaled performances of data-driven methods in degraded measurements setups like sparse X-ray projections. Although a significant proportion of deep learning approaches benefit from large supervised datasets, they cannot generalize to new experimental setups. In contrast, fully unsupervised techniques, most notably using score-based generative models, have recently demonstrated similar or better performances compared to supervised approaches while being flexible at test time. However, their use cases are limited as they need considerable amounts of training data to have good generalization properties. Another unsupervised approach taking advantage of the implicit natural bias of deep convolutional networks, Deep Image Prior, has recently been adapted to solve sparse CT by reparameterizing the reconstruction problem. Although this methodology does not require any training dataset, it enforces a weaker prior on the reconstructions when compared to data-driven methods. To fill the gap between these two strategies, we propose an unsupervised conditional approach to the Generative Latent Optimization framework (cGLO). Similarly to DIP, without any training dataset, cGLO benefits from the structural bias of a decoder network. However, the prior is further reinforced as the effect of a likelihood objective shared between multiple slices being reconstructed simultaneously through the same decoder network. In addition, the parameters of the decoder may be initialized on an unsupervised, and eventually very small, training dataset to enhance the reconstruction. The resulting approach is tested on full-dose sparse-view CT using multiple training dataset sizes and varying numbers of viewing angles.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 61 references that are in the map. First posted on arXiv 31 Jul 2023.
Builds on
47 of 61 references.
References · 47
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Generative Adversarial Networkscited by 5,603
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2023Consistency Modelscited by 1,778
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
35 more
- 2017Deep Image Priorcited by 1,097
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
- 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2021GAN Inversion: A Surveycited by 366
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2016Adversarial Feature Learningcited by 350
- 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
- 2017Don't Decay the Learning Rate, Increase the Batch Sizecited by 313
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
- 2015A note on the evaluation of generative modelscited by 291
- 2017Learned Primal-dual Reconstructioncited by 251
- 2017Image reconstruction by domain transform manifold learningcited by 231
- 2016Adversarially Learned Inferencecited by 216
- 2017Optimizing the Latent Space of Generative Networkscited by 157
- 2019Seeing What a GAN Cannot Generatecited by 148
- 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
- 2016Invertible Conditional GANs for image editingcited by 118
- 2022Parallel Diffusion Models of Operator and Image for Blind Inverse Problemscited by 113
- 2020Transforming and Projecting Images into Class-conditional Generative Networkscited by 76
- 2022DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstructioncited by 73
- 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
- 2018Deep Bayesian Inversioncited by 60
- 2020Computed Tomography Reconstruction Using Deep Image Prior and Learned Reconstruction Methodscited by 56
- 2018Deep-neural-network based sinogram synthesis for sparse-view CT image reconstructioncited by 47
- 2019Denoising and Regularization via Exploiting the Structural Bias of Convolutional Generatorscited by 40
- 2019The Spectral Bias of the Deep Image Priorcited by 20
- 2017It Takes (Only) Two: Adversarial Generator-Encoder Networkscited by 19
- 2018Non-Adversarial Image Synthesis with Generative Latent Nearest Neighborscited by 19
- 2021Prior Image-Constrained Reconstruction using Style-Based Generative Modelscited by 19
- 2019Disentangled Inference for GANs with Latently Invertible Autoencodercited by 10
- 20202-Step Sparse-View CT Reconstruction with a Domain-Specific Perceptual Networkcited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A Diffusion-Based Generative Prior Approach to Sparse-view Computed Tomography
- 2022Generative Modeling in Sinogram Domain for Sparse-view CT Reconstruction
- 2026Conditional Diffusion Posterior Alignment for Sparse-View CT Reconstruction
- 2025Pseudoinverse Diffusion Models for Generative CT Image Reconstruction from Low Dose Data
- 2023Data-iterative Optimization Score Model for Stable Ultra-Sparse-View CT Reconstruction
- 2026Towards reconstructing experimental sparse-view X-ray CT data with diffusion models
- 2024Iterative CT Reconstruction via Latent Variable Optimization of Shallow Diffusion Models
- 2024CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates