Prior Image-Constrained Reconstruction using Style-Based Generative Models
Not on the map. Why?
Abstract (arXiv)
Obtaining a useful estimate of an object from highly incomplete imaging measurements remains a holy grail of imaging science. Deep learning methods have shown promise in learning object priors or constraints to improve the conditioning of an ill-posed imaging inverse problem. In this study, a framework for estimating an object of interest that is semantically related to a known prior image, is proposed. An optimization problem is formulated in the disentangled latent space of a style-based generative model, and semantically meaningful constraints are imposed using the disentangled latent representation of the prior image. Stable recovery from incomplete measurements with the help of a prior image is theoretically analyzed. Numerical experiments demonstrating the superior performance of our approach as compared to related methods are presented.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 21 of its 40 references that are in the map. First posted on arXiv 24 Feb 2021.
Builds on
21 of 40 references.
References · 21
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Density estimation using Real NVPcited by 2,029
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2017Compressed Sensing using Generative Modelscited by 337
- 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
- 2019Invertible generative models for inverse problems: mitigating representation error and dataset biascited by 93
- 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
9 more
- 2020On hallucinations in tomographic image reconstructioncited by 66
- 2017Separating Style and Content for Generalized Style Transfercited by 64
- 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 50
- 2019Image-Adaptive GAN based Reconstructioncited by 36
- 2020Improving Inversion and Generation Diversity in StyleGAN using a Gaussianized Latent Spacecited by 34
- 2020Bayesian Image Reconstruction using Deep Generative Modelscited by 29
- 2020Compressible Latent-Space Invertible Networks for Generative Model-Constrained Image Reconstructioncited by 19
- 2019Fast and Provable ADMM for Learning with Generative Priorscited by 18
- 2019It GAN DO Better: GAN-based Detection of Objects on Images with Varying Qualitycited by 12
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 5; 2024: 3; 2025: 3.
19 papers.
Sort:
By area:
- 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 284
- 2023MRI Reconstruction with Side Information using Diffusion Modelscited by 15
- 2021Learning stochastic object models from medical imaging measurements by use of advanced ambient generative adversarial networkscited by 12
- 2022Assessing the ability of generative adversarial networks to learn canonical medical image statisticscited by 11
- 2022Score-Guided Intermediate Layer Optimization: Fast Langevin Mixing for Inverse Problemscited by 11
- 2023AmbientFlow: Invertible generative models from incomplete, noisy measurementscited by 11
- 2025A Trust-Guided Approach to MR Image Reconstruction with Side Informationcited by 6
- 2021Differentiable Gaussianization Layers for Inverse Problems Regularized by Deep Generative Modelscited by 3
- 2022Mining the manifolds of deep generative models for multiple data-consistent solutions of ill-posed tomographic imaging problemscited by 3
- 2023Deep Injective Prior for Inverse Scatteringcited by 3
- 2023High-Dimensional MR Reconstruction Integrating Subspace and Adaptive Generative Modelscited by 3
- 2024Back-Projection Diffusion: Solving the Wideband Inverse Scattering Problem with Diffusion Modelscited by 3
7 more
- 2022Prior image-based medical image reconstruction using a style-based generative adversarial networkcited by 2
- 2022Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imagingcited by 1
- 2024Latent Space Imagingcited by 1
- 2025Synthetic Generation and Latent Projection Denoising of Rim Lesions in Multiple Sclerosiscited by 1
- 2023Conditioning Generative Latent Optimization for Sparse-View CT Image Reconstructioncited by 0
- 2024Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstructioncited by 0
- 2025An Adaptive, Disentangled Representation for Multidimensional MRI Reconstructioncited by 0
- 2025An Adaptive, Disentangled Representation for Multidimensional MRI Reconstruction31 Dec 2025
- 2025Synthetic Generation and Latent Projection Denoising of Rim Lesions in Multiple Sclerosis29 May 2025
- 2025A Trust-Guided Approach to MR Image Reconstruction with Side Information6 Jan 2025
- 2024Back-Projection Diffusion: Solving the Wideband Inverse Scattering Problem with Diffusion Models5 Aug 2024
- 2024Latent Space Imaging9 Jul 2024
- 2024Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstruction12 Apr 2024
- 2023AmbientFlow: Invertible generative models from incomplete, noisy measurements9 Sep 2023
- 2023Conditioning Generative Latent Optimization for Sparse-View CT Image Reconstruction31 Jul 2023
- 2023High-Dimensional MR Reconstruction Integrating Subspace and Adaptive Generative Models14 Jun 2023
- 2023MRI Reconstruction with Side Information using Diffusion Models26 Mar 2023
- 2023Deep Injective Prior for Inverse Scattering8 Jan 2023
- 2022Score-Guided Intermediate Layer Optimization: Fast Langevin Mixing for Inverse Problems18 Jun 2022
7 more
- 2022Assessing the ability of generative adversarial networks to learn canonical medical image statistics26 Apr 2022
- 2022Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imaging7 Apr 2022
- 2022Prior image-based medical image reconstruction using a style-based generative adversarial network17 Feb 2022
- 2022Mining the manifolds of deep generative models for multiple data-consistent solutions of ill-posed tomographic imaging problems10 Feb 2022
- 2021Differentiable Gaussianization Layers for Inverse Problems Regularized by Deep Generative Models7 Dec 2021
- 2021Robust Compressed Sensing MRI with Deep Generative Priors3 Aug 2021
- 2021Learning stochastic object models from medical imaging measurements by use of advanced ambient generative adversarial networks27 Jun 2021
- 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 284
- 2021Learning stochastic object models from medical imaging measurements by use of advanced ambient generative adversarial networkscited by 12
- 2022Assessing the ability of generative adversarial networks to learn canonical medical image statisticscited by 11
- 2022Score-Guided Intermediate Layer Optimization: Fast Langevin Mixing for Inverse Problemscited by 11
- 2023AmbientFlow: Invertible generative models from incomplete, noisy measurementscited by 11
- 2025A Trust-Guided Approach to MR Image Reconstruction with Side Informationcited by 6
- 2022Mining the manifolds of deep generative models for multiple data-consistent solutions of ill-posed tomographic imaging problemscited by 3
- 2023Deep Injective Prior for Inverse Scatteringcited by 3
- 2023High-Dimensional MR Reconstruction Integrating Subspace and Adaptive Generative Modelscited by 3
- 2022Prior image-based medical image reconstruction using a style-based generative adversarial networkcited by 2
- 2022Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imagingcited by 1
- 2024Latent Space Imagingcited by 1
12 most cited of 16 All 16 (JSON)
- 2025An Adaptive, Disentangled Representation for Multidimensional MRI Reconstruction31 Dec 2025
- 2025Synthetic Generation and Latent Projection Denoising of Rim Lesions in Multiple Sclerosis29 May 2025
- 2025A Trust-Guided Approach to MR Image Reconstruction with Side Information6 Jan 2025
- 2024Latent Space Imaging9 Jul 2024
- 2024Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstruction12 Apr 2024
- 2023AmbientFlow: Invertible generative models from incomplete, noisy measurements9 Sep 2023
- 2023Conditioning Generative Latent Optimization for Sparse-View CT Image Reconstruction31 Jul 2023
- 2023High-Dimensional MR Reconstruction Integrating Subspace and Adaptive Generative Models14 Jun 2023
- 2023Deep Injective Prior for Inverse Scattering8 Jan 2023
- 2022Score-Guided Intermediate Layer Optimization: Fast Langevin Mixing for Inverse Problems18 Jun 2022
- 2022Assessing the ability of generative adversarial networks to learn canonical medical image statistics26 Apr 2022
- 2022Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imaging7 Apr 2022
12 newest of 16 All 16 (JSON)