# Assessing the ability of generative adversarial networks to learn canonical medical image statistics

arXiv: https://arxiv.org/abs/2204.12007 · HTML: https://mlsanity.com/paper/2204.12007/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 32 of its 71 references that are in the map.
- First posted on arXiv 26 Apr 2022.

## Builds on (most cited first, 30 of 32)

- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [Generative Adversarial Networks](https://mlsanity.com/paper/2203.00667/) (2022)
- [Rethinking the Inception Architecture for Computer Vision](https://mlsanity.com/paper/1512.00567/) (2015)
- [Analyzing and Improving the Image Quality of StyleGAN](https://mlsanity.com/paper/1912.04958/) (2019)
- [Progressive Growing of GANs for Improved Quality, Stability, and Variation](https://mlsanity.com/paper/1710.10196/) (2017)
- [Improved Techniques for Training GANs](https://mlsanity.com/paper/1606.03498/) (2016)
- [Alias-Free Generative Adversarial Networks](https://mlsanity.com/paper/2106.12423/) (2021)
- [Towards Principled Methods for Training Generative Adversarial Networks](https://mlsanity.com/paper/1701.04862/) (2017)
- [Robust Compressed Sensing MRI with Deep Generative Priors](https://mlsanity.com/paper/2108.01368/) (2021)
- [A Note on the Inception Score](https://mlsanity.com/paper/1801.01973/) (2018)
- [Pros and Cons of GAN Evaluation Measures](https://mlsanity.com/paper/1802.03446/) (2018)
- [A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications](https://mlsanity.com/paper/2001.06937/) (2020)
- [Pros and Cons of GAN Evaluation Measures: New Developments](https://mlsanity.com/paper/2103.09396/) (2021)
- [Distribution Matching Losses Can Hallucinate Features in Medical Image Translation](https://mlsanity.com/paper/1805.08841/) (2018)
- [CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN-CIRCLE)](https://mlsanity.com/paper/1808.04256/) (2018)
- [On hallucinations in tomographic image reconstruction](https://mlsanity.com/paper/2012.00646/) (2020)
- [MADGAN: unsupervised Medical Anomaly Detection GAN using multiple adjacent brain MRI slice reconstruction](https://mlsanity.com/paper/2007.13559/) (2020)
- [Unsupervised Medical Image Translation Using Cycle-MedGAN](https://mlsanity.com/paper/1903.03374/) (2019)
- [Overcoming Barriers to Data Sharing with Medical Image Generation: A Comprehensive Evaluation](https://mlsanity.com/paper/2012.03769/) (2020)
- [3D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Images](https://mlsanity.com/paper/2107.09700/) (2021)
- [Assessing the Impact of Deep Neural Network-based Image Denoising on Binary Signal Detection Tasks](https://mlsanity.com/paper/2104.14037/) (2021)
- [Compressible Latent-Space Invertible Networks for Generative Model-Constrained Image Reconstruction](https://mlsanity.com/paper/2007.02462/) (2020)
- [Prior Image-Constrained Reconstruction using Style-Based Generative Models](https://mlsanity.com/paper/2102.12525/) (2021)
- [Objective task-based evaluation of artificial intelligence-based medical imaging methods: Framework, strategies and role of the physician](https://mlsanity.com/paper/2107.04540/) (2021)
- [Deep Generative Models in the Real-World: An Open Challenge from Medical Imaging](https://mlsanity.com/paper/1806.05452/) (2018)
- [Learning stochastic object models from medical imaging measurements by use of advanced ambient generative adversarial networks](https://mlsanity.com/paper/2106.14324/) (2021)
- [Medical image reconstruction with image-adaptive priors learned by use of generative adversarial networks](https://mlsanity.com/paper/2001.10830/) (2020)
- [Impact of deep learning-based image super-resolution on binary signal detection](https://mlsanity.com/paper/2107.02338/) (2021)
- [Markov-Chain Monte Carlo Approximation of the Ideal Observer using Generative Adversarial Networks](https://mlsanity.com/paper/2001.09526/) (2020)
- [Evaluation of Deep Convolutional Generative Adversarial Networks for data augmentation of chest X-ray images](https://mlsanity.com/paper/2009.01181/) (2020)

## Built on by (most cited first, 11 of 11)

- [AmbientFlow: Invertible generative models from incomplete, noisy measurements](https://mlsanity.com/paper/2309.04856/) (2023)
- [Assessing the capacity of a denoising diffusion probabilistic model to reproduce spatial context](https://mlsanity.com/paper/2309.10817/) (2023)
- [Synthetic Data in Radiological Imaging: Current State and Future Outlook](https://mlsanity.com/paper/2407.01561/) (2024)
- [Ideal Observer Computation by Use of Markov-Chain Monte Carlo with Generative Adversarial Networks](https://mlsanity.com/paper/2304.00433/) (2023)
- [Report on the AAPM Grand Challenge on deep generative modeling for learning medical image statistics](https://mlsanity.com/paper/2405.01822/) (2024)
- [Shifts in Doctors' Eye Movements Between Real and AI-Generated Medical Images](https://mlsanity.com/paper/2504.15007/) (2025)
- [T-SYNTH: A Knowledge-Based Dataset of Synthetic Breast Images](https://mlsanity.com/paper/2507.04038/) (2025)
- [Hallucinations in medical devices](https://mlsanity.com/paper/2508.14118/) (2025)
- [Knowledge-based anomaly detection for identifying network-induced shape artifacts](https://mlsanity.com/paper/2511.04729/) (2025)
- [Not all Jensen-Shannon Divergence Estimators are Equal](https://mlsanity.com/paper/2606.16411/) (2026)
- [M3-Score: Fidelity, Memorization and Coverage as Separate Axes for Evaluating Generative Radiology Image Models](https://mlsanity.com/paper/2609.33769/) (2026)

## Abstract (arXiv)

In recent years, generative adversarial networks (GANs) have gained tremendous popularity for potential applications in medical imaging, such as medical image synthesis, restoration, reconstruction, translation, as well as objective image quality assessment. Despite the impressive progress in generating high-resolution, perceptually realistic images, it is not clear if modern GANs reliably learn the statistics that are meaningful to a downstream medical imaging application. In this work, the ability of a state-of-the-art GAN to learn the statistics of canonical stochastic image models (SIMs) that are relevant to objective assessment of image quality is investigated. It is shown that although the employed GAN successfully learned several basic first- and second-order statistics of the specific medical SIMs under consideration and generated images with high perceptual quality, it failed to correctly learn several per-image statistics pertinent to the these SIMs, highlighting the urgent need to assess medical image GANs in terms of objective measures of image quality.
