# Learning stochastic object models from medical imaging measurements by use of advanced ambient generative adversarial networks

arXiv: https://arxiv.org/abs/2106.14324 · HTML: https://mlsanity.com/paper/2106.14324/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- Builds on 26 of its 74 references that are in the map.
- First posted on arXiv 27 Jun 2021.

## Builds on (most cited first, 26 of 26)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [Rethinking the Inception Architecture for Computer Vision](https://mlsanity.com/paper/1512.00567/) (2015)
- [Analyzing and Improving the Image Quality of StyleGAN](https://mlsanity.com/paper/1912.04958/) (2019)
- [Progressive Growing of GANs for Improved Quality, Stability, and Variation](https://mlsanity.com/paper/1710.10196/) (2017)
- [Improved Techniques for Training GANs](https://mlsanity.com/paper/1606.03498/) (2016)
- [Large Scale GAN Training for High Fidelity Natural Image Synthesis](https://mlsanity.com/paper/1809.11096/) (2018)
- [Improved Training of Wasserstein GANs](https://mlsanity.com/paper/1704.00028/) (2017)
- [Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks](https://mlsanity.com/paper/1511.06434/) (2015)
- [Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising](https://mlsanity.com/paper/1608.03981/) (2016)
- [Wasserstein GAN](https://mlsanity.com/paper/1701.07875/) (2017)
- [fastMRI: An Open Dataset and Benchmarks for Accelerated MRI](https://mlsanity.com/paper/1811.08839/) (2018)
- [Towards Principled Methods for Training Generative Adversarial Networks](https://mlsanity.com/paper/1701.04862/) (2017)
- [Compressed Sensing using Generative Models](https://mlsanity.com/paper/1703.03208/) (2017)
- [Learning from Simulated and Unsupervised Images through Adversarial Training](https://mlsanity.com/paper/1612.07828/) (2016)
- [Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks](https://mlsanity.com/paper/1506.05751/) (2015)
- [MisGAN: Learning from Incomplete Data with Generative Adversarial Networks](https://mlsanity.com/paper/1902.09599/) (2019)
- [Image-Adaptive GAN based Reconstruction](https://mlsanity.com/paper/1906.05284/) (2019)
- [Do GANs actually learn the distribution? An empirical study](https://mlsanity.com/paper/1706.08224/) (2017)
- [Assessing the Impact of Deep Neural Network-based Image Denoising on Binary Signal Detection Tasks](https://mlsanity.com/paper/2104.14037/) (2021)
- [Prior Image-Constrained Reconstruction using Style-Based Generative Models](https://mlsanity.com/paper/2102.12525/) (2021)
- [Approximating the Ideal Observer and Hotelling Observer for binary signal detection tasks by use of supervised learning methods](https://mlsanity.com/paper/1905.06330/) (2019)
- [Medical image reconstruction with image-adaptive priors learned by use of generative adversarial networks](https://mlsanity.com/paper/2001.10830/) (2020)
- [Approximating the Ideal Observer for joint signal detection and localization tasks by use of supervised learning methods](https://mlsanity.com/paper/2006.00112/) (2020)
- [Markov-Chain Monte Carlo Approximation of the Ideal Observer using Generative Adversarial Networks](https://mlsanity.com/paper/2001.09526/) (2020)
- [Advancing the AmbientGAN for learning stochastic object models](https://mlsanity.com/paper/2102.00281/) (2021)

## Built on by (most cited first, 12 of 12)

- [Assessing the ability of generative adversarial networks to learn canonical medical image statistics](https://mlsanity.com/paper/2204.12007/) (2022)
- [AmbientFlow: Invertible generative models from incomplete, noisy measurements](https://mlsanity.com/paper/2309.04856/) (2023)
- [Knowledge-based in silico models and dataset for the comparative evaluation of mammography AI for a range of breast characteristics, lesion conspicuities and doses](https://mlsanity.com/paper/2310.18494/) (2023)
- [Regression is all you need for medical image translation](https://mlsanity.com/paper/2505.02048/) (2025)
- [Synthetic Data in Radiological Imaging: Current State and Future Outlook](https://mlsanity.com/paper/2407.01561/) (2024)
- [The stochastic digital human is now enrolling for in silico imaging trials -- Methods and tools for generating digital cohorts](https://mlsanity.com/paper/2301.08719/) (2023)
- [Ideal Observer Computation by Use of Markov-Chain Monte Carlo with Generative Adversarial Networks](https://mlsanity.com/paper/2304.00433/) (2023)
- [Report on the AAPM Grand Challenge on deep generative modeling for learning medical image statistics](https://mlsanity.com/paper/2405.01822/) (2024)
- [Ambient-Pix2PixGAN for Translating Medical Images from Noisy Data](https://mlsanity.com/paper/2402.01186/) (2024)
- [AmbientCycleGAN for Establishing Interpretable Stochastic Object Models Based on Mathematical Phantoms and Medical Imaging Measurements](https://mlsanity.com/paper/2402.01171/) (2024)
- [Ambient Denoising Diffusion Generative Adversarial Networks for Establishing Stochastic Object Models from Noisy Image Data](https://mlsanity.com/paper/2501.19094/) (2025)
- [Establishing Stochastic Object Models from Noisy Data via Ambient Measurement-Integrated Diffusion](https://mlsanity.com/paper/2512.14187/) (2025)

## Abstract (arXiv)

Purpose: To objectively assess new medical imaging technologies via computer-simulations, it is important to account for the variability in the ensemble of objects to be imaged. This source of variability can be described by stochastic object models (SOMs). It is generally desirable to establish SOMs from experimental imaging measurements acquired by use of a well-characterized imaging system, but this task has remained challenging. Approach: A generative adversarial network (GAN)-based method that employs AmbientGANs with modern progressive or multiresolution training approaches is proposed. AmbientGANs established using the proposed training procedure are systematically validated in a controlled way using computer-simulated magnetic resonance imaging (MRI) data corresponding to a stylized imaging system. Emulated single-coil experimental MRI data are also employed to demonstrate the methods under less stylized conditions. Results: The proposed AmbientGAN method can generate clean images when the imaging measurements are contaminated by measurement noise. When the imaging measurement data are incomplete, the proposed AmbientGAN can reliably learn the distribution of the measurement components of the objects. Conclusions: Both visual examinations and quantitative analyses, including task-specific validations using the Hotelling observer, demonstrated that the proposed AmbientGAN method holds promise to establish realistic SOMs from imaging measurements.
