Harnessing Synthetic Data from Generative AI for Statistical Inference
Not on the map. Why?
Abstract (arXiv)
The emergence of generative AI models has dramatically expanded the availability and use of synthetic data across scientific, industrial, and policy domains. While these developments open new possibilities for data analysis, they also raise fundamental statistical questions about when synthetic data can be used in a valid, reliable, and principled manner. This paper reviews the current landscape of synthetic data generation and use from a statistical perspective, with the goal of clarifying the assumptions under which synthetic data can meaningfully support downstream discovery, inference, and prediction. We survey major classes of modern generative models, their intended use cases, and the benefits they offer, while also highlighting their limitations and characteristic failure modes. We additionally examine common pitfalls that arise when synthetic data are treated as surrogates for real observations, including biases from model misspecification, attenuated uncertainty, and difficulties in generalization. Building on these insights, we discuss emerging frameworks for the principled use of synthetic data. We conclude with practical recommendations, open problems, and cautions intended to guide both method developers and applied researchers.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 88 of its 140 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
88 of 140 references.
References · 88
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023Visual Instruction Tuningcited by 7,792
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
38 more
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2016Improved Techniques for Training GANscited by 2,938
- 2016Deep Learning with Differential Privacycited by 2,682
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2016Conditional Image Generation with PixelCNN Decoderscited by 859
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2016Pixel Recurrent Neural Networkscited by 814
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2019Modeling Tabular data using Conditional GANcited by 695
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
- 2021Domain Generalization with MixStylecited by 563
- 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 504
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
- 2015Optimal Transport for Domain Adaptationcited by 457
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 373
- 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
- 2016Semi-supervised Knowledge Transfer for Deep Learning from Private Training Datacited by 347
- 2021Transformers Can Do Bayesian Inferencecited by 338
- 2015A note on the evaluation of generative modelscited by 291
- 2023Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selectioncited by 291
- 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
- 2017Joint Distribution Optimal Transportation for Domain Adaptationcited by 280
- 2017Data Augmentation Generative Adversarial Networkscited by 278
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2023Prediction-Powered Inferencecited by 214
- 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 193
- 2015DRAW: A Recurrent Neural Network For Image Generationcited by 190
- 2019Learning Likelihoods with Conditional Normalizing Flowscited by 170
- 2021CTAB-GAN: Effective Table Data Synthesizingcited by 156
- 2023Self-Alignment with Instruction Backtranslationcited by 149
50 most cited of 88 All 88 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.