mlsanityData to 7 Oct 2026

Harnessing Synthetic Data from Generative AI for Statistical Inference

arXiv 2603.05396 ↗First posted 5 Mar 2026stat.ML cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

The emergence of generative AI models has dramatically expanded the availability and use of synthetic data across scientific, industrial, and policy domains. While these developments open new possibilities for data analysis, they also raise fundamental statistical questions about when synthetic data can be used in a valid, reliable, and principled manner. This paper reviews the current landscape of synthetic data generation and use from a statistical perspective, with the goal of clarifying the assumptions under which synthetic data can meaningfully support downstream discovery, inference, and prediction. We survey major classes of modern generative models, their intended use cases, and the benefits they offer, while also highlighting their limitations and characteristic failure modes. We additionally examine common pitfalls that arise when synthetic data are treated as surrogates for real observations, including biases from model misspecification, attenuated uncertainty, and difficulties in generalization. Building on these insights, we discuss emerging frameworks for the principled use of synthetic data. We conclude with practical recommendations, open problems, and cautions intended to guide both method developers and applied researchers.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 88 of its 140 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

88 of 140 references.

References · 88

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2023Visual Instruction Tuningcited by 7,792
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Scalable Diffusion Models with Transformerscited by 5,931
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2022Flow Matching for Generative Modelingcited by 5,426
38 more
  1. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  5. 2016Improved Techniques for Training GANscited by 2,938
  6. 2016Deep Learning with Differential Privacycited by 2,682
  7. 2015Variational Inference with Normalizing Flowscited by 2,161
  8. 2014Conditional Generative Adversarial Netscited by 2,152
  9. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  10. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  11. 2016Conditional Image Generation with PixelCNN Decoderscited by 859
  12. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  13. 2016Pixel Recurrent Neural Networkscited by 814
  14. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  15. 2019Modeling Tabular data using Conditional GANcited by 695
  16. 2018Which Training Methods for GANs do actually Converge?cited by 672
  17. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
  18. 2021Domain Generalization with MixStylecited by 563
  19. 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 504
  20. 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
  21. 2015Optimal Transport for Domain Adaptationcited by 457
  22. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  23. 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 373
  24. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
  25. 2016Semi-supervised Knowledge Transfer for Deep Learning from Private Training Datacited by 347
  26. 2021Transformers Can Do Bayesian Inferencecited by 338
  27. 2015A note on the evaluation of generative modelscited by 291
  28. 2023Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selectioncited by 291
  29. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
  30. 2017Joint Distribution Optimal Transportation for Domain Adaptationcited by 280
  31. 2017Data Augmentation Generative Adversarial Networkscited by 278
  32. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
  33. 2023Prediction-Powered Inferencecited by 214
  34. 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 193
  35. 2015DRAW: A Recurrent Neural Network For Image Generationcited by 190
  36. 2019Learning Likelihoods with Conditional Normalizing Flowscited by 170
  37. 2021CTAB-GAN: Effective Table Data Synthesizingcited by 156
  38. 2023Self-Alignment with Instruction Backtranslationcited by 149

50 most cited of 88 All 88 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.