mlsanityData to 14 Oct 2026

AI-Generated Images as Data Source: The Dawn of Synthetic Era

arXiv 2310.01830 ↗First posted 3 Oct 2023cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

The advancement of visual intelligence is intrinsically tethered to the availability of large-scale data. In parallel, generative Artificial Intelligence (AI) has unlocked the potential to create synthetic images that closely resemble real-world photographs. This prompts a compelling inquiry: how much visual intelligence could benefit from the advance of generative AI? This paper explores the innovative concept of harnessing these AI-generated images as new data sources, reshaping traditional modeling paradigms in visual intelligence. In contrast to real data, AI-generated data exhibit remarkable advantages, including unmatched abundance and scalability, the rapid generation of vast datasets, and the effortless simulation of edge cases. Built on the success of generative AI models, we examine the potential of their generated data in a range of applications, from training machine learning models to simulating scenarios for computational modeling, testing, and validation. We probe the technological foundations that support this groundbreaking use of generative AI, engaging in an in-depth discussion on the ethical, legal, and practical considerations that accompany this transformative paradigm shift. Through an exhaustive survey of current technologies and applications, this paper presents a comprehensive view of the synthetic era in visual intelligence. A project associated with this paper can be found at https://github.com/mwxely/AIGS .

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 210 of its 255 references that are in the map. First posted on arXiv 3 Oct 2023.

Builds on

210 of 255 references.

References · 210

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  7. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  8. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  10. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  11. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  12. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
38 more
  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  10. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  11. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  13. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  14. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  15. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  16. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  17. 2016Improved Techniques for Training GANscited by 2,970
  18. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  19. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  20. 2015Variational Inference with Normalizing Flowscited by 2,170
  21. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  22. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  23. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  24. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  25. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  26. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  27. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  28. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  29. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  30. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  31. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  32. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  33. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  34. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  35. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  36. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  37. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  38. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178

50 most cited of 210 All 210 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 3; 2025: 3; 2026: 4.

13 papers.

Sort:

By area: