mlsanityData to 7 Oct 2026

Evaluating a Synthetic Image Dataset Generated with Stable Diffusion

arXiv 2211.01777 ↗First posted 3 Nov 2022cs.CV cs.LGcited by 9

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We generate synthetic images with the "Stable Diffusion" image generation model using the Wordnet taxonomy and the definitions of concepts it contains. This synthetic image database can be used as training data for data augmentation in machine learning applications, and it is used to investigate the capabilities of the Stable Diffusion model. Analyses show that Stable Diffusion can produce correct images for a large number of concepts, but also a large variety of different representations. The results show differences depending on the test concepts considered and problems with very specific concepts. These evaluations were performed using a vision transformer model for image classification.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 27 of its 40 references that are in the map. First posted on arXiv 3 Nov 2022.

Builds on

27 of 40 references.

Closest ancestors · 5

Same direction, newest first

  1. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models26 Oct
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  10. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  11. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  12. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
10 more
  1. 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 368
  2. 2022Red-Teaming the Stable Diffusion Safety Filtercited by 257
  3. 2018Data Augmentation by Pairing Samples for Images Classificationcited by 96
  4. 2022Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2cited by 55
  5. 2017On Pre-Trained Image Features and Synthetic Images for Deep Learningcited by 51
  6. 2021ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generationcited by 41
  7. 2014On Rendering Synthetic Images for Training an Object Detectorcited by 18
  8. 2020Mixing Real and Synthetic Data to Enhance Neural Network Training -- A Review of Current Approachescited by 13
  9. 2017Object Detection Using Deep CNNs Trained on Synthetic Imagescited by 9
  10. 2022How good are deep models in understanding the generated images?cited by 2

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 5; 2025: 2.

9 papers.

  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 105
  3. 2024Diffusion Facial Forgery Detectioncited by 41
  4. 2024VISION-XL: High Definition Video Inverse Problem Solver using Latent Image Diffusion Modelscited by 13
  5. 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Modelscited by 12
  6. 2024ShieldDiff: Suppressing Sexual Content Generation from Diffusion Models through Reinforcement Learningcited by 6
  7. 2024Mind the Gap Between Synthetic and Real: Utilizing Transfer Learning to Probe the Boundaries of Stable Diffusion Generated Datacited by 5
  8. 2024NL-Eye: Abductive NLI for Imagescited by 5
  9. 2025Modeling Human Responses to Multimodal AI Contentcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Stable Diffusion for Data Augmentation in COCO and Weed Datasets
  2. 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clones
  3. 2023Diversity and Diffusion: Observations on Synthetic Image Distributions with Stable Diffusion
  4. 2024Visual Car Brand Classification by Implementing a Synthetic Image Dataset Creation Pipeline
  5. 2024Stable Diffusion Dataset Generation for Downstream Classification Tasks
  6. 2023Synthetic Data from Diffusion Models Improves ImageNet Classification
  7. 2023A Survey of Diffusion Based Image Generation Models: Issues and Their Solutions
  8. 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learners