mlsanityData to 14 Oct 2026

SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributes

arXiv 2404.17255 ↗First posted 26 Apr 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

AI systems rely on extensive training on large datasets to address various tasks. However, image-based systems, particularly those used for demographic attribute prediction, face significant challenges. Many current face image datasets primarily focus on demographic factors such as age, gender, and skin tone, overlooking other crucial facial attributes like hairstyle and accessories. This narrow focus limits the diversity of the data and consequently the robustness of AI systems trained on them. This work aims to address this limitation by proposing a methodology for generating synthetic face image datasets that capture a broader spectrum of facial diversity. Specifically, our approach integrates a systematic prompt formulation strategy, encompassing not only demographics and biometrics but also non-permanent traits like make-up, hairstyle, and accessories. These prompts guide a state-of-the-art text-to-image model in generating a comprehensive dataset of high-quality realistic images and can be used as an evaluation set in face analysis systems. Compared to existing datasets, our proposed dataset proves equally or more challenging in image classification tasks while being much smaller in size.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 50 of its 72 references that are in the map. First posted on arXiv 26 Apr 2024.

Builds on

50 of 72 references.

References · 50

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  10. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  11. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  12. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
38 more
  1. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  2. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  3. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  4. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
  5. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  6. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
  7. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
  8. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
  9. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  10. 2017Age Progression/Regression by Conditional Adversarial Autoencodercited by 429
  11. 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
  12. 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
  13. 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 220
  14. 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
  15. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
  16. 2023Holistic Evaluation of Text-To-Image Modelscited by 160
  17. 2019Mitigate Bias in Face Recognition using Skewness-Aware Reinforcement Learningcited by 145
  18. 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
  19. 2018Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddingscited by 114
  20. 2021SynFace: Face Recognition with Synthetic Datacited by 106
  21. 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
  22. 2022DigiFace-1M: 1 Million Digital Face Images for Face Recognitioncited by 92
  23. 2021A Comprehensive Study on Face Recognition Biases Beyond Demographicscited by 86
  24. 2019Diversity in Facescited by 77
  25. 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Modelscited by 72
  26. 2022SFace: Privacy-friendly and Accurate Face Recognition using Synthetic Datacited by 63
  27. 2022Meta Balanced Network for Fair Face Recognitioncited by 53
  28. 2023GANDiffFace: Controllable Generation of Synthetic Datasets for Face Recognition with Realistic Variationscited by 49
  29. 2023Analyzing Bias in Diffusion-based Face Generation Modelscited by 46
  30. 2020A survey of face recognition techniques under occlusioncited by 38
  31. 2020InsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometricscited by 31
  32. 2021On the use of automatically generated synthetic image datasets for benchmarking face recognitioncited by 26
  33. 2022Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognitioncited by 26
  34. 2023Face Aging via Diffusion-based Editingcited by 24
  35. 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
  36. 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognitioncited by 10
  37. 2021Generation of Non-Deterministic Synthetic Face Datasets Guided by Identity Priorscited by 6
  38. 2023Balanced Face Dataset: Guiding StyleGAN to Generate Labeled Synthetic Face Image Dataset for Underrepresented Groupcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 1.

6 papers.