SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributes
Not on the map. Why?
Abstract (arXiv)
AI systems rely on extensive training on large datasets to address various tasks. However, image-based systems, particularly those used for demographic attribute prediction, face significant challenges. Many current face image datasets primarily focus on demographic factors such as age, gender, and skin tone, overlooking other crucial facial attributes like hairstyle and accessories. This narrow focus limits the diversity of the data and consequently the robustness of AI systems trained on them. This work aims to address this limitation by proposing a methodology for generating synthetic face image datasets that capture a broader spectrum of facial diversity. Specifically, our approach integrates a systematic prompt formulation strategy, encompassing not only demographics and biometrics but also non-permanent traits like make-up, hairstyle, and accessories. These prompts guide a state-of-the-art text-to-image model in generating a comprehensive dataset of high-quality realistic images and can be used as an evaluation set in face analysis systems. Compared to existing datasets, our proposed dataset proves equally or more challenging in image classification tasks while being much smaller in size.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 50 of its 72 references that are in the map. First posted on arXiv 26 Apr 2024.
Builds on
50 of 72 references.
References · 50
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
38 more
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2017Age Progression/Regression by Conditional Adversarial Autoencodercited by 429
- 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
- 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
- 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 220
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
- 2023Holistic Evaluation of Text-To-Image Modelscited by 160
- 2019Mitigate Bias in Face Recognition using Skewness-Aware Reinforcement Learningcited by 145
- 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
- 2018Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddingscited by 114
- 2021SynFace: Face Recognition with Synthetic Datacited by 106
- 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
- 2022DigiFace-1M: 1 Million Digital Face Images for Face Recognitioncited by 92
- 2021A Comprehensive Study on Face Recognition Biases Beyond Demographicscited by 86
- 2019Diversity in Facescited by 77
- 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Modelscited by 72
- 2022SFace: Privacy-friendly and Accurate Face Recognition using Synthetic Datacited by 63
- 2022Meta Balanced Network for Fair Face Recognitioncited by 53
- 2023GANDiffFace: Controllable Generation of Synthetic Datasets for Face Recognition with Realistic Variationscited by 49
- 2023Analyzing Bias in Diffusion-based Face Generation Modelscited by 46
- 2020A survey of face recognition techniques under occlusioncited by 38
- 2020InsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometricscited by 31
- 2021On the use of automatically generated synthetic image datasets for benchmarking face recognitioncited by 26
- 2022Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognitioncited by 26
- 2023Face Aging via Diffusion-based Editingcited by 24
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognitioncited by 10
- 2021Generation of Non-Deterministic Synthetic Face Datasets Guided by Identity Priorscited by 6
- 2023Balanced Face Dataset: Guiding StyleGAN to Generate Labeled Synthetic Face Image Dataset for Underrepresented Groupcited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 1.
6 papers.
- 2024VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognitioncited by 8
- 2025Beyond Real Faces: Synthetic Datasets Can Achieve Reliable Recognition Performance without Privacy Compromisecited by 8
- 2024ChildDiffusion: Unlocking the Potential of Generative AI and Controllable Augmentations for Child Facial Data using Stable Diffusion and Large Language Modelscited by 0
- 2025Bias Analysis for Synthetic Face Detection: A Case Study of the Impact of Facial Attributescited by 0
- 2025Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Taskscited by 0
- 2026Benchmarking Face Recognition without Real Facescited by 0
- 2026Benchmarking Face Recognition without Real Faces16 Jul 2026
- 2025Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Tasks21 Nov 2025
- 2025Beyond Real Faces: Synthetic Datasets Can Achieve Reliable Recognition Performance without Privacy Compromise20 Oct 2025
- 2025Bias Analysis for Synthetic Face Detection: A Case Study of the Impact of Facial Attributes25 Jul 2025
- 2024VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognition9 Dec 2024
- 2024ChildDiffusion: Unlocking the Potential of Generative AI and Controllable Augmentations for Child Facial Data using Stable Diffusion and Large Language Models17 Jun 2024