Synthetic Data for Face Recognition: Current State and Future Prospects
Not on the map. Why?
Abstract (arXiv)
Over the past years, deep learning capabilities and the availability of large-scale training datasets advanced rapidly, leading to breakthroughs in face recognition accuracy. However, these technologies are foreseen to face a major challenge in the next years due to the legal and ethical concerns about using authentic biometric data in AI model training and evaluation along with increasingly utilizing data-hungry state-of-the-art deep learning models. With the recent advances in deep generative models and their success in generating realistic and high-resolution synthetic image data, privacy-friendly synthetic data has been recently proposed as an alternative to privacy-sensitive authentic data to overcome the challenges of using authentic data in face recognition development. This work aims at providing a clear and structured picture of the use-cases taxonomy of synthetic face data in face recognition along with the recent emerging advances of face recognition models developed on the bases of synthetic data. We also discuss the challenges facing the use of synthetic data in face recognition development and several future prospects of synthetic data in the domain of face recognition.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Builds on 37 of its 62 references that are in the map. First posted on arXiv 1 May 2023.
Builds on
37 of 62 references.
References · 37
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
- 2016Pixel Recurrent Neural Networkscited by 816
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 624
- 2014Learning Face Representation from Scratchcited by 453
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
- 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 260
25 more
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
- 2021WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognitioncited by 223
- 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 220
- 2021ElasticFace: Elastic Margin Loss for Deep Face Recognitioncited by 144
- 2021SynFace: Face Recognition with Synthetic Datacited by 106
- 2022DigiFace-1M: 1 Million Digital Face Images for Face Recognitioncited by 92
- 2021GAN-Control: Explicitly Controllable GANscited by 91
- 2018The Devil of Face Recognition is in the Noisecited by 65
- 2022SFace: Privacy-friendly and Accurate Face Recognition using Synthetic Datacited by 63
- 2020CONFIG: Controllable Neural Face Image Generationcited by 61
- 2022Privacy-friendly Synthetic Data for the Development of Face Morphing Attack Detectorscited by 47
- 2023MorDIFF: Recognition Vulnerability and Attack Detectability of Face Morphing Attacks Created by Diffusion Autoencoderscited by 44
- 2017Level Playing Field for Million Scale Face Recognitioncited by 43
- 2016UMDFaces: An Annotated Face Dataset for Training Deep Networkscited by 42
- 2020This Face Does Not Exist ... But It Might Be Yours! Identity Leakage in Generative Modelscited by 33
- 2022SYN-MAD 2022: Competition on Face Morphing Attack Detection Based on Privacy-aware Synthetic Training Datacited by 30
- 2022Unsupervised Face Recognition using Unlabeled Synthetic Datacited by 27
- 2023Identity-driven Three-Player Generative Adversarial Network for Synthetic-based Face Recognitioncited by 27
- 2014Web-Scale Training for Face Identificationcited by 20
- 2022QuantFace: Towards Lightweight Face Recognition by Synthetic Data Low-bit Quantizationcited by 18
- 2023SynthASpoof: Developing Face Presentation Attack Detection Based on Privacy-friendly Synthetic Datacited by 17
- 2020Generating Master Faces for Use in Performing Wolf Attacks on Face Recognition Systemscited by 13
- 2022On the (Limited) Generalization of MasterFace Attacks and Its Relation to the Capacity of Face Representationscited by 7
- 2019FlowSAN: Privacy-enhancing Semi-Adversarial Networks to Confound Arbitrary Face-based Gender Classifierscited by 5
Built on by
Citing papers per year: 2023: 11; 2024: 12; 2025: 7; 2026: 8.
38 papers.
Sort:
By area:
- 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Modelscited by 72
- 2023GANDiffFace: Controllable Generation of Synthetic Datasets for Face Recognition with Realistic Variationscited by 49
- 2023Analyzing Bias in Diffusion-based Face Generation Modelscited by 46
- 2024SDFR: Synthetic Data for Face Recognition Competitioncited by 28
- 2024FRoundation: Are Foundation Models Ready for Face Recognition?cited by 23
- 2023ExFaceGAN: Exploring Identity Directions in GAN's Learned Latent Space for Synthetic Identity Generationcited by 22
- 2023FRCSyn Challenge at WACV 2024:Face Recognition Challenge in the Era of Synthetic Datacited by 21
- 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Datacited by 13
- 2023Bias and Diversity in Synthetic-based Face Recognitioncited by 11
- 2024ONOT: a High-Quality ICAO-compliant Synthetic Mugshot Datasetcited by 10
- 2023SynthDistill: Face Recognition with Knowledge Distillation from Synthetic Datacited by 9
- 2024AdaDistill: Adaptive Knowledge Distillation for Deep Face Recognitioncited by 8
26 more
- 2024VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognitioncited by 8
- 2023Face Presentation Attack Detection by Excavating Causal Clues and Adapting Embedding Statisticscited by 7
- 2025ID-Booth: Identity-consistent Face Generation with Diffusion Modelscited by 6
- 2023SynFacePAD 2023: Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Datacited by 5
- 2025Deep Learning in Palmprint Recognition-A Comprehensive Surveycited by 5
- 2024If It's Not Enough, Make It So: Reducing Authentic Data Demand in Face Recognition through Synthetic Facescited by 4
- 2024A Survey on Drowsiness Detection -- Modern Applications and Methodscited by 4
- 2025FROQ: Observing Face Recognition Models for Efficient Quality Assessmentcited by 4
- 2024The Impact of Balancing Real and Synthetic Data on Accuracy and Fairness in Face Recognitioncited by 3
- 2024SynMorph: Generating Synthetic Face Morphing Dataset with Mated Samplescited by 3
- 2025NegFaceDiff: The Power of Negative Context in Identity-Conditioned Diffusion for Synthetic Face Generationcited by 3
- 2024CLIP4Sketch: Enhancing Sketch to Mugshot Matching through Dataset Augmentation using Diffusion Modelscited by 2
- 2026IDperturb: Enhancing Variation in Synthetic Face Generation via Angular Perturbationcited by 2
- 2023Face Recognition Using Synthetic Face Datacited by 1
- 2024How Knowledge Distillation Mitigates the Synthetic Gap in Fair Face Recognitioncited by 1
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Modelscited by 1
- 2023Multi-Task Faces (MTF) Data Set: A Legally and Ethically Compliant Collection of Face Images for Various Classification Taskscited by 0
- 2025DiffProb: Data Pruning for Face Recognitioncited by 0
- 2025GANDiff FR: Hybrid GAN Diffusion Synthesis for Causal Bias Attribution in Face Recognitioncited by 0
- 2025Trade-offs in Cross-Domain Generalization of Foundation Model Fine-Tuned for Biometric Applicationscited by 0
- 2026Evidence-based Decision Modeling for Synthetic Face Detection with Uncertainty-driven Active Learningcited by 0
- 2026Toward Calibrated, Fair, and accurate Deepfake Detectioncited by 0
- 2026Benchmarking Face Recognition without Real Facescited by 0
- 2026IJCB-AFMFR 2026: Competition on Adapting Foundation Models for Face Recognition Using Synthetic Training Datacited by 0
- 2026Learning Late, Guiding Early: Timestep-Decoupled Semantic Guidance for Fair Face Generationcited by 0
- 2026Revisiting Face Recognition for Monozygotic Twins: The Celeb Twins Test Setcited by 0
- 2026Revisiting Face Recognition for Monozygotic Twins: The Celeb Twins Test Set1 Sep 2026
- 2026Learning Late, Guiding Early: Timestep-Decoupled Semantic Guidance for Fair Face Generation26 Aug 2026
- 2026IJCB-AFMFR 2026: Competition on Adapting Foundation Models for Face Recognition Using Synthetic Training Data27 Jul 2026
- 2026Benchmarking Face Recognition without Real Faces16 Jul 2026
- 2026Toward Calibrated, Fair, and accurate Deepfake Detection3 Jun 2026
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Models21 May 2026
- 2026Evidence-based Decision Modeling for Synthetic Face Detection with Uncertainty-driven Active Learning11 May 2026
- 2026IDperturb: Enhancing Variation in Synthetic Face Generation via Angular Perturbation21 Feb 2026
- 2025FROQ: Observing Face Recognition Models for Efficient Quality Assessment22 Sep 2025
- 2025Trade-offs in Cross-Domain Generalization of Foundation Model Fine-Tuned for Biometric Applications18 Sep 2025
- 2025GANDiff FR: Hybrid GAN Diffusion Synthesis for Causal Bias Attribution in Face Recognition15 Aug 2025
- 2025NegFaceDiff: The Power of Negative Context in Identity-Conditioned Diffusion for Synthetic Face Generation13 Aug 2025
26 more
- 2025DiffProb: Data Pruning for Face Recognition21 May 2025
- 2025ID-Booth: Identity-consistent Face Generation with Diffusion Models10 Apr 2025
- 2025Deep Learning in Palmprint Recognition-A Comprehensive Survey2 Jan 2025
- 2024VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognition9 Dec 2024
- 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Data2 Dec 2024
- 2024FRoundation: Are Foundation Models Ready for Face Recognition?31 Oct 2024
- 2024SynMorph: Generating Synthetic Face Morphing Dataset with Mated Samples9 Sep 2024
- 2024The Impact of Balancing Real and Synthetic Data on Accuracy and Fairness in Face Recognition4 Sep 2024
- 2024How Knowledge Distillation Mitigates the Synthetic Gap in Fair Face Recognition30 Aug 2024
- 2024A Survey on Drowsiness Detection -- Modern Applications and Methods23 Aug 2024
- 2024CLIP4Sketch: Enhancing Sketch to Mugshot Matching through Dataset Augmentation using Diffusion Models2 Aug 2024
- 2024AdaDistill: Adaptive Knowledge Distillation for Deep Face Recognition1 Jul 2024
- 2024ONOT: a High-Quality ICAO-compliant Synthetic Mugshot Dataset17 Apr 2024
- 2024SDFR: Synthetic Data for Face Recognition Competition6 Apr 2024
- 2024If It's Not Enough, Make It So: Reducing Authentic Data Demand in Face Recognition through Synthetic Faces4 Apr 2024
- 2023Multi-Task Faces (MTF) Data Set: A Legally and Ethically Compliant Collection of Face Images for Various Classification Tasks20 Nov 2023
- 2023FRCSyn Challenge at WACV 2024:Face Recognition Challenge in the Era of Synthetic Data17 Nov 2023
- 2023SynFacePAD 2023: Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Data9 Nov 2023
- 2023Bias and Diversity in Synthetic-based Face Recognition7 Nov 2023
- 2023SynthDistill: Face Recognition with Knowledge Distillation from Synthetic Data28 Aug 2023
- 2023Face Presentation Attack Detection by Excavating Causal Clues and Adapting Embedding Statistics28 Aug 2023
- 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Models9 Aug 2023
- 2023ExFaceGAN: Exploring Identity Directions in GAN's Learned Latent Space for Synthetic Identity Generation11 Jul 2023
- 2023GANDiffFace: Controllable Generation of Synthetic Datasets for Face Recognition with Realistic Variations31 May 2023
- 2023Face Recognition Using Synthetic Face Data17 May 2023
- 2023Analyzing Bias in Diffusion-based Face Generation Models10 May 2023
- 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Modelscited by 72
- 2023GANDiffFace: Controllable Generation of Synthetic Datasets for Face Recognition with Realistic Variationscited by 49
- 2023Analyzing Bias in Diffusion-based Face Generation Modelscited by 46
- 2025ID-Booth: Identity-consistent Face Generation with Diffusion Modelscited by 6
- 2025NegFaceDiff: The Power of Negative Context in Identity-Conditioned Diffusion for Synthetic Face Generationcited by 3
- 2024CLIP4Sketch: Enhancing Sketch to Mugshot Matching through Dataset Augmentation using Diffusion Modelscited by 2
- 2026IDperturb: Enhancing Variation in Synthetic Face Generation via Angular Perturbationcited by 2
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Modelscited by 1
- 2026Learning Late, Guiding Early: Timestep-Decoupled Semantic Guidance for Fair Face Generationcited by 0
- 2026Learning Late, Guiding Early: Timestep-Decoupled Semantic Guidance for Fair Face Generation26 Aug 2026
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Models21 May 2026
- 2026IDperturb: Enhancing Variation in Synthetic Face Generation via Angular Perturbation21 Feb 2026
- 2025NegFaceDiff: The Power of Negative Context in Identity-Conditioned Diffusion for Synthetic Face Generation13 Aug 2025
- 2025ID-Booth: Identity-consistent Face Generation with Diffusion Models10 Apr 2025
- 2024CLIP4Sketch: Enhancing Sketch to Mugshot Matching through Dataset Augmentation using Diffusion Models2 Aug 2024
- 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Models9 Aug 2023
- 2023GANDiffFace: Controllable Generation of Synthetic Datasets for Face Recognition with Realistic Variations31 May 2023
- 2023Analyzing Bias in Diffusion-based Face Generation Models10 May 2023
- 2024SDFR: Synthetic Data for Face Recognition Competitioncited by 28
- 2024FRoundation: Are Foundation Models Ready for Face Recognition?cited by 23
- 2023ExFaceGAN: Exploring Identity Directions in GAN's Learned Latent Space for Synthetic Identity Generationcited by 22
- 2023FRCSyn Challenge at WACV 2024:Face Recognition Challenge in the Era of Synthetic Datacited by 21
- 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Datacited by 13
- 2023Bias and Diversity in Synthetic-based Face Recognitioncited by 11
- 2024ONOT: a High-Quality ICAO-compliant Synthetic Mugshot Datasetcited by 10
- 2024VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognitioncited by 8
- 2023Face Presentation Attack Detection by Excavating Causal Clues and Adapting Embedding Statisticscited by 7
- 2023SynFacePAD 2023: Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Datacited by 5
- 2025Deep Learning in Palmprint Recognition-A Comprehensive Surveycited by 5
- 2024If It's Not Enough, Make It So: Reducing Authentic Data Demand in Face Recognition through Synthetic Facescited by 4
12 most cited of 26 All 26 (JSON)
- 2026Revisiting Face Recognition for Monozygotic Twins: The Celeb Twins Test Set1 Sep 2026
- 2026IJCB-AFMFR 2026: Competition on Adapting Foundation Models for Face Recognition Using Synthetic Training Data27 Jul 2026
- 2026Benchmarking Face Recognition without Real Faces16 Jul 2026
- 2026Toward Calibrated, Fair, and accurate Deepfake Detection3 Jun 2026
- 2026Evidence-based Decision Modeling for Synthetic Face Detection with Uncertainty-driven Active Learning11 May 2026
- 2025FROQ: Observing Face Recognition Models for Efficient Quality Assessment22 Sep 2025
- 2025Trade-offs in Cross-Domain Generalization of Foundation Model Fine-Tuned for Biometric Applications18 Sep 2025
- 2025GANDiff FR: Hybrid GAN Diffusion Synthesis for Causal Bias Attribution in Face Recognition15 Aug 2025
- 2025DiffProb: Data Pruning for Face Recognition21 May 2025
- 2025Deep Learning in Palmprint Recognition-A Comprehensive Survey2 Jan 2025
- 2024VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognition9 Dec 2024
- 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Data2 Dec 2024
12 newest of 26 All 26 (JSON)