mlsanityData to 7 Oct 2026

DCFace: Synthetic Face Generation with Dual Condition Diffusion Model

arXiv 2304.07060 ↗First posted 14 Apr 2023cs.CVcited by 116

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Generating synthetic datasets for training face recognition models is challenging because dataset generation entails more than creating high fidelity images. It involves generating multiple images of same subjects under different factors (textite.g., variations in pose, illumination, expression, aging and occlusion) which follows the real image conditional distribution. Previous works have studied the generation of synthetic datasets using GAN or 3D models. In this work, we approach the problem from the aspect of combining subject appearance (ID) and external factor (style) conditions. These two conditions provide a direct way to control the inter-class and intra-class variations. To this end, we propose a Dual Condition Face Generator (DCFace) based on a diffusion model. Our novel Patch-wise style extractor and Time-step dependent ID loss enables DCFace to consistently produce face images of the same subject under different styles with precise control. Face recognition models trained on synthetic images from the proposed DCFace provide higher verification accuracies compared to previous works by 6.11% on average in 4 out of 5 test datasets, LFW, CFP-FP, CPLFW, AgeDB and CALFW. Code is available at https://github.com/mk-minchul/dcface

Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 65 of its 92 references that are in the map. First posted on arXiv 14 Apr 2023.

Builds on

65 of 92 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022Pretraining is All You Need for Image-to-Image Translation25 May
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 63

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  10. 2022Classifier-Free Diffusion Guidancecited by 5,717
  11. 2022Generative Adversarial Networkscited by 5,603
  12. 2016Layer Normalizationcited by 5,579
38 more
  1. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  5. 2016Improved Techniques for Training GANscited by 2,938
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  7. 2018Group Normalizationcited by 1,514
  8. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  9. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  10. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
  11. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  12. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  13. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  14. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  15. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  16. 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
  17. 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
  18. 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
  19. 2014Learning Face Representation from Scratchcited by 451
  20. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
  21. 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 390
  22. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
  23. 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 292
  24. 2018Deep Video Portraitscited by 265
  25. 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
  26. 2021WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognitioncited by 221
  27. 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 219
  28. 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
  29. 2019Single Image Portrait Relightingcited by 152
  30. 2021DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networkscited by 109
  31. 2021SynFace: Face Recognition with Synthetic Datacited by 106
  32. 2022DigiFace-1M: 1 Million Digital Face Images for Face Recognitioncited by 92
  33. 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
  34. 2019SRM : A Style-based Recalibration Module for Convolutional Neural Networkscited by 65
  35. 2018Low-Resolution Face Recognitioncited by 64
  36. 2017UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognitioncited by 62
  37. 2018ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributescited by 50
  38. 20193D Guided Fine-Grained Face Manipulationcited by 45

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 16; 2024: 50; 2025: 32; 2026: 18.

116 papers.

Sort:

By area:

  1. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
  2. 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
  3. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
  4. 2023GANDiffFace: Controllable Generation of Synthetic Datasets for Face Recognition with Realistic Variationscited by 49
  5. 2024Diffusion Facial Forgery Detectioncited by 41
  6. 2024KeyPoint Relative Position Encoding for Face Recognitioncited by 37
  7. 2024SDFR: Synthetic Data for Face Recognition Competitioncited by 28
  8. 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmarkcited by 28
  9. 2024FRoundation: Are Foundation Models Ready for Face Recognition?cited by 22
  10. 2023GCD-DDPM: A Generative Change Detection Model Based on Difference-Feature Guided DDPMcited by 21
  11. 2023FRCSyn Challenge at WACV 2024:Face Recognition Challenge in the Era of Synthetic Datacited by 21
  12. 2023Towards Real-World Blind Face Restoration with Generative Diffusion Priorcited by 21
38 more
  1. 2024ID3: Identity-Preserving-yet-Diversified Diffusion Models for Synthetic Face Recognitioncited by 18
  2. 2024Vec2Face: Scaling Face Dataset Generation with Loosely Constrained Vectorscited by 15
  3. 2025SapiensID: Foundation for Human Recognitioncited by 14
  4. 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Datacited by 13
  5. 202550 Years of Automated Face Recognitioncited by 13
  6. 2024Synthetic Face Datasets Generation via Latent Space Exploration from Brownian Identity Diffusioncited by 12
  7. 2024HyperFace: Generating Synthetic Face Recognition Datasets by Exploring Face Embedding Hyperspherecited by 12
  8. 2025Data Synthesis with Diverse Styles for Face Recognition via 3DMM-Guided Diffusioncited by 12
  9. 2023Identity-Preserving Aging of Face Images via Latent Diffusion Modelscited by 11
  10. 2023Bias and Diversity in Synthetic-based Face Recognitioncited by 11
  11. 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognitioncited by 10
  12. 2024CemiFace: Center-based Semi-hard Synthetic Face Generation for Face Recognitioncited by 10
  13. 2023SynthDistill: Face Recognition with Knowledge Distillation from Synthetic Datacited by 9
  14. 2024Digi2Real: Bridging the Realism Gap in Synthetic Data Face Recognition via Foundation Modelscited by 9
  15. 2025Disentangled Source-Free Personalization for Facial Expression Recognition with Neutral Target Datacited by 9
  16. 2024Thinking Racial Bias in Fair Forgery Detection: Models, Datasets and Evaluationscited by 8
  17. 2024Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360degcited by 8
  18. 2024VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognitioncited by 8
  19. 2025Beyond Real Faces: Synthetic Datasets Can Achieve Reliable Recognition Performance without Privacy Compromisecited by 8
  20. 2024AdaDistill: Adaptive Knowledge Distillation for Deep Face Recognitioncited by 7
  21. 2024DiffFAS: Face Anti-Spoofing via Generative Diffusion Modelscited by 7
  22. 2024ConsistentAvatar: Learning to Diffuse Fully Consistent Talking Head Avatar with Temporal Guidancecited by 7
  23. 2024A Novel Approach to Industrial Defect Generation through Blended Latent Diffusion Model with Online Adaptationcited by 6
  24. 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributescited by 6
  25. 2024SynFER: Towards Boosting Facial Expression Recognition with Synthetic Datacited by 6
  26. 2023Zero-shot racially balanced dataset generation using an existing biased StyleGAN2cited by 5
  27. 2023Improving Visual Quality and Transferability of Adversarial Attacks on Face Recognition Simultaneously with Adversarial Restorationcited by 5
  28. 2024VIGFace: Virtual Identity Generation for Privacy-Free Face Recognitioncited by 5
  29. 2024Synthetic to Authentic: Transferring Realism to 3D Face Renderings for Boosting Face Recognitioncited by 5
  30. 2024Towards Native Generative Model for 3D Head Avatarcited by 5
  31. 2025Hybrid Generative Fusion for Efficient and Privacy-Preserving Face Recognition Dataset Generationcited by 5
  32. 2023On the Biometric Capacity of Generative Face Modelscited by 4
  33. 2024If It's Not Enough, Make It So: Reducing Authentic Data Demand in Face Recognition through Synthetic Facescited by 4
  34. 2025Dimitra: Audio-driven Diffusion model for Expressive Talking Head Generationcited by 4
  35. 2025Mixture of Global and Local Experts with Diffusion Transformer for Controllable Face Generationcited by 4
  36. 2023ProS: Facial Omni-Representation Learning via Prototype-based Self-Distillationcited by 3
  37. 2023EyePreserve: Identity-Preserving Iris Synthesiscited by 3
  38. 2024Goldilocks Test Sets for Face Verificationcited by 3

50 most cited of 116 All 116 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025ID-Booth: Identity-consistent Face Generation with Diffusion Models
  2. 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Models
  3. 2024Detection of Synthetic Face Images: Accuracy, Robustness, Generalization
  4. 2026Diff-ID: Identity Consistent Facial Image Generation and Morphing via Diffusion Models
  5. 2023Conditioning Diffusion Models via Attributes and Semantic Masks for Face Generation
  6. 2023Fake It Without Making It: Conditioned Face Generation for Accurate 3D Face Reconstruction
  7. 2024Diffusion-driven GAN Inversion for Multi-Modal Face Image Generation
  8. 2022DiffFace: Diffusion-based Face Swapping with Facial Guidance