Measuring Fairness in Generative Models
Not on the map. Why?
Abstract (arXiv)
Deep generative models have made much progress in improving training stability and quality of generated data. Recently there has been increased interest in the fairness of deep-generated data. Fairness is important in many applications, e.g. law enforcement, as biases will affect efficacy. Central to fair data generation are the fairness metrics for the assessment and evaluation of different generative models. In this paper, we first review fairness metrics proposed in previous works and highlight potential weaknesses. We then discuss a performance benchmark framework along with the assessment of alternative metrics.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 18 of its 22 references that are in the map. First posted on arXiv 16 Jul 2021.
Builds on
18 of 22 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016Improved Techniques for Training GANscited by 2,938
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2014Certifying and removing disparate impactcited by 715
- 2020Fairness in Machine Learning: A Surveycited by 369
- 2016Unrolled Generative Adversarial Networkscited by 208
- 2018FairGAN: Fairness-aware Generative Adversarial Networkscited by 164
6 more
- 2019Fair Generative Modeling via Weak Supervisioncited by 114
- 2019Bias Correction of Learned Generative Models using Likelihood-Free Importance Weightingcited by 70
- 2021A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detectioncited by 68
- 2020Improving the Fairness of Deep Generative Models without Retrainingcited by 46
- 2018Dist-GAN: An Improved GAN using Distance Constraintscited by 26
- 2019Self-supervised GAN: Analysis and Improvement with Multi-class Minimax Gamecited by 25
Built on by
Citing papers per year: 2022: 2; 2023: 7; 2024: 9; 2025: 7; 2026: 6.
31 papers.
Sort:
By area:
- 2023Debiasing Vision-Language Models via Biased Promptscited by 147
- 2024Large-scale Reinforcement Learning for Diffusion Modelscited by 78
- 2023Spawrious: A Benchmark for Fine Control of Spurious Correlation Biasescited by 41
- 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmarkcited by 28
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2022Discovering Transferable Forensic Features for CNN-generated Images Detectioncited by 24
- 2023Label-Only Model Inversion Attacks via Knowledge Transfercited by 21
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19
- 2023EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Modelscited by 18
- 2025Exploring Bias in over 100 Text-to-Image Generative Modelscited by 9
- 2023On Measuring Fairness in Generative Modelscited by 8
- 2024FairQueue: Rethinking Prompt Learning for Fair Text-to-Image Generationcited by 7
19 more
- 2025FairImagen: Post-Processing for Bias Mitigation in Text-to-Image Modelscited by 6
- 2025Standardizing Intelligence: Aligning Generative AI for Regulatory and Operational Compliancecited by 5
- 2025Fit for Purpose? Deepfake Detection in the Real Worldcited by 4
- 2024A Comprehensive Survey and Classification of Evaluation Criteria for Trustworthy Artificial Intelligencecited by 3
- 2024Data Pruning in Generative Diffusion Modelscited by 3
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Modelscited by 3
- 2022Fairness in generative modelingcited by 2
- 2024On the Fairness, Diversity and Reliability of Text-to-Image Generative Modelscited by 2
- 2025On Optimal Steering to Achieve Exact Fairnesscited by 2
- 2024AITTI: Learning Adaptive Inclusive Token for Text-to-Image Generationcited by 1
- 2026Equalized Generative Treatment: Matching f-divergences for Fairness in Generative Modelscited by 1
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasingcited by 1
- 2023Fair GANs through model rebalancing for extremely imbalanced class distributionscited by 0
- 2024Text-to-Image Representativity Fairness Evaluation Frameworkcited by 0
- 2025Improving Fairness in LLMs Through Testing-Time Adversariescited by 0
- 2026Fairness risk and its privacy-enabled solution in AI-driven robotic applicationscited by 0
- 2026Disparate Impact in Synthetic Data Generationcited by 0
- 2026Position: Fairness Failure in Generative Models is an Evaluation Problemcited by 0
- 2026Debias Anything: Fairness with Diversity without Supervision in Diffusion Modelscited by 0
- 2026Debias Anything: Fairness with Diversity without Supervision in Diffusion Models1 Oct 2026
- 2026Position: Fairness Failure in Generative Models is an Evaluation Problem17 Aug 2026
- 2026Disparate Impact in Synthetic Data Generation11 Jun 2026
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasing23 May 2026
- 2026Equalized Generative Treatment: Matching f-divergences for Fairness in Generative Models9 Feb 2026
- 2026Fairness risk and its privacy-enabled solution in AI-driven robotic applications13 Jan 2026
- 2025FairImagen: Post-Processing for Bias Mitigation in Text-to-Image Models24 Oct 2025
- 2025Fit for Purpose? Deepfake Detection in the Real World18 Oct 2025
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models25 Sep 2025
- 2025On Optimal Steering to Achieve Exact Fairness19 Sep 2025
- 2025Improving Fairness in LLMs Through Testing-Time Adversaries17 May 2025
- 2025Exploring Bias in over 100 Text-to-Image Generative Models11 Mar 2025
19 more
- 2025Standardizing Intelligence: Aligning Generative AI for Regulatory and Operational Compliance3 Feb 2025
- 2024On the Fairness, Diversity and Reliability of Text-to-Image Generative Models21 Nov 2024
- 2024Data Pruning in Generative Diffusion Models19 Nov 2024
- 2024FairQueue: Rethinking Prompt Learning for Fair Text-to-Image Generation24 Oct 2024
- 2024Text-to-Image Representativity Fairness Evaluation Framework18 Oct 2024
- 2024A Comprehensive Survey and Classification of Evaluation Criteria for Trustworthy Artificial Intelligence10 Oct 2024
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIP19 Aug 2024
- 2024AITTI: Learning Adaptive Inclusive Token for Text-to-Image Generation18 Jun 2024
- 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmark2 Jun 2024
- 2024Large-scale Reinforcement Learning for Diffusion Models20 Jan 2024
- 2023Label-Only Model Inversion Attacks via Knowledge Transfer30 Oct 2023
- 2023On Measuring Fairness in Generative Models30 Oct 2023
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023Fair GANs through model rebalancing for extremely imbalanced class distributions16 Aug 2023
- 2023EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Models10 Mar 2023
- 2023Spawrious: A Benchmark for Fine Control of Spurious Correlation Biases9 Mar 2023
- 2023Debiasing Vision-Language Models via Biased Prompts31 Jan 2023
- 2022Fairness in generative modeling6 Oct 2022
- 2022Discovering Transferable Forensic Features for CNN-generated Images Detection24 Aug 2022
- 2024Large-scale Reinforcement Learning for Diffusion Modelscited by 78
- 2023EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Modelscited by 18
- 2025FairImagen: Post-Processing for Bias Mitigation in Text-to-Image Modelscited by 6
- 2025Fit for Purpose? Deepfake Detection in the Real Worldcited by 4
- 2024Data Pruning in Generative Diffusion Modelscited by 3
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Modelscited by 3
- 2026Debias Anything: Fairness with Diversity without Supervision in Diffusion Modelscited by 0
- 2026Debias Anything: Fairness with Diversity without Supervision in Diffusion Models1 Oct 2026
- 2025FairImagen: Post-Processing for Bias Mitigation in Text-to-Image Models24 Oct 2025
- 2025Fit for Purpose? Deepfake Detection in the Real World18 Oct 2025
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models25 Sep 2025
- 2024Data Pruning in Generative Diffusion Models19 Nov 2024
- 2024Large-scale Reinforcement Learning for Diffusion Models20 Jan 2024
- 2023EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Models10 Mar 2023
- 2023Debiasing Vision-Language Models via Biased Promptscited by 147
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIP19 Aug 2024
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023Debiasing Vision-Language Models via Biased Prompts31 Jan 2023
- 2023Spawrious: A Benchmark for Fine Control of Spurious Correlation Biasescited by 41
- 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmarkcited by 28
- 2022Discovering Transferable Forensic Features for CNN-generated Images Detectioncited by 24
- 2023Label-Only Model Inversion Attacks via Knowledge Transfercited by 21
- 2025Exploring Bias in over 100 Text-to-Image Generative Modelscited by 9
- 2023On Measuring Fairness in Generative Modelscited by 8
- 2024FairQueue: Rethinking Prompt Learning for Fair Text-to-Image Generationcited by 7
- 2025Standardizing Intelligence: Aligning Generative AI for Regulatory and Operational Compliancecited by 5
- 2024A Comprehensive Survey and Classification of Evaluation Criteria for Trustworthy Artificial Intelligencecited by 3
- 2022Fairness in generative modelingcited by 2
- 2024On the Fairness, Diversity and Reliability of Text-to-Image Generative Modelscited by 2
- 2025On Optimal Steering to Achieve Exact Fairnesscited by 2
12 most cited of 20 All 20 (JSON)
- 2026Position: Fairness Failure in Generative Models is an Evaluation Problem17 Aug 2026
- 2026Disparate Impact in Synthetic Data Generation11 Jun 2026
- 2026Equalized Generative Treatment: Matching f-divergences for Fairness in Generative Models9 Feb 2026
- 2026Fairness risk and its privacy-enabled solution in AI-driven robotic applications13 Jan 2026
- 2025On Optimal Steering to Achieve Exact Fairness19 Sep 2025
- 2025Improving Fairness in LLMs Through Testing-Time Adversaries17 May 2025
- 2025Exploring Bias in over 100 Text-to-Image Generative Models11 Mar 2025
- 2025Standardizing Intelligence: Aligning Generative AI for Regulatory and Operational Compliance3 Feb 2025
- 2024On the Fairness, Diversity and Reliability of Text-to-Image Generative Models21 Nov 2024
- 2024FairQueue: Rethinking Prompt Learning for Fair Text-to-Image Generation24 Oct 2024
- 2024Text-to-Image Representativity Fairness Evaluation Framework18 Oct 2024
- 2024A Comprehensive Survey and Classification of Evaluation Criteria for Trustworthy Artificial Intelligence10 Oct 2024
12 newest of 20 All 20 (JSON)