FairT2I: Mitigating Social Bias in Text-to-Image Generation via Large Language Model-Assisted Detection and Attribute Rebalancing
Not on the map. Why?
Abstract (arXiv)
Text-to-image (T2I) models have advanced creative content generation, yet their reliance on large uncurated datasets often reproduces societal biases. We present FairT2I, a training-free and interactive framework grounded in a mathematically principled latent variable guidance formulation. This formulation decomposes the generative score function into attribute-conditioned components and reweights them according to a defined distribution, providing a unified and flexible mechanism for bias-aware generation that also subsumes many existing ad hoc debiasing approaches as special cases. Building upon this foundation, FairT2I incorporates (1) latent variable guidance as the core mechanism, (2) LLM-based bias detection to automatically infer bias-prone categories and attributes from text prompts as part of the latent structure, and (3) attribute resampling, which allows users to adjust or redefine the attribute distribution based on uniform, real-world, or user-specified statistics. The accompanying user interface supports this pipeline by enabling users to inspect detected biases, modify attributes or weights, and generate debiased images in real time. Experimental results show that LLMs outperform average human annotators in the number and granularity of detected bias categories and attributes. Moreover, FairT2I achieves superior performance to baseline models in both societal bias mitigation and image diversity, while preserving image quality and prompt fidelity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 74 references that are in the map. First posted on arXiv 6 Feb 2025.
Builds on
52 of 74 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
38 more
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023Consistency Modelscited by 1,822
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2023Adversarial Diffusion Distillationcited by 759
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2023Self-Consuming Generative Models Go MADcited by 250
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
- 2023Fair Diffusion: Instructing Text-to-Image Generation Models on Fairnesscited by 151
- 2023Debiasing Vision-Language Models via Biased Promptscited by 149
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 141
- 2023Social Biases through the Text-to-Image Generation Lenscited by 127
- 2019Fair Generative Modeling via Weak Supervisioncited by 114
- 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?cited by 92
- 2023DeAR: Debiasing Vision-Language Models with Additive Residualscited by 70
- 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
- 2024Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigationcited by 66
- 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 62
- 2024OpenBias: Open-set Bias Detection in Text-to-Image Generative Modelscited by 61
- 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Biascited by 55
- 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 52
- 2023T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generationcited by 39
- 2023PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactionscited by 34
- 2023'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusioncited by 33
- 2023Stable Diffusion Exposed: Gender Bias from Prompt to Imagecited by 25
- 2024Training Unbiased Diffusion Models From Biased Datasetcited by 25
- 2024Would Deep Generative Models Amplify Bias in Future Models?cited by 24
- 2022When are Lemons Purple? The Concept Association Bias of Vision-Language Modelscited by 23
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.