mlsanityData to 14 Oct 2026

FairT2I: Mitigating Social Bias in Text-to-Image Generation via Large Language Model-Assisted Detection and Attribute Rebalancing

arXiv 2502.03826 ↗First posted 6 Feb 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-image (T2I) models have advanced creative content generation, yet their reliance on large uncurated datasets often reproduces societal biases. We present FairT2I, a training-free and interactive framework grounded in a mathematically principled latent variable guidance formulation. This formulation decomposes the generative score function into attribute-conditioned components and reweights them according to a defined distribution, providing a unified and flexible mechanism for bias-aware generation that also subsumes many existing ad hoc debiasing approaches as special cases. Building upon this foundation, FairT2I incorporates (1) latent variable guidance as the core mechanism, (2) LLM-based bias detection to automatically infer bias-prone categories and attributes from text prompts as part of the latent structure, and (3) attribute resampling, which allows users to adjust or redefine the attribute distribution based on uniform, real-world, or user-specified statistics. The accompanying user interface supports this pipeline by enabling users to inspect detected biases, modify attributes or weights, and generate debiased images in real time. Experimental results show that LLMs outperform average human annotators in the number and granularity of detected bias categories and attributes. Moreover, FairT2I achieves superior performance to baseline models in both societal bias mitigation and image diversity, while preserving image quality and prompt fidelity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 74 references that are in the map. First posted on arXiv 6 Feb 2025.

Builds on

52 of 74 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  7. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  8. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  10. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  11. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  12. 2022Scalable Diffusion Models with Transformerscited by 6,054
38 more
  1. 2022Classifier-Free Diffusion Guidancecited by 5,847
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  7. 2023Consistency Modelscited by 1,822
  8. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  9. 2023Adversarial Diffusion Distillationcited by 759
  10. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  11. 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
  12. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  13. 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
  14. 2023Self-Consuming Generative Models Go MADcited by 250
  15. 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
  16. 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
  17. 2023Fair Diffusion: Instructing Text-to-Image Generation Models on Fairnesscited by 151
  18. 2023Debiasing Vision-Language Models via Biased Promptscited by 149
  19. 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 141
  20. 2023Social Biases through the Text-to-Image Generation Lenscited by 127
  21. 2019Fair Generative Modeling via Weak Supervisioncited by 114
  22. 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?cited by 92
  23. 2023DeAR: Debiasing Vision-Language Models with Additive Residualscited by 70
  24. 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
  25. 2024Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigationcited by 66
  26. 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
  27. 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 62
  28. 2024OpenBias: Open-set Bias Detection in Text-to-Image Generative Modelscited by 61
  29. 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Biascited by 55
  30. 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 52
  31. 2023T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generationcited by 39
  32. 2023PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactionscited by 34
  33. 2023'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusioncited by 33
  34. 2023Stable Diffusion Exposed: Gender Bias from Prompt to Imagecited by 25
  35. 2024Training Unbiased Diffusion Models From Biased Datasetcited by 25
  36. 2024Would Deep Generative Models Amplify Bias in Future Models?cited by 24
  37. 2022When are Lemons Purple? The Concept Association Bias of Vision-Language Modelscited by 23
  38. 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.