Beyond wheelchairs and blindfolds: Investigating disability stereotypes in T2I models with INCLUDE-BENCH
Not on the map. Why?
Abstract (arXiv)
Text-to-image (T2I) models have been shown to exhibit social biases. Prior work has mainly focused on gender, skin tone, and cultural representation within restricted occupational associations, and emerging benchmarks increasingly incorporate these dimensions. However, disability remains systematically underexplored. Current evaluation practices often fail to align with sociologically grounded definitions of stereotyping, limiting principled assessment of representational harms toward people with disabilities (PWD). To address this, we introduce INCLUDE-BENCH, the first large-scale benchmark for evaluating disability-related bias in T2I models. INCLUDE-BENCH comprises 119K generated images based on prompt design across multiple bias dimensions and both static and dynamic contexts. We evaluate 15 open-source and 2 closed-source models. Our key findings reveal that: (1) mobility-impaired and default disability prompts predominantly yield wheelchair depictions across all models; (2) disability-conditioned generations consistently exhibit less diversity; (3) stereotypical portrayals demonstrate stronger disability-text alignment; and (4) we introduce the Stereotype Content Model (SCM) Score, demonstrating that T2I models reflect real-world stereotypical associations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 90 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
46 of 90 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
- 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 253
34 more
- 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 138
- 2021Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologiescited by 128
- 2023Social Biases through the Text-to-Image Generation Lenscited by 127
- 2023HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Modelscited by 95
- 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?cited by 92
- 2024OpenBias: Open-set Bias Detection in Text-to-Image Generative Modelscited by 61
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 52
- 2023Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Taskscited by 51
- 2023T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generationcited by 39
- 2022Measuring Representational Harms in Image Captioningcited by 36
- 2021Unpacking the Interdependent Systems of Discrimination: Ableist Bias in NLP Systems through an Intersectional Lenscited by 30
- 2024ViSAGe: A Global-Scale Analysis of Visual Stereotypes in Text-to-Image Generationcited by 27
- 2023Taxonomizing and Measuring Representational Harms: A Look at Image Taggingcited by 25
- 2021Understanding and Countering Stereotypes: A Computational Approach to the Stereotype Content Modelcited by 23
- 2024FAIntbench: A Holistic and Precise Benchmark for Bias Evaluation in Text-to-Image Modelscited by 22
- 2023Automated Ableism: An Exploration of Explicit Disability Biases in Sentiment and Toxicity Analysis Modelscited by 20
- 2024BIGbench: A Unified Benchmark for Evaluating Multi-dimensional Social Biases in Text-to-Image Modelscited by 18
- 2018AI Fairness for People with Disabilities: Point of Viewcited by 16
- 2025A Large Scale Analysis of Gender Biases in Text-to-Image Generative Modelscited by 14
- 2023Towards Equitable Representation in Text-to-Image Synthesis Models with the Cross-Cultural Understanding Benchmark (CCUB) Datasetcited by 12
- 2024"Cold, Calculated, and Condescending": How AI Identifies and Explains Ableism Compared to Disabled Peoplecited by 10
- 2025OASIS Uncovers: High-Quality T2I Models, Same Old Stereotypescited by 8
- 2024KITTEN: A Knowledge-Intensive Evaluation of Image Generation on Visual Entitiescited by 5
- 2025AccessEval: Benchmarking Disability Bias in Large Language Modelscited by 5
- 2025ABLEIST: Intersectional Disability Bias in LLM-Generated Hiring Scenarioscited by 5
- 2024Disability Representations: Finding Biases in Automatic Image Generationcited by 4
- 2024A Taxonomy of the Biases of the Images created by Generative Artificial Intelligencecited by 4
- 2022"It's Just Part of Me:" Understanding Avatar Diversity and Self-presentation of People with Disabilities in Social Virtual Realitycited by 3
- 2025A Systematic Review of Open Datasets Used in Text-to-Image (T2I) Gen AI Model Safetycited by 2
- 2025Hidden Bias in the Machine: Stereotypes in Text-to-Image Modelscited by 2
Built on by
Not cited yet.