Exploring LGBTQ+ Bias in Generative AI Answers across Different Country and Religious Contexts
Not on the map. Why?
Abstract (arXiv)
Previous discussions have highlighted the need for generative AI tools to become more culturally sensitive, yet often neglect the complexities of handling content about minorities, who are perceived differently across cultures and religions. Our study examined how two generative AI systems respond to homophobic statements with varying cultural and religious context information. Findings showed ChatGPT 3.5's replies exhibited cultural relativism, in contrast to Bard's, which stressed human rights and provided more support for LGBTQ+ issues. Both demonstrated significant change in responses based on contextual information provided in the prompts, suggesting that AI systems may adjust in their responses the degree and forms of support for LGBTQ+ people according to information they receive about the user's background. The study contributes to understanding the social and ethical implications of AI responses and argues that any work to make generative AI outputs more culturally diverse requires a grounding in fundamental human rights. A revised edition of this preprint is available open access at Big Data & Society at https://doi.org/10.1177/20539517251396069
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 73 references that are in the map. First posted on arXiv 3 Jul 2024.
Builds on
16 of 73 references.
References · 16
- 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
- 2023Beyond Memorization: Violating Privacy Via Inference with Large Language Modelscited by 167
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 147
- 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 137
- 2024The Political Preferences of LLMscited by 83
- 2023The Self-Perception and Political Biases of ChatGPTcited by 66
- 2023Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Taskscited by 51
- 2023MISGENDERED: Limits of Large Language Models in Understanding Pronounscited by 43
- 2023WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Modelscited by 42
- 2023ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languagescited by 33
- 2023Evaluating Biased Attitude Associations of Language Models in an Intersectional Contextcited by 20
4 more
- 2024The Colorful Future of LLMs: Evaluating and Improving LLMs as Emotional Supporters for Queer Youthcited by 20
- 2023GPTBIAS: A Comprehensive Framework for Evaluating Bias in Large Language Modelscited by 16
- 2020Designing for Human Rights in AIcited by 13
- 2020Conservative AI and social inequality: Conceptualizing alternatives to bias through social theorycited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.