Public Perceptions of Gender Bias in Large Language Models: Cases of ChatGPT and Ernie
Not on the map. Why?
Abstract (arXiv)
Large language models are quickly gaining momentum, yet are found to demonstrate gender bias in their responses. In this paper, we conducted a content analysis of social media discussions to gauge public perceptions of gender bias in LLMs which are trained in different cultural contexts, i.e., ChatGPT, a US-based LLM, or Ernie, a China-based LLM. People shared both observations of gender bias in their personal use and scientific findings about gender bias in LLMs. A difference between the two LLMs was seen -- ChatGPT was more often found to carry implicit gender bias, e.g., associating men and women with different profession titles, while explicit gender bias was found in Ernie's responses, e.g., overly promoting women's pursuit of marriage over career. Based on the findings, we reflect on the impact of culture on gender bias and propose governance recommendations to regulate gender bias in LLMs.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 14 of its 49 references that are in the map. First posted on arXiv 17 Sep 2023.
Builds on
14 of 49 references.
References · 14
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
- 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 144
- 2020Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Databasecited by 95
- 2022ChatGPT: The End of Online Exam Integrity?cited by 88
- 2021Uncovering Implicit Gender Bias in Narratives through Commonsense Inferencecited by 32
- 2021Ethics-Based Auditing to Develop Trustworthy AIcited by 23
- 2022AI Ethics Issues in Real World: Evidence from AI Incident Databasecited by 14
- 2023Linguistic ambiguity analysis in ChatGPTcited by 14
- 2023Ethical ChatGPT: Concerns, Challenges, and Commandmentscited by 13
- 2022A Moral- and Event- Centric Inspection of Gender Bias in Fairy Tales at A Large Scalecited by 3
- 2022Anonymous Expression in an Online Community for Women in Chinacited by 2
- 2022More Than a Wife and a Mom: A Study of Mom Vlogging Practices in Chinacited by 2
Built on by
Citing papers per year: 2024: 6; 2025: 2.
8 papers.
- 2024Safeguarding Large Language Models: A Surveycited by 73
- 2024Building Guardrails for Large Language Modelscited by 61
- 2024Gender Bias in Large Language Models across Multiple Languagescited by 35
- 2024Beware of Words: Evaluating the Lexical Diversity of Conversational LLMs using ChatGPT as Case Studycited by 10
- 2024On LLM Wizards: Identifying Large Language Models' Behaviors for Wizard of Oz Experimentscited by 4
- 2025EuroGEST: Investigating gender stereotypes in multilingual language modelscited by 4
- 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goalscited by 3
- 2025An Empirical Investigation of Gender Stereotype Representation in Large Language Models: The Italian Casecited by 0
- 2025An Empirical Investigation of Gender Stereotype Representation in Large Language Models: The Italian Case25 Jul 2025
- 2025EuroGEST: Investigating gender stereotypes in multilingual language models4 Jun 2025
- 2024On LLM Wizards: Identifying Large Language Models' Behaviors for Wizard of Oz Experiments10 Jul 2024
- 2024Safeguarding Large Language Models: A Survey3 Jun 2024
- 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goals22 Apr 2024
- 2024Gender Bias in Large Language Models across Multiple Languages1 Mar 2024
- 2024Beware of Words: Evaluating the Lexical Diversity of Conversational LLMs using ChatGPT as Case Study11 Feb 2024
- 2024Building Guardrails for Large Language Models2 Feb 2024