Unveiling Gender Bias in Terms of Profession Across LLMs: Analyzing and Addressing Sociological Implications
Not on the map. Why?
Abstract (arXiv)
Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language Models (LLMs) with a focus on multiple comparisons between GPT-2 and GPT-3.5, some prominent language models, to better understand its implications. Through a comprehensive literature review, the study examines existing research on gender bias in AI language models and identifies gaps in the current knowledge. The methodology involves collecting and preprocessing data from GPT-2 and GPT-3.5, and employing in-depth quantitative analysis techniques to evaluate gender bias in the generated text. The findings shed light on gendered word associations, language usage, and biased narratives present in the outputs of these Large Language Models. The discussion explores the ethical implications of gender bias and its potential consequences on social perceptions and marginalized communities. Additionally, the paper presents strategies for reducing gender bias in LLMs, including algorithmic approaches and data augmentation techniques. The research highlights the importance of interdisciplinary collaborations and the role of sociological studies in mitigating gender bias in AI models. By addressing these issues, we can pave the way for more inclusive and unbiased AI systems that have a positive impact on society.
Key facts. Cited by 29 papers in the map (data through 13 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 18 Jul 2023.
Builds on
18 of 30 references.
References · 18
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,309
- 2019Release Strategies and the Social Impacts of Language Modelscited by 511
- 2018Gender Bias in Coreference Resolutioncited by 439
- 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 205
- 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 155
- 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 88
- 2022Gender Bias in Masked Language Models for Multiple Languagescited by 60
- 2023Nationality Bias in Text Generationcited by 50
- 2023Evaluating GPT-3 Generated Explanations for Hateful Content Moderationcited by 44
- 2022Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversalcited by 40
- 2023ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languagescited by 33
- 2022Causally Testing Gender Bias in LLMs: A Case Study on Occupational Biascited by 28
6 more
- 2023Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventionscited by 28
- 2022The Birth of Bias: A case study on the evolution of gender bias in an English language modelcited by 16
- 2023She Elicits Requirements and He Tests: Software Engineering Gender Bias in Large Language Modelscited by 12
- 2023Measuring Gender Bias in West Slavic Language Modelscited by 10
- 2022Efficient Gender Debiasing of Pre-trained Indic Language Modelscited by 3
- 2023Gender Bias in Transformer Models: A comprehensive surveycited by 2
Built on by
Citing papers per year: 2023: 4; 2024: 13; 2025: 9; 2026: 3.
29 papers.
Sort:
By area:
- 2024Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Modelscited by 45
- 2024D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Modelscited by 41
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Modelscited by 30
- 2023How susceptible are LLMs to Logical Fallacies?cited by 23
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subculturescited by 23
- 2023Embedding in Recommender Systems: A Surveycited by 19
- 2023Indian-BhED: A Dataset for Measuring India-Centric Biases in Large Language Modelscited by 17
- 2024CIDAR: Culturally Relevant Instruction Dataset For Arabiccited by 17
- 2024AuditLLM: A Tool for Auditing Large Language Models Using Multiprobe Approachcited by 11
- 2025Guiding LLM Decision-Making with Fairness Reward Modelscited by 9
- 2024'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMscited by 7
- 2024Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Predictioncited by 6
17 more
- 2025Rethinking LLM Bias Probing Using Lessons from the Social Sciencescited by 6
- 2025Evaluating how LLM annotations represent diverse views on contentious topicscited by 6
- 2024Best Practices for Large Language Models in Radiologycited by 5
- 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settingscited by 5
- 2024OMGEval: An Open Multilingual Generative Evaluation Benchmark for Large Language Modelscited by 4
- 2024"Flex Tape Can't Fix That": Bias and Misinformation in Edited Language Modelscited by 4
- 2025SafeLLM: Unlearning Harmful Outputs from Large Language Models against Jailbreak Attackscited by 4
- 2024LLM Bias Evaluation: Gender, Racial, and Age Disparities in Occupational and Crime Scenarioscited by 2
- 2023From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Modelscited by 1
- 2024Boardwalk Empire: How Generative AI is Revolutionizing Economic Paradigmscited by 1
- 2025The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Datacited by 1
- 2024Evaluation of Large Language Models: STEM education and Gender Stereotypescited by 0
- 2025Personalisation or Prejudice? Addressing Geographic Bias in Hate Speech Detection using Debias Tuning in Large Language Modelscited by 0
- 2025Probing Gender Bias in Multilingual LLMs: A Case Study of Stereotypes in Persiancited by 0
- 2026Contaminated Collaboration: Measuring Gender Bias Transfer in LLM-Assisted Student Writingcited by 0
- 2026Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMscited by 0
- 2026Identifying Harm in Personalized, Generative AI Systems Requires User-Centered Auditing at the Interaction Levelcited by 0
- 2026Identifying Harm in Personalized, Generative AI Systems Requires User-Centered Auditing at the Interaction Level7 Aug 2026
- 2026Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMs29 Jul 2026
- 2026Contaminated Collaboration: Measuring Gender Bias Transfer in LLM-Assisted Student Writing14 Jun 2026
- 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settings29 Sep 2025
- 2025Probing Gender Bias in Multilingual LLMs: A Case Study of Stereotypes in Persian24 Sep 2025
- 2025SafeLLM: Unlearning Harmful Outputs from Large Language Models against Jailbreak Attacks21 Aug 2025
- 2025Guiding LLM Decision-Making with Fairness Reward Models15 Jul 2025
- 2025Personalisation or Prejudice? Addressing Geographic Bias in Hate Speech Detection using Debias Tuning in Large Language Models4 May 2025
- 2025The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Data2 Apr 2025
- 2025Evaluating how LLM annotations represent diverse views on contentious topics29 Mar 2025
- 2025Rethinking LLM Bias Probing Using Lessons from the Social Sciences28 Feb 2025
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Models29 Jan 2025
17 more
- 2024Best Practices for Large Language Models in Radiology2 Dec 2024
- 2024Boardwalk Empire: How Generative AI is Revolutionizing Economic Paradigms19 Oct 2024
- 2024LLM Bias Evaluation: Gender, Racial, and Age Disparities in Occupational and Crime Scenarios22 Sep 2024
- 2024'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMs20 Sep 2024
- 2024Evaluation of Large Language Models: STEM education and Gender Stereotypes14 Jun 2024
- 2024Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Prediction12 Jun 2024
- 2024D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models3 Jun 2024
- 2024Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Models16 May 2024
- 2024"Flex Tape Can't Fix That": Bias and Misinformation in Edited Language Models29 Feb 2024
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures23 Feb 2024
- 2024OMGEval: An Open Multilingual Generative Evaluation Benchmark for Large Language Models21 Feb 2024
- 2024AuditLLM: A Tool for Auditing Large Language Models Using Multiprobe Approach14 Feb 2024
- 2024CIDAR: Culturally Relevant Instruction Dataset For Arabic5 Feb 2024
- 2023From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models21 Dec 2023
- 2023Embedding in Recommender Systems: A Survey28 Oct 2023
- 2023Indian-BhED: A Dataset for Measuring India-Centric Biases in Large Language Models15 Sep 2023
- 2023How susceptible are LLMs to Logical Fallacies?18 Aug 2023
- 2024Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Modelscited by 45
- 2023How susceptible are LLMs to Logical Fallacies?cited by 23
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subculturescited by 23
- 2025Guiding LLM Decision-Making with Fairness Reward Modelscited by 9
- 2025Rethinking LLM Bias Probing Using Lessons from the Social Sciencescited by 6
- 2025Guiding LLM Decision-Making with Fairness Reward Models15 Jul 2025
- 2025Rethinking LLM Bias Probing Using Lessons from the Social Sciences28 Feb 2025
- 2024Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Models16 May 2024
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures23 Feb 2024
- 2023How susceptible are LLMs to Logical Fallacies?18 Aug 2023
- 2024D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Modelscited by 41
- 2023Embedding in Recommender Systems: A Surveycited by 19
- 2023Indian-BhED: A Dataset for Measuring India-Centric Biases in Large Language Modelscited by 17
- 2024CIDAR: Culturally Relevant Instruction Dataset For Arabiccited by 17
- 2024AuditLLM: A Tool for Auditing Large Language Models Using Multiprobe Approachcited by 11
- 2024'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMscited by 7
- 2024Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Predictioncited by 6
- 2025Evaluating how LLM annotations represent diverse views on contentious topicscited by 6
- 2024Best Practices for Large Language Models in Radiologycited by 5
- 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settingscited by 5
- 2024OMGEval: An Open Multilingual Generative Evaluation Benchmark for Large Language Modelscited by 4
- 2024"Flex Tape Can't Fix That": Bias and Misinformation in Edited Language Modelscited by 4
12 most cited of 22 All 22 (JSON)
- 2026Identifying Harm in Personalized, Generative AI Systems Requires User-Centered Auditing at the Interaction Level7 Aug 2026
- 2026Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMs29 Jul 2026
- 2026Contaminated Collaboration: Measuring Gender Bias Transfer in LLM-Assisted Student Writing14 Jun 2026
- 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settings29 Sep 2025
- 2025Probing Gender Bias in Multilingual LLMs: A Case Study of Stereotypes in Persian24 Sep 2025
- 2025Personalisation or Prejudice? Addressing Geographic Bias in Hate Speech Detection using Debias Tuning in Large Language Models4 May 2025
- 2025The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Data2 Apr 2025
- 2025Evaluating how LLM annotations represent diverse views on contentious topics29 Mar 2025
- 2024Best Practices for Large Language Models in Radiology2 Dec 2024
- 2024Boardwalk Empire: How Generative AI is Revolutionizing Economic Paradigms19 Oct 2024
- 2024LLM Bias Evaluation: Gender, Racial, and Age Disparities in Occupational and Crime Scenarios22 Sep 2024
- 2024'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMs20 Sep 2024
12 newest of 22 All 22 (JSON)