A Comprehensive Survey of Bias in LLMs: Current Landscape and Future Directions
Not on the map. Why?
Abstract (arXiv)
Large Language Models(LLMs) have revolutionized various applications in natural language processing (NLP) by providing unprecedented text generation, translation, and comprehension capabilities. However, their widespread deployment has brought to light significant concerns regarding biases embedded within these models. This paper presents a comprehensive survey of biases in LLMs, aiming to provide an extensive review of the types, sources, impacts, and mitigation strategies related to these biases. We systematically categorize biases into several dimensions. Our survey synthesizes current research findings and discusses the implications of biases in real-world applications. Additionally, we critically assess existing bias mitigation techniques and propose future research directions to enhance fairness and equity in LLMs. This survey serves as a foundational resource for researchers, practitioners, and policymakers concerned with addressing and understanding biases in LLMs.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 24 Sep 2024.
Builds on
28 of 35 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 148
- 2023Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategiescited by 83
- 2024Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perceptioncited by 55
- 2023Bias Testing and Mitigation in LLM-based Code Generationcited by 53
16 more
- 2024Evaluating Gender Bias in Large Language Models via Chain-of-Thought Promptingcited by 49
- 2024Measuring Implicit Bias in Explicitly Unbiased Large Language Modelscited by 49
- 2024Bias patterns in the application of LLMs for clinical decision support: A comprehensive studycited by 27
- 2024(Ir)rationality and Cognitive Biases in Large Language Modelscited by 23
- 2024BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMscited by 21
- 2024Breaking Bias, Building Bridges: Evaluation and Mitigation of Social Biases in LLMs via Contact Hypothesiscited by 19
- 2023Large Language Model (LLM) Bias Index -- LLMBIcited by 14
- 2024Take Care of Your Prompt Bias! Investigating and Mitigating Prompt Bias in Factual Knowledge Extractioncited by 13
- 2024PoliTune: Analyzing the Impact of Data Selection and Fine-Tuning on Economic and Political Biases in Large Language Modelscited by 11
- 2024Blind Spots and Biases: Exploring the Role of Annotator Cognitive Biases in NLPcited by 11
- 2024Comprehensive Study on Sentiment Analysis: From Rule-based to modern LLM based systemcited by 8
- 2024Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMscited by 7
- 2024Evaluation of LLMs Biases Towards Elite Universities: A Persona-Based Explorationcited by 7
- 2024The Generation Gap: Exploring Age Bias in the Value Systems of Large Language Modelscited by 5
- 2024Born With a Silver Spoon? Investigating Socioeconomic Bias in Large Language Modelscited by 4
- 2024LangBiTe: A Platform for Testing Bias in Large Language Modelscited by 3
Built on by
Citing papers per year: 2025: 14; 2026: 13.
27 papers.
Sort:
By area:
- 2025Colombian Waitresses y Jueces canadienses: Gender and Country Biases in Occupation Recommendations from LLMscited by 7
- 2025Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?cited by 7
- 2025Fairness in Agentic AI: A Unified Framework for Ethical and Equitable Multi-Agent Systemcited by 5
- 2025Mind the Language Gap: Automated and Augmented Evaluation of Bias in LLMs for High- and Low-Resource Languagescited by 4
- 2026Emergently Misaligned Language Models Show Behavioral Self-Awareness That Shifts With Subsequent Realignmentcited by 4
- 2025Bias after Prompting: Persistent Discrimination in Large Language Modelscited by 3
- 2025Building Trust in Clinical LLMs: Bias Analysis and Dataset Transparencycited by 3
- 2025Comprehensive Framework for Evaluating Conversational AI Chatbotscited by 2
- 2026CALM: Culturally Self-Aware Language Modelscited by 2
- 2026Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detectioncited by 2
- 2025Agent-Enhanced Large Language Models for Researching Political Institutionscited by 1
- 2025'Rich Dad, Poor Lad': How do Large Language Models Contextualize Socioeconomic Factors in College Admission ?cited by 1
15 more
- 2026MLLM-as-a-Judge Exhibits Model Preference Biascited by 1
- 2025Towards Efficient and Effective Alignment of Large Language Modelscited by 0
- 2025A Multi-Agent Probabilistic Inference Framework Inspired by Kairanban-Style CoT System with IdoBata Conversation for Debiasingcited by 0
- 2025Audit, Alignment, and Optimization of LM-Powered Subroutines with Application to Public Comment Processingcited by 0
- 2025Do They Understand Them? An Updated Evaluation on Nonbinary Pronoun Handling in Large Language Modelscited by 0
- 2025A Close Reading Approach to Gender Narrative Biases in AI-Generated Storiescited by 0
- 2026The GDN-CC Dataset: Automatic Corpus Clarification for AI-enhanced Democratic Citizen Consultationscited by 0
- 2026Measuring Political Stance and Consistency in Large Language Modelscited by 0
- 2026Why Do Large Language Models Generate Harmful Content?cited by 0
- 2026First, Do No Harm (With LLMs): Mitigating Racial Bias via Agentic Workflowscited by 0
- 2026Saying More Than They Know: A Framework for Quantifying Epistemic-Rhetorical Miscalibration in Large Language Modelscited by 0
- 2026Fairness-Aware Retrieval Optimization for Retrieval-Augmented Generationcited by 0
- 2026Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learningcited by 0
- 2026GAS-Leak-LLM: Genetic Algorithm-Based Suffix Optimization for Black-Box LLM Jailbreakingcited by 0
- 2026Wasted large language models: A life cycle thinking approachcited by 0
- 2026Wasted large language models: A life cycle thinking approach17 Aug 2026
- 2026GAS-Leak-LLM: Genetic Algorithm-Based Suffix Optimization for Black-Box LLM Jailbreaking14 Jun 2026
- 2026Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learning6 Jun 2026
- 2026Fairness-Aware Retrieval Optimization for Retrieval-Augmented Generation15 May 2026
- 2026First, Do No Harm (With LLMs): Mitigating Racial Bias via Agentic Workflows20 Apr 2026
- 2026Why Do Large Language Models Generate Harmful Content?13 Apr 2026
- 2026MLLM-as-a-Judge Exhibits Model Preference Bias13 Apr 2026
- 2026Saying More Than They Know: A Framework for Quantifying Epistemic-Rhetorical Miscalibration in Large Language Models27 Mar 2026
- 2026Emergently Misaligned Language Models Show Behavioral Self-Awareness That Shifts With Subsequent Realignment16 Feb 2026
- 2026The GDN-CC Dataset: Automatic Corpus Clarification for AI-enhanced Democratic Citizen Consultations21 Jan 2026
- 2026Measuring Political Stance and Consistency in Large Language Models15 Jan 2026
- 2026Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection8 Jan 2026
15 more
- 2026CALM: Culturally Self-Aware Language Models7 Jan 2026
- 2025Building Trust in Clinical LLMs: Bias Analysis and Dataset Transparency21 Oct 2025
- 2025'Rich Dad, Poor Lad': How do Large Language Models Contextualize Socioeconomic Factors in College Admission ?19 Sep 2025
- 2025Bias after Prompting: Persistent Discrimination in Large Language Models9 Sep 2025
- 2025A Close Reading Approach to Gender Narrative Biases in AI-Generated Stories13 Aug 2025
- 2025Do They Understand Them? An Updated Evaluation on Nonbinary Pronoun Handling in Large Language Models1 Aug 2025
- 2025Audit, Alignment, and Optimization of LM-Powered Subroutines with Application to Public Comment Processing10 Jul 2025
- 2025A Multi-Agent Probabilistic Inference Framework Inspired by Kairanban-Style CoT System with IdoBata Conversation for Debiasing12 Jun 2025
- 2025Towards Efficient and Effective Alignment of Large Language Models11 Jun 2025
- 2025Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?31 May 2025
- 2025Colombian Waitresses y Jueces canadienses: Gender and Country Biases in Occupation Recommendations from LLMs5 May 2025
- 2025Mind the Language Gap: Automated and Augmented Evaluation of Bias in LLMs for High- and Low-Resource Languages19 Apr 2025
- 2025Agent-Enhanced Large Language Models for Researching Political Institutions14 Mar 2025
- 2025Fairness in Agentic AI: A Unified Framework for Ethical and Equitable Multi-Agent System11 Feb 2025
- 2025Comprehensive Framework for Evaluating Conversational AI Chatbots10 Feb 2025
- 2025Fairness in Agentic AI: A Unified Framework for Ethical and Equitable Multi-Agent Systemcited by 5
- 2025Agent-Enhanced Large Language Models for Researching Political Institutionscited by 1
- 2025A Multi-Agent Probabilistic Inference Framework Inspired by Kairanban-Style CoT System with IdoBata Conversation for Debiasingcited by 0
- 2026First, Do No Harm (With LLMs): Mitigating Racial Bias via Agentic Workflowscited by 0
- 2026First, Do No Harm (With LLMs): Mitigating Racial Bias via Agentic Workflows20 Apr 2026
- 2025A Multi-Agent Probabilistic Inference Framework Inspired by Kairanban-Style CoT System with IdoBata Conversation for Debiasing12 Jun 2025
- 2025Agent-Enhanced Large Language Models for Researching Political Institutions14 Mar 2025
- 2025Fairness in Agentic AI: A Unified Framework for Ethical and Equitable Multi-Agent System11 Feb 2025
- 2025Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?cited by 7
- 2026Emergently Misaligned Language Models Show Behavioral Self-Awareness That Shifts With Subsequent Realignmentcited by 4
- 2025Towards Efficient and Effective Alignment of Large Language Modelscited by 0
- 2025Audit, Alignment, and Optimization of LM-Powered Subroutines with Application to Public Comment Processingcited by 0
- 2026Emergently Misaligned Language Models Show Behavioral Self-Awareness That Shifts With Subsequent Realignment16 Feb 2026
- 2025Audit, Alignment, and Optimization of LM-Powered Subroutines with Application to Public Comment Processing10 Jul 2025
- 2025Towards Efficient and Effective Alignment of Large Language Models11 Jun 2025
- 2025Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?31 May 2025
- 2026Wasted large language models: A life cycle thinking approach17 Aug 2026
- 2026MLLM-as-a-Judge Exhibits Model Preference Biascited by 1
- 2026MLLM-as-a-Judge Exhibits Model Preference Bias13 Apr 2026
- 2025Colombian Waitresses y Jueces canadienses: Gender and Country Biases in Occupation Recommendations from LLMscited by 7
- 2025Mind the Language Gap: Automated and Augmented Evaluation of Bias in LLMs for High- and Low-Resource Languagescited by 4
- 2025Bias after Prompting: Persistent Discrimination in Large Language Modelscited by 3
- 2025Building Trust in Clinical LLMs: Bias Analysis and Dataset Transparencycited by 3
- 2025Comprehensive Framework for Evaluating Conversational AI Chatbotscited by 2
- 2026CALM: Culturally Self-Aware Language Modelscited by 2
- 2026Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detectioncited by 2
- 2025'Rich Dad, Poor Lad': How do Large Language Models Contextualize Socioeconomic Factors in College Admission ?cited by 1
- 2025Do They Understand Them? An Updated Evaluation on Nonbinary Pronoun Handling in Large Language Modelscited by 0
- 2025A Close Reading Approach to Gender Narrative Biases in AI-Generated Storiescited by 0
- 2026The GDN-CC Dataset: Automatic Corpus Clarification for AI-enhanced Democratic Citizen Consultationscited by 0
- 2026Measuring Political Stance and Consistency in Large Language Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learning6 Jun 2026
- 2026Saying More Than They Know: A Framework for Quantifying Epistemic-Rhetorical Miscalibration in Large Language Models27 Mar 2026
- 2026The GDN-CC Dataset: Automatic Corpus Clarification for AI-enhanced Democratic Citizen Consultations21 Jan 2026
- 2026Measuring Political Stance and Consistency in Large Language Models15 Jan 2026
- 2026Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection8 Jan 2026
- 2026CALM: Culturally Self-Aware Language Models7 Jan 2026
- 2025Building Trust in Clinical LLMs: Bias Analysis and Dataset Transparency21 Oct 2025
- 2025'Rich Dad, Poor Lad': How do Large Language Models Contextualize Socioeconomic Factors in College Admission ?19 Sep 2025
- 2025Bias after Prompting: Persistent Discrimination in Large Language Models9 Sep 2025
- 2025A Close Reading Approach to Gender Narrative Biases in AI-Generated Stories13 Aug 2025
- 2025Do They Understand Them? An Updated Evaluation on Nonbinary Pronoun Handling in Large Language Models1 Aug 2025
- 2025Colombian Waitresses y Jueces canadienses: Gender and Country Biases in Occupation Recommendations from LLMs5 May 2025
12 newest of 14 All 14 (JSON)