mlsanityData to 7 Oct 2026

BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMs

arXiv 2407.10241 ↗First posted 14 Jul 2024cs.CLcited by 21

Not on the map. Why?

Abstract (arXiv)

Evaluating the bias in Large Language Models (LLMs) becomes increasingly crucial with their rapid development. However, existing evaluation methods rely on fixed-form outputs and cannot adapt to the flexible open-text generation scenarios of LLMs (e.g., sentence completion and question answering). To address this, we introduce BiasAlert, a plug-and-play tool designed to detect social bias in open-text generations of LLMs. BiasAlert integrates external human knowledge with inherent reasoning capabilities to detect bias reliably. Extensive experiments demonstrate that BiasAlert significantly outperforms existing state-of-the-art methods like GPT4-as-A-Judge in detecting bias. Furthermore, through application studies, we demonstrate the utility of BiasAlert in reliable LLM bias evaluation and bias mitigation across various scenarios. Model and code will be publicly released.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 30 of its 47 references that are in the map. First posted on arXiv 14 Jul 2024.

Builds on

30 of 47 references.

References · 30

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  5. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  6. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  7. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  8. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  9. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  10. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
  11. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
  12. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
18 more
  1. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  2. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 410
  3. 2019On Measuring Social Biases in Sentence Encoderscited by 397
  4. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
  5. 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
  6. 2021Societal Biases in Language Generation: Progress and Challengescited by 201
  7. 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
  8. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  9. 2019Reducing Sentiment Bias in Language Models via Counterfactual Evaluationcited by 148
  10. 2020UnQovering Stereotyping Biases via Underspecified Questionscited by 124
  11. 2023Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendationcited by 113
  12. 2023Fast Model Debias with Machine Unlearningcited by 70
  13. 2023BiasAsker: Measuring the Bias in Conversational AI Systemcited by 52
  14. 2024Evaluating Gender Bias in Large Language Models via Chain-of-Thought Promptingcited by 49
  15. 2022Debiasing isn't enough! -- On the Effectiveness of Debiasing MLMs and their Social Biases in Downstream Taskscited by 48
  16. 2023On the Independence of Association Bias and Empirical Fairness in Language Modelscited by 29
  17. 2024Large Language Model Bias Mitigation from the Perspective of Knowledge Editingcited by 16
  18. 2024IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias Indicatorscited by 15

Built on by

Cited by year

Citing papers per year: 2024: 5; 2025: 16.

21 papers.

Sort:

By area:

  1. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
  2. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
  3. 2024PAD: Personalized Alignment of LLMs at Decoding-Timecited by 58
  4. 2025FairSteer: Inference Time Debiasing for LLMs with Dynamic Activation Steeringcited by 37
  5. 2024FairMT-Bench: Benchmarking Fairness for Multi-turn Dialogue in Conversational LLMscited by 36
  6. 2024A Comprehensive Survey of Bias in LLMs: Current Landscape and Future Directionscited by 27
  7. 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 18
  8. 2024Identifying and Mitigating Social Bias Knowledge in Language Modelscited by 13
  9. 2025Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgmentcited by 11
  10. 2025The Bias is in the Details: An Assessment of Cognitive Bias in LLMscited by 10
  11. 2025Unsupervised Concept Vector Extraction for Bias Control in LLMscited by 7
  12. 2025BiasFilter: An Inference-Time Debiasing Framework for Large Language Modelscited by 6
9 more
  1. 2025DiffPO: Diffusion-styled Preference Optimization for Efficient Inference-Time Alignment of Large Language Modelscited by 5
  2. 2025BiasGuard: A Reasoning-enhanced Bias Detection Tool For Large Language Modelscited by 4
  3. 2025No LLM is Free From Bias: A Comprehensive Study of Bias Evaluation in Large Language Modelscited by 3
  4. 2025Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directionscited by 3
  5. 2025Is General-Purpose AI Reasoning Sensitive to Data-Induced Cognitive Biases? Dynamic Benchmarking on Typical Software Engineering Dilemmascited by 2
  6. 2025BiasFreeBench: a Benchmark for Mitigating Bias in Large Language Model Responsescited by 2
  7. 2025Detection, Classification, and Mitigation of Gender Bias in Large Language Modelscited by 1
  8. 2025Cross-Language Bias Examination in Large Language Modelscited by 1
  9. 2025MASteer: Multi-Agent Adaptive Steer Strategy for End-to-End LLM Trustworthiness Repaircited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating Social Bias in RAG Systems: When External Context Helps and Reasoning Hurts
  2. 2024A Multi-LLM Debiasing Framework
  3. 2025Does Reasoning Introduce Bias? A Study of Social Bias Evaluation and Mitigation in LLM Reasoning
  4. 2025An Empirical Survey of Model Merging Algorithms for Social Bias Mitigation
  5. 2026Biases in the Blind Spot: Detecting What LLMs Fail to Mention
  6. 2026BiasTrace: Linking Reasoning Behaviours to Biased Outputs in LLMs
  7. 2023SocialStigmaQA: A Benchmark to Uncover Stigma Amplification in Generative Language Models
  8. 2026Identifying High-Confidence Social Biases in LLMs for Trustworthy Conversational Tutoring Agents