mlsanityData to 14 Oct 2026

BiasGuard: A Reasoning-enhanced Bias Detection Tool For Large Language Models

arXiv 2504.21299 ↗First posted 30 Apr 2025cs.CLcited by 4

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Identifying bias in LLM-generated content is a crucial prerequisite for ensuring fairness in LLMs. Existing methods, such as fairness classifiers and LLM-based judges, face limitations related to difficulties in understanding underlying intentions and the lack of criteria for fairness judgment. In this paper, we introduce BiasGuard, a novel bias detection tool that explicitly analyzes inputs and reasons through fairness specifications to provide accurate judgments. BiasGuard is implemented through a two-stage approach: the first stage initializes the model to explicitly reason based on fairness specifications, while the second stage leverages reinforcement learning to enhance its reasoning and judgment capabilities. Our experiments, conducted across five datasets, demonstrate that BiasGuard outperforms existing tools, improving accuracy and reducing over-fairness misjudgments. We also highlight the importance of reasoning-enhanced decision-making and provide evidence for the effectiveness of our two-stage optimization pipeline.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 33 of its 52 references that are in the map. First posted on arXiv 30 Apr 2025.

Builds on

33 of 52 references.

References · 33

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  6. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  7. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  8. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  9. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  10. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  11. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  12. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 422
21 more
  1. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
  2. 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
  3. 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
  4. 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
  5. 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
  6. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  7. 2022Holistic Evaluation of Language Modelscited by 131
  8. 2020UnQovering Stereotyping Biases via Underspecified Questionscited by 126
  9. 2024PAD: Personalized Alignment of LLMs at Decoding-Timecited by 60
  10. 2024Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypescited by 59
  11. 2024Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perceptioncited by 56
  12. 2023Unveiling the Implicit Toxicity in Large Language Modelscited by 51
  13. 2025FairSteer: Inference Time Debiasing for LLMs with Dynamic Activation Steeringcited by 40
  14. 2024FairMT-Bench: Benchmarking Fairness for Multi-turn Dialogue in Conversational LLMscited by 36
  15. 2024Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Modelscited by 33
  16. 2024Learnable Privacy Neurons Localization in Language Modelscited by 27
  17. 2024BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMscited by 21
  18. 2024CEB: Compositional Evaluation Benchmark for Fairness in Large Language Modelscited by 18
  19. 2024GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Constructioncited by 15
  20. 2024Identifying and Mitigating Social Bias Knowledge in Language Modelscited by 13
  21. 2025DiffPO: Diffusion-styled Preference Optimization for Efficient Inference-Time Alignment of Large Language Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

  1. 2025BiasFreeBench: a Benchmark for Mitigating Bias in Large Language Model Responsescited by 2
  2. 2025Detection, Classification, and Mitigation of Gender Bias in Large Language Modelscited by 1
  3. 2026ReLay: Personalized LLM-Generated Plain-Language Summaries for Better Understanding, but at What Cost?cited by 0
  4. 2026KG-FairDiff: Knowledge Graph-Guided Prompt Refinement for Demographically Fair Text-to-Image Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning Towards Fairness: Mitigating Bias in Language Models through Reasoning-Guided Fine-Tuning
  2. 2025Any Large Language Model Can Be a Reliable Judge: Debiasing with a Reasoning-based Bias Detector
  3. 2025Guiding LLM Decision-Making with Fairness Reward Models
  4. 2025BiasFilter: An Inference-Time Debiasing Framework for Large Language Models
  5. 2026Toward Robust LLM-Based Judges: Taxonomic Bias Evaluation and Debiasing Optimization
  6. 2025FairCoder: Probing LLM Bias in High-Stakes Decision Making via Coding Tasks
  7. 2025FairReason: Balancing Reasoning and Social Bias in MLLMs
  8. 2026BiasTrace: Linking Reasoning Behaviours to Biased Outputs in LLMs