mlsanityData to 7 Oct 2026

Knowing Bias, Doing Better: Mitigating Social Bias in LLMs via Know-Bias Neuron Enhancement

arXiv 2601.21864 ↗First posted 29 Jan 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) exhibit social biases that reinforce harmful stereotypes, limiting their safe deployment. Most existing debiasing methods adopt a suppressive paradigm by modifying parameters, prompts, or neurons associated with biased behavior; however, such approaches are often brittle, weakly generalizable, data-inefficient, and prone to degrading general capability. We propose KnowBias, a lightweight and conceptually distinct framework that mitigates bias by strengthening, rather than suppressing, neurons encoding bias-knowledge. KnowBias identifies neurons encoding bias knowledge using a small set of bias-knowledge questions via attribution-based analysis, and selectively enhances them at inference time. This design enables strong debiasing while preserving general capabilities, generalizes across bias types and demographics, and is highly data efficient, requiring only a handful of simple yes/no questions and no retraining. Experiments across multiple benchmarks and LLMs demonstrate consistent state-of-the-art debiasing performance with minimal utility degradation. Data and code are available at https://github.com/JP-25/KnowBias.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

36 of 49 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  5. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  6. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  7. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  8. 2022Toy Models of Superpositioncited by 928
  9. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  10. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
  11. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
  12. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
24 more
  1. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
  2. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  3. 2017Avoiding Discrimination through Causal Reasoningcited by 191
  4. 2020Compositional Explanations of Neuronscited by 172
  5. 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
  6. 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
  7. 2024Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypescited by 58
  8. 2024Evaluating Gender Bias in Large Language Models via Chain-of-Thought Promptingcited by 49
  9. 2024What does the Knowledge Neuron Thesis Have to do with Knowledge?cited by 49
  10. 2019When Choosing Plausible Alternatives, Clever Hans can be Clevercited by 39
  11. 2023Neuron-Level Knowledge Attribution in Large Language Modelscited by 37
  12. 2025FairSteer: Inference Time Debiasing for LLMs with Dynamic Activation Steeringcited by 37
  13. 2023Mitigating Biases for Instruction-following Language Models via Bias Neurons Eliminationcited by 23
  14. 2025Fairness through Difference Awareness: Measuring Desired Group Discrimination in LLMscited by 20
  15. 2023Understanding the Effect of Model Compression on Social Bias in Large Language Modelscited by 19
  16. 2025BiasEdit: Debiasing Stereotyped Language Models via Model Editingcited by 18
  17. 2025Understanding and Mitigating Gender Bias in LLMs via Interpretable Neuron Editingcited by 14
  18. 2024Unveiling Language Competence Neurons: A Psycholinguistic Approach to Model Interpretabilitycited by 8
  19. 2022Task-specific Compression for Multi-task Language Models using Attribution-based Pruningcited by 7
  20. 2025The Achilles' Heel of LLMs: How Altering a Handful of Neurons Can Cripple Language Abilitiescited by 7
  21. 2025What's Not Said Still Hurts: A Description-Based Evaluation Framework for Measuring Social Bias in LLMscited by 6
  22. 2025Reasoning Towards Fairness: Mitigating Bias in Language Models through Reasoning-Guided Fine-Tuningcited by 5
  23. 2025Bias Association Discovery Framework for Open-Ended LLM Generationscited by 4
  24. 2025LFTF: Locating First and Then Fine-Tuning for Mitigating Gender Bias in Large Language Modelscited by 2

Built on by

Not cited yet.