mlsanityData to 7 Oct 2026

FairPy: A Toolkit for Evaluation of Prediction Biases and their Mitigation in Large Language Models

arXiv 2302.05508 ↗First posted 10 Feb 2023cs.CL cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Recent studies have demonstrated that large pretrained language models (LLMs) such as BERT and GPT-2 exhibit biases in token prediction, often inherited from the data distributions present in their training corpora. In response, a number of mathematical frameworks have been proposed to quantify, identify, and mitigate these the likelihood of biased token predictions. In this paper, we present a comprehensive survey of such techniques tailored towards widely used LLMs such as BERT, GPT-2, etc. We additionally introduce Fairpy, a modular and extensible toolkit that provides plug-and-play interfaces for integrating these mathematical tools, enabling users to evaluate both pretrained and custom language models. Fairpy supports the implementation of existing debiasing algorithms. The toolkit is open-source and publicly available at: hrefhttps://github.com/HrishikeshVish/Fairpyhttps://github.com/HrishikeshVish/Fairpy

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 10 Feb 2023.

Builds on

23 of 31 references.

References · 23

  1. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  2. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  3. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  4. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  5. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
  6. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
  7. 2019On Measuring Social Biases in Sentence Encoderscited by 397
  8. 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 336
  9. 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
  10. 2019Evaluating Gender Bias in Machine Translationcited by 247
  11. 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 222
  12. 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
11 more
  1. 2018Reducing Gender Bias in Abusive Language Detectioncited by 152
  2. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  3. 2021Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Modelscited by 141
  4. 2020UnQovering Stereotyping Biases via Underspecified Questionscited by 124
  5. 2018Assessing Gender Bias in Machine Translation -- A Case Study with Google Translatecited by 121
  6. 2021An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Modelscited by 96
  7. 2020Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Biascited by 82
  8. 2021Mitigating Political Bias in Language Models Through Reinforced Calibrationcited by 73
  9. 2019Reducing Gender Bias in Word-Level Language Models with a Gender-Equalizing Loss Functioncited by 57
  10. 2019Automatic Testing and Improvement of Machine Translationcited by 35
  11. 2021Intersectional Bias in Causal Language Modelscited by 24

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 2; 2025: 1.

5 papers.

  1. 2023Challenges and Applications of Large Language Modelscited by 251
  2. 2024Evaluating Gender Bias in Large Language Models via Chain-of-Thought Promptingcited by 49
  3. 2023Bias and Fairness in Chatbots: An Overviewcited by 20
  4. 2024A Survey on Responsible Generative AI: What to Generate and What Notcited by 8
  5. 2025How AI Fails: An Interactive Pedagogical Tool for Demonstrating Dialectal Bias in Automated Toxicity Modelscited by 0