NBIAS: A Natural Language Processing Framework for Bias Identification in Text
Not on the map. Why?
Abstract (arXiv)
Bias in textual data can lead to skewed interpretations and outcomes when the data is used. These biases could perpetuate stereotypes, discrimination, or other forms of unfair treatment. An algorithm trained on biased data may end up making decisions that disproportionately impact a certain group of people. Therefore, it is crucial to detect and remove these biases to ensure the fair and ethical use of data. To this end, we develop a comprehensive and robust framework NBIAS that consists of four main layers: data, corpus construction, model development and an evaluation layer. The dataset is constructed by collecting diverse data from various domains, including social media, healthcare, and job hiring portals. As such, we applied a transformer-based token classification model that is able to identify bias words/ phrases through a unique named entity BIAS. In the evaluation procedure, we incorporate a blend of quantitative and qualitative measures to gauge the effectiveness of our models. We achieve accuracy improvements ranging from 1% to 8% compared to baselines. We are also able to generate a robust understanding of the model functioning. The proposed approach is applicable to a variety of biases and contributes to the fair and ethical use of textual data.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 35 of its 79 references that are in the map. First posted on arXiv 3 Aug 2023.
Builds on
35 of 79 references.
References · 35
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
- 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 147
- 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 143
- 2021A Unified Generative Framework for Various NER Subtaskscited by 141
- 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 121
- 2019Automatically Neutralizing Subjective Bias in Textcited by 105
- 2021On Measures of Biases and Harms in NLPcited by 81
23 more
- 2019TENER: Adapting Transformer Encoder for Named Entity Recognitioncited by 69
- 2018Few-shot classification in Named Entity Recognition Taskcited by 64
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2022Neural Media Bias Detection Using Distant Supervision With BABE -- Bias Annotations By Expertscited by 56
- 2018Multimodal Named Entity Recognition for Short Social Media Postscited by 43
- 2022T-NER: An All-Round Python Library for Transformer-based Named Entity Recognitioncited by 37
- 2019Massive vs. Curated Word Embeddings for Low-Resourced Languages. The Case of Yor`ub'a and Twicited by 33
- 2021Unpacking the Interdependent Systems of Discrimination: Ableist Bias in NLP Systems through an Intersectional Lenscited by 30
- 2022Dbias: Detecting biases and ensuring Fairness in news articlescited by 28
- 2019Semi-Supervised Learning with Scarce Annotationscited by 25
- 2020Named Entity Recognition for Social Media Texts with Semantic Augmentationcited by 23
- 2020Biomedical named entity recognition using BERT in the machine reading comprehension frameworkcited by 22
- 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognitioncited by 22
- 2023An Annotated Dataset for Explainable Interpersonal Risk Factors of Mental Disturbance in Social Media Postscited by 16
- 2021Word Embeddings via Causal Inference: Gender Bias Reducing and Semantic Information Preservingcited by 11
- 2021Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognitioncited by 10
- 2023How Far Can It Go?: On Intrinsic Gender Bias Mitigation for Text Classificationcited by 10
- 2021Combating Unknown Bias with Effective Bias-Conflicting Scoring and Gradient Alignmentcited by 8
- 2021Marked Attribute Bias in Natural Language Inferencecited by 6
- 2022How people talk about each other: Modeling Generalized Intergroup Bias and Emotioncited by 5
- 2022Power of Explanations: Towards automatic debiasing in hate speech detectioncited by 5
- 2023On the Origins of Bias in NLP through the Lens of the Jim Codecited by 5
- 2019Look Again at the Syntax: Relational Graph Convolutional Network for Gendered Ambiguous Pronoun Resolutioncited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 11; 2025: 6; 2026: 3.
23 papers.
Sort:
By area:
- 2024Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technologycited by 17
- 2024MBIAS: Mitigating Bias in Large Language Models While Retaining Contextcited by 15
- 2026Quantifying and Mitigating Self-Preference Bias of LLM Judgescited by 10
- 2024FAIR Enough: How Can We Develop and Assess a FAIR-Compliant Dataset for Large Language Models' Training?cited by 9
- 2024Fake News Detection: Comparative Evaluation of BERT-like Models and Large Language Models with Generative AI-Annotated Datacited by 5
- 2023Unlocking Bias Detection: Leveraging Transformer-Based Models for Content Analysiscited by 4
- 2024Adaptable and Reliable Text Classification using Large Language Modelscited by 4
- 2024FakeWatch: A Framework for Detecting Fake News to Ensure Credible Electionscited by 3
- 2024BEADs: Bias Evaluation Across Domainscited by 3
- 2023FakeWatch ElectionShield: A Benchmarking Framework to Detect Fake News for Credible US Electionscited by 2
- 2024REFINE-LM: Mitigating Language Model Stereotypes via Reinforcement Learningcited by 2
- 2024Desert Camels and Oil Sheikhs: Arab-Centric Red Teaming of Frontier LLMscited by 1
11 more
- 2025FairSense-AI: Responsible AI Meets Sustainabilitycited by 1
- 2025Evaluating LLMs for Demographic-Targeted Social Bias Detection: A Comprehensive Benchmark Studycited by 1
- 2025AI Text Detectors and the Misclassification of Slightly Polished Arabic Textcited by 1
- 2023She had Cobalt Blue Eyes: Prompt Testing to Create Aligned and Sustainable Language Modelscited by 0
- 2024Towards Fairer Health Recommendations: finding informative unbiased samples via Word Sense Disambiguationcited by 0
- 2024Responsible AI in NLP: GUS-Net Span-Level Bias Detection Dataset and Benchmark for Generalizations, Unfairness, and Stereotypescited by 0
- 2025Cross-cultural value alignment frameworks for responsible AI governance: Evidence from China-West comparative analysiscited by 0
- 2025Textual Data Bias Detection and Mitigation -- An Extensible Pipeline with Experimental Evaluationcited by 0
- 2025A Multifaceted Analysis of Social Biases in Large Language Modelscited by 0
- 2026Cross-Lingual Probing and Community-Grounded Analysis of Gender Bias in Low-Resource Bengalicited by 0
- 2026Investigating Disability Representations in Text-to-Image Modelscited by 0
- 2026Quantifying and Mitigating Self-Preference Bias of LLM Judges24 Apr 2026
- 2026Investigating Disability Representations in Text-to-Image Models4 Feb 2026
- 2026Cross-Lingual Probing and Community-Grounded Analysis of Gender Bias in Low-Resource Bengali25 Jan 2026
- 2025A Multifaceted Analysis of Social Biases in Large Language Models16 Dec 2025
- 2025Textual Data Bias Detection and Mitigation -- An Extensible Pipeline with Experimental Evaluation11 Dec 2025
- 2025Cross-cultural value alignment frameworks for responsible AI governance: Evidence from China-West comparative analysis21 Nov 2025
- 2025AI Text Detectors and the Misclassification of Slightly Polished Arabic Text16 Nov 2025
- 2025Evaluating LLMs for Demographic-Targeted Social Bias Detection: A Comprehensive Benchmark Study6 Oct 2025
- 2025FairSense-AI: Responsible AI Meets Sustainability4 Mar 2025
- 2024Fake News Detection: Comparative Evaluation of BERT-like Models and Large Language Models with Generative AI-Annotated Data18 Dec 2024
- 2024Desert Camels and Oil Sheikhs: Arab-Centric Red Teaming of Frontier LLMs31 Oct 2024
- 2024Responsible AI in NLP: GUS-Net Span-Level Bias Detection Dataset and Benchmark for Generalizations, Unfairness, and Stereotypes10 Oct 2024
11 more
- 2024Towards Fairer Health Recommendations: finding informative unbiased samples via Word Sense Disambiguation11 Sep 2024
- 2024REFINE-LM: Mitigating Language Model Stereotypes via Reinforcement Learning18 Aug 2024
- 2024BEADs: Bias Evaluation Across Domains6 Jun 2024
- 2024MBIAS: Mitigating Bias in Large Language Models While Retaining Context18 May 2024
- 2024Adaptable and Reliable Text Classification using Large Language Models17 May 2024
- 2024Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technology10 May 2024
- 2024FakeWatch: A Framework for Detecting Fake News to Ensure Credible Elections14 Mar 2024
- 2024FAIR Enough: How Can We Develop and Assess a FAIR-Compliant Dataset for Large Language Models' Training?19 Jan 2024
- 2023FakeWatch ElectionShield: A Benchmarking Framework to Detect Fake News for Credible US Elections27 Nov 2023
- 2023She had Cobalt Blue Eyes: Prompt Testing to Create Aligned and Sustainable Language Models20 Oct 2023
- 2023Unlocking Bias Detection: Leveraging Transformer-Based Models for Content Analysis30 Sep 2023
- 2025FairSense-AI: Responsible AI Meets Sustainabilitycited by 1
- 2025FairSense-AI: Responsible AI Meets Sustainability4 Mar 2025
- 2024Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technologycited by 17
- 2024MBIAS: Mitigating Bias in Large Language Models While Retaining Contextcited by 15
- 2024FAIR Enough: How Can We Develop and Assess a FAIR-Compliant Dataset for Large Language Models' Training?cited by 9
- 2024Fake News Detection: Comparative Evaluation of BERT-like Models and Large Language Models with Generative AI-Annotated Datacited by 5
- 2023Unlocking Bias Detection: Leveraging Transformer-Based Models for Content Analysiscited by 4
- 2024Adaptable and Reliable Text Classification using Large Language Modelscited by 4
- 2024FakeWatch: A Framework for Detecting Fake News to Ensure Credible Electionscited by 3
- 2024BEADs: Bias Evaluation Across Domainscited by 3
- 2023FakeWatch ElectionShield: A Benchmarking Framework to Detect Fake News for Credible US Electionscited by 2
- 2024REFINE-LM: Mitigating Language Model Stereotypes via Reinforcement Learningcited by 2
- 2025Evaluating LLMs for Demographic-Targeted Social Bias Detection: A Comprehensive Benchmark Studycited by 1
- 2025AI Text Detectors and the Misclassification of Slightly Polished Arabic Textcited by 1
12 most cited of 19 All 19 (JSON)
- 2026Investigating Disability Representations in Text-to-Image Models4 Feb 2026
- 2026Cross-Lingual Probing and Community-Grounded Analysis of Gender Bias in Low-Resource Bengali25 Jan 2026
- 2025A Multifaceted Analysis of Social Biases in Large Language Models16 Dec 2025
- 2025Textual Data Bias Detection and Mitigation -- An Extensible Pipeline with Experimental Evaluation11 Dec 2025
- 2025AI Text Detectors and the Misclassification of Slightly Polished Arabic Text16 Nov 2025
- 2025Evaluating LLMs for Demographic-Targeted Social Bias Detection: A Comprehensive Benchmark Study6 Oct 2025
- 2024Fake News Detection: Comparative Evaluation of BERT-like Models and Large Language Models with Generative AI-Annotated Data18 Dec 2024
- 2024Responsible AI in NLP: GUS-Net Span-Level Bias Detection Dataset and Benchmark for Generalizations, Unfairness, and Stereotypes10 Oct 2024
- 2024Towards Fairer Health Recommendations: finding informative unbiased samples via Word Sense Disambiguation11 Sep 2024
- 2024REFINE-LM: Mitigating Language Model Stereotypes via Reinforcement Learning18 Aug 2024
- 2024BEADs: Bias Evaluation Across Domains6 Jun 2024
- 2024MBIAS: Mitigating Bias in Large Language Models While Retaining Context18 May 2024
12 newest of 19 All 19 (JSON)