Racial Disparity in Natural Language Processing: A Case Study of Social Media African-American English
Not on the map. Why?
Abstract (arXiv)
We highlight an important frontier in algorithmic fairness: disparity in the quality of natural language processing algorithms when applied to language from authors of different social groups. For example, current systems sometimes analyze the language of females and minorities more poorly than they do of whites and males. We conduct an empirical analysis of racial disparity in language identification for tweets written in African-American English, and discuss implications of disparity in NLP.
Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 13; 2023: 16; 2024: 19; 2025: 8; 2026: 7.
71 papers.
Sort:
By area:
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
- 2023Data Selection for Language Models via Importance Resamplingcited by 329
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
- 2021Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metricscited by 83
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2022Multi-VALUE: A Framework for Cross-Dialectal English NLPcited by 53
- 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Paperscited by 49
- 2022VALUE: Understanding Dialect Disparity in NLUcited by 47
- 2024Dialect prejudice predicts AI decisions about people's character, employability, and criminalitycited by 37
38 more
- 2023Evaluation of African American Language Bias in Natural Language Generationcited by 36
- 2024History, Development, and Principles of Large Language Models-An Introductory Surveycited by 30
- 2023Understanding and Mitigating the Label Noise in Pre-training on Downstream Taskscited by 27
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Surveycited by 23
- 2023A Material Lens on Coloniality in NLPcited by 21
- 2022Challenges in Applying Explainability Methods to Improve the Fairness of NLP Modelscited by 20
- 2025Rejected Dialects: Biases Against African American Language in Reward Modelscited by 20
- 2022How to keep text private? A systematic review of deep learning methods for privacy-preserving natural language processingcited by 16
- 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
- 2024The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biasescited by 16
- 2021Fair Enough: Searching for Sufficient Measures of Fairnesscited by 14
- 2021Automated Quality Assessment of Cognitive Behavioral Therapy Sessions Through Highly Contextualized Language Representationscited by 13
- 2022Putting the Con in Context: Identifying Deceptive Actors in the Game of Mafiacited by 13
- 2023DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic Rulescited by 13
- 2024The Sociolinguistic Foundations of Language Modelingcited by 13
- 2021Hate Speech Classifiers Learn Human-Like Social Stereotypescited by 12
- 2021Learning to be Fair: A Consequentialist Approach to Equitable Decision-Makingcited by 11
- 2024"Cold, Calculated, and Condescending": How AI Identifies and Explains Ableism Compared to Disabled Peoplecited by 10
- 2023In the Name of Fairness: Assessing the Bias in Clinical Record De-identificationcited by 9
- 2023Task-Agnostic Low-Rank Adapters for Unseen English Dialectscited by 9
- 2022Detecting Harmful Online Conversational Content towards LGBTQIA+ Individualscited by 8
- 2024Impact of Noisy Supervision in Foundation Model Learningcited by 8
- 2022Richer Countries and Richer Representationscited by 7
- 2022TESTSGD: Interpretable Testing of Neural Networks Against Subtle Group Discriminationcited by 7
- 2022Measuring and signing fairness as performance under multiple stakeholder distributionscited by 6
- 2024Toward Informal Language Processing: Knowledge of Slang in Large Language Modelscited by 6
- 2023Transcending the "Male Code": Implicit Masculine Biases in NLP Contextscited by 5
- 2023Adding guardrails to advanced chatbotscited by 5
- 2025EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Modelscited by 5
- 2022Fairness for Text Classification Tasks with Identity Information Data Augmentation Methodscited by 4
- 2025Attention to Non-Adopterscited by 4
- 2022Towards a Deep Multi-layered Dialectal Language Analysis: A Case Study of African-American Englishcited by 3
- 2023Hateful Messages: A Conversational Data Set of Hate Speech produced by Adolescents on Discordcited by 3
- 2025Data Caricatures: On the Representation of African American Language in Pretraining Corporacited by 3
- 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governancecited by 3
- 2024Towards Better Inclusivity: A Diverse Tweet Corpus of English Varietiescited by 2
- 2024Reexamining Racial Disparities in Automatic Speech Recognition Performance: The Role of Confounding by Provenancecited by 2
- 2024STOP! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressionscited by 2
50 most cited of 71 All 71 (JSON)
- 2026Is the ACL Responsible NLP Checklist a Box-Ticking Exercise? A Large-Scale Analysis of EMNLP 202510 Aug 2026
- 2026Rethinking Indic AI from a Lens of Cultural Heritage Preservation7 Jul 2026
- 2026Who Do Language Models Think Is Competent? A Mechanistic Analysis of Occupational Bias15 Jun 2026
- 2026Reflections and New Directions for Human-Centered Large Language Models7 May 2026
- 2026Evaluating the Usage of African-American Vernacular English in Large Language Models25 Feb 2026
- 2026Regional Bias in Large Language Models22 Jan 2026
- 2026AfroScope: A Framework for Studying the Linguistic Landscape of Africa19 Jan 2026
- 2025Attention to Non-Adopters10 Oct 2025
- 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governance10 Jul 2025
- 2025From Measurement to Mitigation: Exploring the Transferability of Debiasing Approaches to Gender Bias in Maltese Language Models3 Jul 2025
- 2025Revisiting Common Assumptions about Arabic Dialects in NLP27 May 2025
- 2025Data Caricatures: On the Representation of African American Language in Pretraining Corpora13 Mar 2025
38 more
- 2025EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Models25 Feb 2025
- 2025Rejected Dialects: Biases Against African American Language in Reward Models18 Feb 2025
- 2025Using Contextually Aligned Online Reviews to Measure LLMs' Performance Disparities Across Language Varieties10 Feb 2025
- 2024Large Language Model Safety: A Holistic Survey23 Dec 2024
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigation16 Nov 2024
- 2024Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models17 Oct 2024
- 2024"Cold, Calculated, and Condescending": How AI Identifies and Explains Ableism Compared to Disabled People4 Oct 2024
- 2024STOP! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressions20 Sep 2024
- 2024It is Time to Develop an Auditing Framework to Promote Value Aware Chatbots3 Sep 2024
- 2024Downstream bias mitigation is all you need1 Aug 2024
- 2024Reexamining Racial Disparities in Automatic Speech Recognition Performance: The Role of Confounding by Provenance19 Jul 2024
- 2024The Sociolinguistic Foundations of Language Modeling12 Jul 2024
- 2024Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness14 Jun 2024
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey8 Jun 2024
- 2024Toward Informal Language Processing: Knowledge of Slang in Large Language Models2 Apr 2024
- 2024Impact of Noisy Supervision in Foundation Model Learning11 Mar 2024
- 2024Dialect prejudice predicts AI decisions about people's character, employability, and criminality1 Mar 2024
- 2024ARTiST: Automated Text Simplification for Task Guidance in Augmented Reality29 Feb 2024
- 2024History, Development, and Principles of Large Language Models-An Introductory Survey10 Feb 2024
- 2024Towards Better Inclusivity: A Diverse Tweet Corpus of English Varieties21 Jan 2024
- 2024The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biases19 Jan 2024
- 2024Fairness Certification for Natural Language Processing and Large Language Models2 Jan 2024
- 2023A Material Lens on Coloniality in NLP14 Nov 2023
- 2023Task-Agnostic Low-Rank Adapters for Unseen English Dialects2 Nov 2023
- 2023Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks29 Sep 2023
- 2023Hateful Messages: A Conversational Data Set of Hate Speech produced by Adolescents on Discord4 Sep 2023
- 2023Bias and Fairness in Large Language Models: A Survey2 Sep 2023
- 2023AI and ethics in insurance: a new solution to mitigate proxy discrimination in risk modeling25 Jul 2023
- 2023Adding guardrails to advanced chatbots13 Jun 2023
- 2023Evaluation of African American Language Bias in Natural Language Generation23 May 2023
- 2023DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic Rules22 May 2023
- 2023In the Name of Fairness: Assessing the Bias in Clinical Record De-identification18 May 2023
- 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining17 May 2023
- 2023Transcending the "Male Code": Implicit Masculine Biases in NLP Contexts22 Apr 2023
- 2023Understanding Lexical Biases when Identifying Gang-related Social Media Communications22 Apr 2023
- 2023Fairness in Language Models Beyond English: Gaps and Challenges24 Feb 2023
- 2023Data Selection for Language Models via Importance Resampling6 Feb 2023
- 2023Less, but Stronger: On the Value of Strong Heuristics in Semi-supervised Learning for Software Analytics3 Feb 2023
50 newest of 71 All 71 (JSON)
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2024Large Language Model Safety: A Holistic Survey23 Dec 2024
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
- 2023Data Selection for Language Models via Importance Resamplingcited by 329
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
- 2021Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metricscited by 83
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2022Multi-VALUE: A Framework for Cross-Dialectal English NLPcited by 53
- 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Paperscited by 49
- 2022VALUE: Understanding Dialect Disparity in NLUcited by 47
- 2024Dialect prejudice predicts AI decisions about people's character, employability, and criminalitycited by 37
- 2023Evaluation of African American Language Bias in Natural Language Generationcited by 36
12 most cited of 68 All 68 (JSON)
- 2026Is the ACL Responsible NLP Checklist a Box-Ticking Exercise? A Large-Scale Analysis of EMNLP 202510 Aug 2026
- 2026Rethinking Indic AI from a Lens of Cultural Heritage Preservation7 Jul 2026
- 2026Reflections and New Directions for Human-Centered Large Language Models7 May 2026
- 2026Evaluating the Usage of African-American Vernacular English in Large Language Models25 Feb 2026
- 2026Regional Bias in Large Language Models22 Jan 2026
- 2026AfroScope: A Framework for Studying the Linguistic Landscape of Africa19 Jan 2026
- 2025Attention to Non-Adopters10 Oct 2025
- 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governance10 Jul 2025
- 2025From Measurement to Mitigation: Exploring the Transferability of Debiasing Approaches to Gender Bias in Maltese Language Models3 Jul 2025
- 2025Revisiting Common Assumptions about Arabic Dialects in NLP27 May 2025
- 2025Data Caricatures: On the Representation of African American Language in Pretraining Corpora13 Mar 2025
- 2025EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Models25 Feb 2025
12 newest of 68 All 68 (JSON)