mlsanityData to 14 Oct 2026

Re-contextualizing Fairness in NLP: The Case of India

arXiv 2209.12226 ↗First posted 25 Sep 2022cs.CL cs.CYcited by 55

Not on the map. Why?

Abstract (arXiv)

Recent research has revealed undesirable biases in NLP data and models. However, these efforts focus on social disparities in West, and are not directly portable to other geo-cultural contexts. In this paper, we focus on NLP fair-ness in the context of India. We start with a brief account of the prominent axes of social disparities in India. We build resources for fairness evaluation in the Indian context and use them to demonstrate prediction biases along some of the axes. We then delve deeper into social stereotypes for Region andReligion, demonstrating its prevalence in corpora and models. Finally, we outline a holistic research agenda to re-contextualize NLP fairness research for the Indian context, ac-counting for Indian societal context, bridging technological gaps in NLP capabilities and re-sources, and adapting to Indian cultural values. While we focus on India, this framework can be generalized to other geo-cultural contexts.

Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). Builds on 38 of its 81 references that are in the map. First posted on arXiv 25 Sep 2022.

Builds on

38 of 81 references.

References · 38

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  6. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  7. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  8. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  9. 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
  10. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  11. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
  12. 2020Artificial Intelligence, Values and Alignmentcited by 448
26 more
  1. 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
  2. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
  3. 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
  4. 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
  5. 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 224
  6. 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 209
  7. 2021Societal Biases in Language Generation: Progress and Challengescited by 202
  8. 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
  9. 2021MuRIL: Multilingual Representations for Indian Languagescited by 179
  10. 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
  11. 2018Counterfactual Fairness in Text Classification through Robustnesscited by 151
  12. 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 147
  13. 2021On Releasing Annotator-Level Labels and Information in Datasetscited by 126
  14. 2019On Measuring and Mitigating Biased Inferences of Word Embeddingscited by 112
  15. 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 104
  16. 2019It's All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitutioncited by 103
  17. 2019Perturbation Sensitivity Analysis to Detect Unintended Model Biasescited by 74
  18. 2022Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selectioncited by 53
  19. 2020AI4Bharat-IndicNLP Corpus: Monolingual Corpora and Word Embeddings for Indic Languagescited by 44
  20. 2021Detecting Cross-Geographic Biases in Toxicity Modeling on Social Mediacited by 31
  21. 2020Learning to Recognize Dialect Featurescited by 29
  22. 2021Socially Aware Bias Measurements for Hindi Language Representationscited by 29
  23. 2021Measuring Model Biases in the Absence of Ground Truthcited by 24
  24. 2020AraWEAT: Multidimensional Analysis of Biases in Arabic Word Embeddingscited by 20
  25. 2021Evaluating Gender Bias in Hindi-English Machine Translationcited by 19
  26. 2019Smart, Responsible, and Upper Caste Only: Measuring Caste Attitudes through Large-Scale Analysis of Matrimonial Profilescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 16; 2024: 16; 2025: 16; 2026: 4.

55 papers.

Sort:

By area:

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  3. 2023PaLM 2 Technical Reportcited by 1,162
  4. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  5. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  6. 2024SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safetycited by 77
  7. 2023SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Modelscited by 66
  8. 2023AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applicationscited by 54
  9. 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 48
  10. 2024Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language we Prompt them incited by 46
  11. 2024Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirementscited by 36
  12. 2024IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Contextcited by 32
38 more
  1. 2022The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarkscited by 31
  2. 2023On Evaluating and Mitigating Gender Biases in Multilingual Settingscited by 31
  3. 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 28
  4. 2023Building Socio-culturally Inclusive Stereotype Resources with Community Engagementcited by 25
  5. 2024SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypescited by 24
  6. 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
  7. 2023Global Voices, Local Biases: Socio-Cultural Prejudices across Languagescited by 23
  8. 2025Fairness through Difference Awareness: Measuring Desired Group Discrimination in LLMscited by 20
  9. 2023Indian-BhED: A Dataset for Measuring India-Centric Biases in Large Language Modelscited by 18
  10. 2024ChatGPT Rates Natural Language Explanation Quality Like Humans: But on Which Scales?cited by 17
  11. 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
  12. 2024The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biasescited by 16
  13. 2023Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societiescited by 11
  14. 2025Culture is Everywhere: A Call for Intentionally Cultural Evaluationcited by 10
  15. 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Storiescited by 10
  16. 2023This Prompt is Measuring <MASK>: Evaluating Bias Evaluation in Language Modelscited by 9
  17. 2025FairI Tales: Evaluation of Fairness in Indian Contexts with a Focus on Bias and Stereotypescited by 9
  18. 2025HESEIA: A community-based dataset for evaluating social biases in large language models, co-designed in real school settings in Latin Americacited by 6
  19. 2025Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challengescited by 6
  20. 2024The Case for Globalizing Fairness: A Mixed Methods Study on Colonialism, AI, and Health in Africacited by 5
  21. 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learningcited by 5
  22. 2025OVERT: A Benchmark for Over-Refusal Evaluation on Text-to-Image Modelscited by 5
  23. 2022Cultural Re-contextualization of Fairness Research in Language Technologies in Indiacited by 4
  24. 2025Mind the Gesture: Evaluating AI Sensitivity to Culturally Offensive Non-Verbal Gesturescited by 4
  25. 2023Hyper-parameter Tuning for Fair Classification without Sensitive Attribute Accesscited by 3
  26. 2024GIEBench: Towards Holistic Evaluation of Group Identity-based Empathy for Large Language Modelscited by 3
  27. 2024With a Grain of SALT: Are LLMs Fair Across Social Dimensions?cited by 3
  28. 2025Research Borderlands: Analysing Writing Across Research Culturescited by 3
  29. 2024GeniL: A Multilingual Dataset on Generalizing Languagecited by 2
  30. 2025Purdah and Patriarchy: Evaluating and Mitigating South Asian Biases in Open-Ended Multilingual LLM Generationscited by 2
  31. 2025Social Bias in Multilingual Language Models: A Surveycited by 2
  32. 2025IndiCASA: A Dataset and Bias Evaluation Framework in LLMs Using Contrastive Embedding Similarity in the Indian Contextcited by 2
  33. 2025Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMscited by 2
  34. 2024InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs ready for the Indian Legal Domain?cited by 1
  35. 2024Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Modelscited by 1
  36. 2026Dual-Metric Evaluation of Social Bias in Large Language Models: Evidence from an Underrepresented Nepali Cultural Contextcited by 1
  37. 2023Globalizing Fairness Attributes in Machine Learning: A Case Study on Health in Africacited by 0
  38. 2024ARTiST: Automated Text Simplification for Task Guidance in Augmented Realitycited by 0

50 most cited of 55 All 55 (JSON)