Re-imagining Algorithmic Fairness in India and Beyond
Not on the map. Why?
Abstract (arXiv)
Conventional algorithmic fairness is West-centric, as seen in its sub-groups, values, and methods. In this paper, we de-center algorithmic fairness and analyse AI power in India. Based on 36 qualitative interviews and a discourse analysis of algorithmic deployments in India, we find that several assumptions of algorithmic fairness are challenged. We find that in India, data is not always reliable due to socio-economic factors, ML makers appear to follow double standards, and AI evokes unquestioning aspiration. We contend that localising model fairness alone can be window dressing in India, where the distance between models and oppressed communities is large. Instead, we re-imagine algorithmic fairness in India and provide a roadmap to re-contextualise data and models, empower oppressed communities, and enable Fair-ML ecosystems.
Key facts. Cited by 104 papers in the map (data through 14 Oct 2026). Builds on 32 of its 227 references that are in the map. First posted on arXiv 25 Jan 2021.
Builds on
32 of 227 references.
References · 32
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2018Datasheets for Datasetscited by 1,386
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2018Model Cards for Model Reportingcited by 1,080
- 2016Adversarial Machine Learning at Scalecited by 936
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 209
- 2019Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphologycited by 200
- 2020Fairness in Machine Learningcited by 194
20 more
- 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
- 2017No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing Worldcited by 153
- 2018Counterfactual Fairness in Text Classification through Robustnesscited by 151
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 149
- 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 147
- 2019Towards a Critical Race Methodology in Algorithmic Fairnesscited by 125
- 2018Optimization with Non-Differentiable Constraints with Applications to Fairness, Recall, Churn, and Other Goalscited by 103
- 201850 Years of Test (Un)fairness: Lessons for Machine Learningcited by 101
- 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 101
- 2019Perturbation Sensitivity Analysis to Detect Unintended Model Biasescited by 74
- 2018Residual Unfairness in Fair Machine Learning from Prejudiced Datacited by 49
- 2020Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamicscited by 31
- 2019Global AI Ethics: A Review of the Social Impacts and Ethical Implications of Artificial Intelligencecited by 21
- 2019On the Legal Compatibility of Fairness Definitionscited by 19
- 2020Entity-Switched Datasets: An Approach to Auditing the In-Domain Robustness of Named Entity Recognition Modelscited by 13
- 2018A Broader View on Bias in Automated Decision-Making: Reflecting on Epistemology and Dynamicscited by 10
- 2019Smart, Responsible, and Upper Caste Only: Measuring Caste Attitudes through Large-Scale Analysis of Matrimonial Profilescited by 5
- 2020Expected Utilitarianismcited by 2
- 2018Economic Impact of Discoverability of Localities and Addresses in Indiacited by 1
- 2018Assignment Mechanisms under Distributional Constraintscited by 1
Built on by
Citing papers per year: 2021: 13; 2022: 21; 2023: 19; 2024: 21; 2025: 18; 2026: 12.
104 papers.
Sort:
By area:
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2023PaLM 2 Technical Reportcited by 1,162
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
- 2021Societal Biases in Language Generation: Progress and Challengescited by 202
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
- 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 92
- 2021Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Supportcited by 63
- 2022CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotationcited by 59
- 2022Re-contextualizing Fairness in NLP: The Case of Indiacited by 55
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
38 more
- 2021Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotationcited by 52
- 2022Detecting Shortcut Learning for Fair Medical AI using Shortcut Testingcited by 52
- 2021Changing the World by Changing the Datacited by 51
- 2022Evaluation Gaps in Machine Learning Practicecited by 49
- 2022Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Modelscited by 49
- 2024Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language we Prompt them incited by 46
- 2022Diagnosing failures of fairness transfer across distribution shift in real-world medical settingscited by 45
- 2024A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Modelscited by 45
- 2023Comparing Biases and the Impact of Multilingual Training across Multiple Languagescited by 36
- 2022Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkitscited by 34
- 2024IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Contextcited by 32
- 2021Detecting Cross-Geographic Biases in Toxicity Modeling on Social Mediacited by 31
- 2023On Evaluating and Mitigating Gender Biases in Multilingual Settingscited by 31
- 2022Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethicscited by 28
- 2021Fairness Perceptions of Algorithmic Decision-Making: A Systematic Review of the Empirical Literaturecited by 27
- 2022From plane crashes to algorithmic harm: applicability of safety engineering frameworks for responsible MLcited by 27
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2024Do Generative AI Models Output Harm while Representing Non-Western Cultures: Evidence from A Community-Centered Approachcited by 26
- 2021Reliability Testing for Natural Language Processing Systemscited by 25
- 2022Rethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approachescited by 25
- 2023Building Socio-culturally Inclusive Stereotype Resources with Community Engagementcited by 25
- 2024"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversationscited by 25
- 2024SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypescited by 24
- 2022Cultural Incongruencies in Artificial Intelligencecited by 21
- 2022Evaluating the Diversity, Equity and Inclusion of NLP Technology: A Case Study for Indian Languagescited by 20
- 2022A Human Rights-Based Approach to Responsible AIcited by 20
- 2025Fairness through Difference Awareness: Measuring Desired Group Discrimination in LLMscited by 20
- 2023Indian-BhED: A Dataset for Measuring India-Centric Biases in Large Language Modelscited by 18
- 2025The Case for "Thick Evaluations" of Cultural Representation in AIcited by 17
- 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
- 2024Towards Geographic Inclusion in the Evaluation of Text-to-Image Modelscited by 16
- 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"cited by 15
- 2023Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Applicationcited by 14
- 2025How Deep Is Representational Bias in LLMs? The Cases of Caste and Religioncited by 14
- 2023Scaling Laws Do Not Scalecited by 13
- 2021Beyond "Fairness:" Structural (In)justice Lenses on AI for Educationcited by 12
- 2021FairCanary: Rapid Continuous Explainable Fairnesscited by 12
- 2024Blind Spots and Biases: Exploring the Role of Annotator Cognitive Biases in NLPcited by 11
50 most cited of 104 All 104 (JSON)
- 2026Designing the Future of User Feedback for Generative AI2 Oct 2026
- 2026RupeeBias: Auditing Demographic Bias in Indian Economic Guidance from Large Language Models25 Sep 2026
- 2026Decolonizing Linguistic Policies in Automated Speech Recognition: A Framework for Cross-Culturally Competent Speech AI6 Aug 2026
- 2026Safety Alignment Illusion: The Cross-Lingual Safety Gap in LLMs26 Jul 2026
- 2026Characterizing Cultural Localization in AI-Generated Stories12 Jun 2026
- 2026Detecting and Mitigating Bias by Treating Fairness as a Symmetry Operation2 Jun 2026
- 2026Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South18 May 2026
- 2026Beyond Categories of Caste: Examining Caste Bias and Morality in Text-to-Image AI Models28 Apr 2026
- 2026Sima AIunty: Caste Audit in LLM-Driven Matchmaking31 Mar 2026
- 2026A Unified Framework to Quantify Cultural Intelligence of AI1 Mar 2026
- 2026Compounding Disadvantage: Auditing Intersectional Bias in LLM-Generated Explanations Across Indian and American STEM Education20 Jan 2026
- 2026When LLMs Imagine People: A Human-Centered Persona Brainstorm Audit for Bias and Fairness in Creative Applications19 Jan 2026
38 more
- 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Stories26 Nov 2025
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culture5 Nov 2025
- 2025ABLEIST: Intersectional Disability Bias in LLM-Generated Hiring Scenarios13 Oct 2025
- 2025Towards Open-Ended Discovery for Low-Resource NLP22 Sep 2025
- 2025Invisible Filters: Cultural Bias in Hiring Evaluations Using Large Language Models21 Aug 2025
- 2025Advancing Data Equity: Practitioner Responsibility and Accountability in NLP Data Practices13 Aug 2025
- 2025From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models23 Jul 2025
- 2025How Deep Is Representational Bias in LLMs? The Cases of Caste and Religion22 Jul 2025
- 2025FairI Tales: Evaluation of Fairness in Indian Contexts with a Focus on Bias and Stereotypes29 Jun 2025
- 2025Research Borderlands: Analysing Writing Across Research Cultures1 Jun 2025
- 2025The Multilingual Divide and Its Impact on Global AI Safety27 May 2025
- 2025Fluent but Foreign: Even Regional LLMs Lack Cultural Alignment25 May 2025
- 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning7 May 2025
- 2025Investigating the Capabilities and Limitations of Machine Learning for Identifying Bias in English Language Data with Information and Heritage Professionals1 Apr 2025
- 2025The Case for "Thick Evaluations" of Cultural Representation in AI24 Mar 2025
- 2025Mind the Gesture: Evaluating AI Sensitivity to Culturally Offensive Non-Verbal Gestures24 Feb 2025
- 2025Fairness through Difference Awareness: Measuring Desired Group Discrimination in LLMs4 Feb 2025
- 2025Through the Prism of Culture: Evaluating LLMs' Understanding of Indian Subcultures and Traditions28 Jan 2025
- 2024What Makes An Expert? Reviewing How ML Researchers Define "Expert"31 Oct 2024
- 2024No Free Lunch: Retrieval-Augmented Generation Undermines Fairness in LLMs, Even for Vigilant Users10 Oct 2024
- 2024Nteasee: Understanding Needs in AI for Health in Africa -- A Mixed-Methods Study of Expert and General Population Perspectives4 Sep 2024
- 2024Exploring Bengali Religious Dialect Biases in Large Language Models with Evaluation Perspectives25 Jul 2024
- 2024Do Generative AI Models Output Harm while Representing Non-Western Cultures: Evidence from A Community-Centered Approach20 Jul 2024
- 2024(Unfair) Norms in Fairness Research: A Meta-Analysis17 Jun 2024
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art6 Jun 2024
- 2024Sociotechnical Implications of Generative Artificial Intelligence for Information Access19 May 2024
- 2024"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversations8 May 2024
- 2024Towards Geographic Inclusion in the Evaluation of Text-to-Image Models7 May 2024
- 2024New contexts, old heuristics: How young people in India and the US trust online content in the age of generative AI3 May 2024
- 2024Blind Spots and Biases: Exploring the Role of Annotator Cognitive Biases in NLP29 Apr 2024
- 2024Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language we Prompt them in29 Apr 2024
- 2024Lazy Data Practices Harm Fairness Research26 Apr 2024
- 2024IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Context29 Mar 2024
- 2024A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Models18 Mar 2024
- 2024SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypes8 Mar 2024
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Survey5 Mar 2024
- 2024The Case for Globalizing Fairness: A Mixed Methods Study on Colonialism, AI, and Health in Africa5 Mar 2024
- 2024InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs ready for the Indian Legal Domain?16 Feb 2024
50 newest of 104 All 104 (JSON)
- 2022A Keyword Based Approach to Understanding the Overpenalization of Marginalized Groups by English Marginal Abuse Models on Twittercited by 1
- 2026Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global Southcited by 1
- 2025From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Modelscited by 0
- 2026Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South18 May 2026
- 2025From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models23 Jul 2025
- 2022A Keyword Based Approach to Understanding the Overpenalization of Marginalized Groups by English Marginal Abuse Models on Twitter7 Oct 2022
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
- 2021Societal Biases in Language Generation: Progress and Challengescited by 202
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
- 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 92
- 2021Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Supportcited by 63
- 2022CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotationcited by 59
- 2022Re-contextualizing Fairness in NLP: The Case of Indiacited by 55
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2021Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotationcited by 52
12 most cited of 96 All 96 (JSON)
- 2026Designing the Future of User Feedback for Generative AI2 Oct 2026
- 2026RupeeBias: Auditing Demographic Bias in Indian Economic Guidance from Large Language Models25 Sep 2026
- 2026Decolonizing Linguistic Policies in Automated Speech Recognition: A Framework for Cross-Culturally Competent Speech AI6 Aug 2026
- 2026Characterizing Cultural Localization in AI-Generated Stories12 Jun 2026
- 2026Detecting and Mitigating Bias by Treating Fairness as a Symmetry Operation2 Jun 2026
- 2026Beyond Categories of Caste: Examining Caste Bias and Morality in Text-to-Image AI Models28 Apr 2026
- 2026Sima AIunty: Caste Audit in LLM-Driven Matchmaking31 Mar 2026
- 2026A Unified Framework to Quantify Cultural Intelligence of AI1 Mar 2026
- 2026Compounding Disadvantage: Auditing Intersectional Bias in LLM-Generated Explanations Across Indian and American STEM Education20 Jan 2026
- 2026When LLMs Imagine People: A Human-Centered Persona Brainstorm Audit for Bias and Fairness in Creative Applications19 Jan 2026
- 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Stories26 Nov 2025
- 2025ABLEIST: Intersectional Disability Bias in LLM-Generated Hiring Scenarios13 Oct 2025
12 newest of 96 All 96 (JSON)