mlsanityData to 14 Oct 2026

Advancing Data Equity: Practitioner Responsibility and Accountability in NLP Data Practices

arXiv 2508.10071 ↗First posted 13 Aug 2025cs.CY cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

While research has focused on surfacing and auditing algorithmic bias to ensure equitable AI development, less is known about how NLP practitioners - those directly involved in dataset development, annotation, and deployment - perceive and navigate issues of NLP data equity. This study is among the first to center practitioners' perspectives, linking their experiences to a multi-scalar AI governance framework and advancing participatory recommendations that bridge technical, policy, and community domains. Drawing on a 2024 questionnaire and focus group, we examine how U.S.-based NLP data practitioners conceptualize fairness, contend with organizational and systemic constraints, and engage emerging governance efforts such as the U.S. AI Bill of Rights. Findings reveal persistent tensions between commercial objectives and equity commitments, alongside calls for more participatory and accountable data workflows. We critically engage debates on data diversity and diversity washing, arguing that improving NLP equity requires structural governance reforms that support practitioner agency and community consent.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 82 references that are in the map. First posted on arXiv 13 Aug 2025.

Builds on

14 of 82 references.

References · 14

  1. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  2. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 349
  3. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 260
  4. 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
  5. 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
  6. 2020Participation is not a Design Fix for Machine Learningcited by 111
  7. 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 104
  8. 2022Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotationcited by 69
  9. 2021Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotationcited by 52
  10. 2023Auditing Cross-Cultural Consistency of Human-Annotated Labels for Recommendation Systemscited by 9
  11. 2022Data Representativeness in Accessibility Datasets: A Meta-Analysiscited by 6
  12. 2024"This is not a data problem": Algorithms and Power in Public Higher Education in Canadacited by 6
2 more
  1. 2024Towards a Non-Ideal Methodological Framework for Responsible MLcited by 4
  2. 2023The Equitable AI Research Roundtable (EARR): Towards Community-Based Decision Making in Responsible AI Developmentcited by 2

Built on by

Not cited yet.