# Advancing Data Equity: Practitioner Responsibility and Accountability in NLP Data Practices

arXiv: https://arxiv.org/abs/2508.10071 · HTML: https://mlsanity.com/paper/2508.10071/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 14 of its 82 references that are in the map.
- First posted on arXiv 13 Aug 2025.

## Builds on (most cited first, 14 of 14)

- [The State and Fate of Linguistic Diversity and Inclusion in the NLP World](https://mlsanity.com/paper/2004.09095/) (2020)
- [AI and the Everything in the Whole Wide World Benchmark](https://mlsanity.com/paper/2111.15366/) (2021)
- [Data and its (dis)contents: A survey of dataset development and use in machine learning research](https://mlsanity.com/paper/2012.05345/) (2020)
- [Social Biases in NLP Models as Barriers for Persons with Disabilities](https://mlsanity.com/paper/2005.00813/) (2020)
- [Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learning](https://mlsanity.com/paper/1912.10389/) (2019)
- [Participation is not a Design Fix for Machine Learning](https://mlsanity.com/paper/2007.02423/) (2020)
- [Re-imagining Algorithmic Fairness in India and Beyond](https://mlsanity.com/paper/2101.09995/) (2021)
- [Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation](https://mlsanity.com/paper/2205.00501/) (2022)
- [Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation](https://mlsanity.com/paper/2112.04554/) (2021)
- [Auditing Cross-Cultural Consistency of Human-Annotated Labels for Recommendation Systems](https://mlsanity.com/paper/2305.05917/) (2023)
- [Data Representativeness in Accessibility Datasets: A Meta-Analysis](https://mlsanity.com/paper/2207.08037/) (2022)
- ["This is not a data problem": Algorithms and Power in Public Higher Education in Canada](https://mlsanity.com/paper/2403.13969/) (2024)
- [Towards a Non-Ideal Methodological Framework for Responsible ML](https://mlsanity.com/paper/2401.11131/) (2024)
- [The Equitable AI Research Roundtable (EARR): Towards Community-Based Decision Making in Responsible AI Development](https://mlsanity.com/paper/2303.08177/) (2023)

## Abstract (arXiv)

While research has focused on surfacing and auditing algorithmic bias to ensure equitable AI development, less is known about how NLP practitioners - those directly involved in dataset development, annotation, and deployment - perceive and navigate issues of NLP data equity. This study is among the first to center practitioners' perspectives, linking their experiences to a multi-scalar AI governance framework and advancing participatory recommendations that bridge technical, policy, and community domains. Drawing on a 2024 questionnaire and focus group, we examine how U.S.-based NLP data practitioners conceptualize fairness, contend with organizational and systemic constraints, and engage emerging governance efforts such as the U.S. AI Bill of Rights. Findings reveal persistent tensions between commercial objectives and equity commitments, alongside calls for more participatory and accountable data workflows. We critically engage debates on data diversity and diversity washing, arguing that improving NLP equity requires structural governance reforms that support practitioner agency and community consent.
