The Data-Production Dispositif
Not on the map. Why?
Abstract (arXiv)
Machine learning (ML) depends on data to train and verify models. Very often, organizations outsource processes related to data work (i.e., generating and annotating data and evaluating outputs) through business process outsourcing (BPO) companies and crowdsourcing platforms. This paper investigates outsourced ML data work in Latin America by studying three platforms in Venezuela and a BPO in Argentina. We lean on the Foucauldian notion of dispositif to define the data-production dispositif as an ensemble of discourses, actions, and objects strategically disposed to (re)produce power/knowledge relations in data and labor. Our dispositif analysis comprises the examination of 210 data work instruction documents, 55 interviews with data workers, managers, and requesters, and participant observation. Our findings show that discourses encoded in instructions reproduce and normalize the worldviews of requesters. Precarious working conditions and economic dependency alienate workers, making them obedient to instructions. Furthermore, discourses and social contexts materialize in artifacts, such as interfaces and performance metrics, limiting workers' agency and normalizing specific ways of interpreting data. We conclude by stressing the importance of counteracting the data-production dispositif by fighting alienation and precarization, and empowering data workers to become assets in the quest for high-quality data.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 9 of its 101 references that are in the map. First posted on arXiv 24 May 2022.
Builds on
9 of 101 references.
References · 9
- 2019Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasetscited by 175
- 2021Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Developmentcited by 85
- 2019Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?cited by 64
- 2017A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turkcited by 39
- 2020Between Subjectivity and Imposition: Power Dynamics in Data Annotation for Computer Visioncited by 25
- 2020Data Vision: Learning to See Through Algorithmic Abstractioncited by 11
- 2020Measuring Social Biases of Crowd Workers using Counterfactual Queriescited by 6
- 2020The Future of Work Is Here: Toward a Comprehensive Approach to Artificial Intelligence and Labourcited by 3
- 2021We Haven't Gone Paperless Yet: Why the Printing Press Can Help Us Understand Data and AIcited by 1
Built on by
Citing papers per year: 2023: 8; 2024: 6; 2025: 1; 2026: 1.
16 papers.
Sort:
By area:
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 87
- 2024Participation in the age of foundation modelscited by 32
- 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participantscited by 28
- 2023Weakly Supervised Detection of Hallucinations in LLM Activationscited by 20
- 2023Using Text-to-Image Generation for Architectural Design Ideationcited by 16
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
- 2023Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AIcited by 11
- 2024AI Alignment through Reinforcement Learning from Human Feedback? Contradictions and Limitationscited by 11
- 2024The Necessity of AI Audit Standards Boardscited by 9
- 2024Quality Assured: Rethinking Annotation Strategies in Imaging AIcited by 6
- 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settingscited by 5
- 2023The Ethics of AI Value Chainscited by 3
4 more
- 2023A toolkit of dilemmas: Beyond debiasing and fairness formulas for responsible AI/MLcited by 2
- 2023Making Data Work Countcited by 2
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotationcited by 2
- 2023Investigating Labeler Bias in Face Annotation for Machine Learningcited by 1
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotation11 Feb 2026
- 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settings29 Sep 2025
- 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participants28 Sep 2024
- 2024Quality Assured: Rethinking Annotation Strategies in Imaging AI24 Jul 2024
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Survey11 Jul 2024
- 2024AI Alignment through Reinforcement Learning from Human Feedback? Contradictions and Limitations26 Jun 2024
- 2024Participation in the age of foundation models29 May 2024
- 2024The Necessity of AI Audit Standards Boards11 Apr 2024
- 2023Weakly Supervised Detection of Hallucinations in LLM Activations5 Dec 2023
- 2023Making Data Work Count29 Nov 2023
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice2 Oct 2023
- 2023Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AI12 Aug 2023
4 more
- 2023The Ethics of AI Value Chains31 Jul 2023
- 2023Using Text-to-Image Generation for Architectural Design Ideation20 Apr 2023
- 2023A toolkit of dilemmas: Beyond debiasing and fairness formulas for responsible AI/ML3 Mar 2023
- 2023Investigating Labeler Bias in Face Annotation for Machine Learning24 Jan 2023
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 87
- 2024Participation in the age of foundation modelscited by 32
- 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participantscited by 28
- 2023Weakly Supervised Detection of Hallucinations in LLM Activationscited by 20
- 2023Using Text-to-Image Generation for Architectural Design Ideationcited by 16
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
- 2023Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AIcited by 11
- 2024The Necessity of AI Audit Standards Boardscited by 9
- 2024Quality Assured: Rethinking Annotation Strategies in Imaging AIcited by 6
- 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settingscited by 5
- 2023The Ethics of AI Value Chainscited by 3
- 2023A toolkit of dilemmas: Beyond debiasing and fairness formulas for responsible AI/MLcited by 2
12 most cited of 15 All 15 (JSON)
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotation11 Feb 2026
- 2025Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settings29 Sep 2025
- 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participants28 Sep 2024
- 2024Quality Assured: Rethinking Annotation Strategies in Imaging AI24 Jul 2024
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Survey11 Jul 2024
- 2024Participation in the age of foundation models29 May 2024
- 2024The Necessity of AI Audit Standards Boards11 Apr 2024
- 2023Weakly Supervised Detection of Hallucinations in LLM Activations5 Dec 2023
- 2023Making Data Work Count29 Nov 2023
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice2 Oct 2023
- 2023Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AI12 Aug 2023
- 2023The Ethics of AI Value Chains31 Jul 2023
12 newest of 15 All 15 (JSON)