Participation is not a Design Fix for Machine Learning
Not on the map. Why?
Abstract (arXiv)
This paper critically examines existing modes of participation in design practice and machine learning. Cautioning against 'participation-washing', it suggests that the ML community must become attuned to possibly exploitative and extractive forms of community involvement and shift away from the prerogatives of context-independent scalability.
Key facts. Cited by 110 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 16; 2023: 21; 2024: 12; 2025: 25; 2026: 28.
110 papers.
Sort:
By area:
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
- 2023The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Datasetcited by 148
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
- 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 74
- 2021Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Supportcited by 61
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 47
- 2023Queer In AI: A Case Study in Community-Led Participatory AIcited by 33
- 2024Participation in the age of foundation modelscited by 32
- 2022Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practicecited by 30
- 2021Envisioning Communities: A Participatory Approach Towards AI for Social Goodcited by 29
38 more
- 2022Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethicscited by 28
- 2023Building Socio-culturally Inclusive Stereotype Resources with Community Engagementcited by 25
- 2022Rethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approachescited by 23
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumventioncited by 21
- 2022Seamful XAI: Operationalizing Seamful Design in Explainable AIcited by 20
- 2023Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experiencecited by 18
- 2025Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effectscited by 18
- 2022Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholderscited by 15
- 2022Gathering Strength, Gathering Storms: The One Hundred Year Study on Artificial Intelligence (AI100) 2021 Study Panel Reportcited by 14
- 2023NLP for Maternal Healthcare: Perspectives and Guiding Principles in the Age of LLMscited by 14
- 2022A Systematic Review and Thematic Analysis of Community-Collaborative Approaches to Computing Researchcited by 13
- 2023Scaling Laws Do Not Scalecited by 13
- 2021Beyond "Fairness:" Structural (In)justice Lenses on AI for Educationcited by 12
- 2023Going public: the role of public participation approaches in commercial AI labscited by 11
- 2025Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Userscited by 11
- 2023Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harmscited by 10
- 2024The Future of Open Human Feedbackcited by 10
- 2025"Ownership, Not Just Happy Talk": Co-Designing a Participatory Large Language Model for Journalismcited by 10
- 2023CreoleVal: Multilingual Multitask Benchmarks for Creolescited by 9
- 2023Designing Fiduciary Artificial Intelligencecited by 8
- 2025LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spacescited by 8
- 2021Empowering Local Communities Using Artificial Intelligencecited by 7
- 2022Social Inclusion in Curated Contexts: Insights from Museum Practicescited by 7
- 2025Benchmarking Overton Pluralism in LLMscited by 7
- 2022Are There Exceptions to Goodhart's Law? On the Moral Justification of Fairness-Aware Machine Learningcited by 6
- 2022Data Representativeness in Accessibility Datasets: A Meta-Analysiscited by 6
- 2024Data Feminism for AIcited by 6
- 2024Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and Usecited by 6
- 2022Definition drives design: Disability models and mechanisms of bias in AI technologiescited by 5
- 2023Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Educationcited by 5
- 2025Stakeholder Participation for Responsible AI Development: Disconnects Between Guidance and Current Practicecited by 5
- 2021Design-Driven Requirements for Computationally Co-Creative Game AI Design Toolscited by 3
- 2023FeedbackLogs: Recording and Incorporating Stakeholder Feedback into Machine Learning Pipelinescited by 3
- 2023Human-in-the-loop Fairness: Integrating Stakeholder Feedback to Incorporate Fairness Perspectives in Responsible AIcited by 3
- 2024Understanding "Democratization" in NLP and ML Researchcited by 3
- 2024Surveys Considered Harmful? Reflecting on the Use of Surveys in AI Research, Development, and Governancecited by 3
- 2024Thoughtful Adoption of NLP for Civic Participation: Understanding Differences Among Policymakerscited by 3
- 2025The Right to AIcited by 3
50 most cited of 110 All 110 (JSON)
- 2026Ontology-Based Contextual AI Evaluations (OB-CAIE) Methodology30 Sep 2026
- 2026Towards participatory speech dataset curation: A queer case study and conceptual framework21 Sep 2026
- 2026The Benchmark Trap: Structures of Power and Injustice in AI Evaluations15 Aug 2026
- 2026Co-constructing sociotechnical AI governance: participatory system mapping using algorithm registers12 Aug 2026
- 2026Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safety8 Aug 2026
- 2026Identifying Harm in Personalized, Generative AI Systems Requires User-Centered Auditing at the Interaction Level7 Aug 2026
- 2026Decolonizing Linguistic Policies in Automated Speech Recognition: A Framework for Cross-Culturally Competent Speech AI6 Aug 2026
- 2026Studying People to Study AI: Expert Perspectives on the Epistemic Fit and Barriers of Human Research in AI Safety & Ethics6 Aug 2026
- 2026MonitrLLM: A Community-Centered Evaluation Infrastructure for Large Language Models3 Aug 2026
- 2026TerraNova: A Foundation Model for the Anthropocene31 Jul 2026
- 2026Co-design of LLM-based preference agents: participation may drive overtrust23 Jul 2026
- 2026AI Pluralism and the Worlds It Misses15 Jun 2026
38 more
- 2026Can Data Work be Reparative?8 Jun 2026
- 2026AI From the Margins (AIM): Rethinking Participatory AI Design Through the Lived Experience of Minoritized Communities31 May 2026
- 2026The Illusion of Opting in AI-Mediated Consequential Decisions27 May 2026
- 2026Grounding Text Embeddings in Stakeholder Associations26 May 2026
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraints18 May 2026
- 2026Voices in the Loop: Mapping Participatory AI16 May 2026
- 2026Governing What the EU AI Act Excludes: Accountability for Autonomous AI Agents in Smart City Critical Infrastructure1 May 2026
- 2026Participatory provenance as representational auditing for AI-mediated public consultation22 Apr 2026
- 2026"Taking Stock at FAccT": Using Participatory Design to Co-Create a Vision for the Fairness, Accountability and Transparency Community17 Apr 2026
- 2026Reckoning with the Political Economy of AI: Avoiding Decoys in Pursuit of Accountability17 Apr 2026
- 2026AI of the People, by the People, for the People: A Social Choice Approach to Collective Control of Artificial Intelligence14 Apr 2026
- 2026Beyond the Townhall: Spatial Anchoring and LLM Agents for Scalable Participatory Urban Planning16 Mar 2026
- 2026AI Alignment Breaks at the Edge23 Feb 2026
- 2026Traceable, Enforceable, and Compensable Participation: A Participation Ledger for People-Centered AI Governance11 Feb 2026
- 2026Investigating Writing Professionals' Relationships with Generative AI: How Combined Perceptions of Rivalry and Collaboration Shape Work Practices and Outcomes9 Feb 2026
- 2026Information Access of the Oppressed: Freirean Design for Emancipatory Information Access14 Jan 2026
- 2025Benchmarking Overton Pluralism in LLMs1 Dec 2025
- 2025Attention to Non-Adopters10 Oct 2025
- 2025Towards Meaningful Transparency in Civic AI Systems9 Oct 2025
- 2025An Adaptive Responsible AI Governance Framework for Decentralized Organizations3 Oct 2025
- 2025PolicyPad: Collaborative Prototyping of LLM Policies24 Sep 2025
- 2025RelAItionship Building: Analyzing Recruitment Strategies for Participatory AI27 Aug 2025
- 2025Toward Responsible ASR for African American English Speakers: A Scoping Review of Bias and Equity in Speech Technology20 Aug 2025
- 2025Advancing Data Equity: Practitioner Responsibility and Accountability in NLP Data Practices13 Aug 2025
- 2025Co-Producing AI: Toward an Augmented, Participatory Lifecycle31 Jul 2025
- 2025ONION: A Multi-Layered Framework for Participatory ER Design11 Jul 2025
- 2025ModelCitizens: Representing Community Voices in Online Safety7 Jul 2025
- 2025Telling stories, making Hanzi: AI-assisted co-creation with elderly migrants in urban China2 Jul 2025
- 2025What Is the Point of Equality in Machine Learning Fairness? Beyond Equality of Opportunity20 Jun 2025
- 2025The Role of Generative AI in Facilitating Social Interactions: A Scoping Review12 Jun 2025
- 2025Stakeholder Participation for Responsible AI Development: Disconnects Between Guidance and Current Practice11 Jun 2025
- 2025Secondary Stakeholders in AI: Fighting for, Brokering, and Navigating Agency8 Jun 2025
- 2025Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects24 May 2025
- 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platform8 Apr 2025
- 2025Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Users28 Mar 2025
- 2025Stakeholder Perspectives on Whether and How Social Robots Can Support Mediation and Advocacy for Higher Education Students with Disabilities11 Mar 2025
- 2025Designing Speech Technologies for Australian Aboriginal English: Opportunities, Risks and Participation5 Mar 2025
- 2025LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spaces27 Feb 2025
50 newest of 110 All 110 (JSON)
- 2024The Future of Open Human Feedbackcited by 10
- 2025LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spacescited by 8
- 2026AI Alignment Breaks at the Edgecited by 3
- 2026AI Alignment Breaks at the Edge23 Feb 2026
- 2025LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spaces27 Feb 2025
- 2024The Future of Open Human Feedback15 Aug 2024
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Datasetcited by 148
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
- 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 74
- 2021Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Supportcited by 61
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 47
- 2023Queer In AI: A Case Study in Community-Led Participatory AIcited by 33
- 2024Participation in the age of foundation modelscited by 32
- 2022Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practicecited by 30
- 2021Envisioning Communities: A Participatory Approach Towards AI for Social Goodcited by 29
- 2022Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethicscited by 28
12 most cited of 103 All 103 (JSON)
- 2026Ontology-Based Contextual AI Evaluations (OB-CAIE) Methodology30 Sep 2026
- 2026Towards participatory speech dataset curation: A queer case study and conceptual framework21 Sep 2026
- 2026The Benchmark Trap: Structures of Power and Injustice in AI Evaluations15 Aug 2026
- 2026Co-constructing sociotechnical AI governance: participatory system mapping using algorithm registers12 Aug 2026
- 2026Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safety8 Aug 2026
- 2026Identifying Harm in Personalized, Generative AI Systems Requires User-Centered Auditing at the Interaction Level7 Aug 2026
- 2026Decolonizing Linguistic Policies in Automated Speech Recognition: A Framework for Cross-Culturally Competent Speech AI6 Aug 2026
- 2026Studying People to Study AI: Expert Perspectives on the Epistemic Fit and Barriers of Human Research in AI Safety & Ethics6 Aug 2026
- 2026MonitrLLM: A Community-Centered Evaluation Infrastructure for Large Language Models3 Aug 2026
- 2026TerraNova: A Foundation Model for the Anthropocene31 Jul 2026
- 2026AI Pluralism and the Worlds It Misses15 Jun 2026
- 2026Can Data Work be Reparative?8 Jun 2026
12 newest of 103 All 103 (JSON)