Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"
Not on the map. Why?
Abstract (arXiv)
There is a growing consensus in HCI and AI research that the design of AI systems needs to engage and empower stakeholders who will be affected by AI. However, the manner in which stakeholders should participate in AI design is unclear. This workshop paper aims to ground what we dub a 'participatory turn' in AI design by synthesizing existing literature on participation and through empirical analysis of its current practices via a survey of recent published research and a dozen semi-structured interviews with AI researchers and practitioners. Based on our literature synthesis and empirical research, this paper presents a conceptual framework for analyzing participatory approaches to AI design and articulates a set of empirical findings that in ensemble detail out the contemporary landscape of participatory practice in AI design. These findings can help bootstrap a more principled discussion on how PD of AI should move forward across AI, HCI, and other research communities.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 6 of its 61 references that are in the map. First posted on arXiv 1 Nov 2021.
Builds on
6 of 61 references.
References · 6
- 2020Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamicscited by 31
- 2020Bridging Machine Learning and Mechanism Design towards Algorithmic Fairnesscited by 30
- 2021A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfarecited by 23
- 2020Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systemscited by 16
- 2020What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Designcited by 14
- 2018Mechanism Design for Social Goodcited by 13
Built on by
Citing papers per year: 2022: 4; 2023: 10; 2024: 7; 2025: 2; 2026: 3.
26 papers.
Sort:
By area:
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2023Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Servicescited by 29
- 2022Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethicscited by 28
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiencescited by 21
- 2022Seamful XAI: Operationalizing Seamful Design in Explainable AIcited by 20
- 2023Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experiencecited by 18
- 2023`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Valuescited by 18
- 2022Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholderscited by 15
- 2023Scaling Laws Do Not Scalecited by 13
- 2023Going public: the role of public participation approaches in commercial AI labscited by 11
- 2023Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AIcited by 9
14 more
- 2022Think About the Stakeholders First! Towards an Algorithmic Transparency Playbook for Regulatory Compliancecited by 7
- 2024Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and Usecited by 6
- 2023Synergizing Human-AI Agency: A Guide of 23 Heuristics for Service Co-Creation with LLM-Based Agentscited by 5
- 2023Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Educationcited by 5
- 2024From Fake Perfects to Conversational Imperfects: Exploring Image-Generative AI as a Boundary Object for Participatory Design of Public Spacescited by 3
- 2024Multi-Group Proportional Representation in Retrievalcited by 2
- 2024Operationalizing the Blueprint for an AI Bill of Rights: Recommendations for Practitioners, Researchers, and Policy Makerscited by 2
- 2024Integrating ESG and AI: A Comprehensive Responsible AI Assessment Frameworkcited by 2
- 2025The Cake that is Intelligence and Who Gets to Bake it: An AI Analogy and its Implications for Participationcited by 1
- 2026Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Studycited by 1
- 2024Reimagining AI in Social Work: Practitioner Perspectives on Incorporating Technology in their Practicecited by 0
- 2025BiaSWE: An Expert Annotated Dataset for Misogyny Detection in Swedishcited by 0
- 2026Information Access of the Oppressed: Freirean Design for Emancipatory Information Accesscited by 0
- 2026A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidancecited by 0
- 2026A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance15 Sep 2026
- 2026Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study16 Feb 2026
- 2026Information Access of the Oppressed: Freirean Design for Emancipatory Information Access14 Jan 2026
- 2025BiaSWE: An Expert Annotated Dataset for Misogyny Detection in Swedish11 Feb 2025
- 2025The Cake that is Intelligence and Who Gets to Bake it: An AI Analogy and its Implications for Participation5 Feb 2025
- 2024From Fake Perfects to Conversational Imperfects: Exploring Image-Generative AI as a Boundary Object for Participatory Design of Public Spaces1 Nov 2024
- 2024Integrating ESG and AI: A Comprehensive Responsible AI Assessment Framework2 Aug 2024
- 2024Operationalizing the Blueprint for an AI Bill of Rights: Recommendations for Practitioners, Researchers, and Policy Makers11 Jul 2024
- 2024Multi-Group Proportional Representation in Retrieval11 Jul 2024
- 2024Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and Use21 May 2024
- 2024Reimagining AI in Social Work: Practitioner Perspectives on Incorporating Technology in their Practice30 Apr 2024
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototyping23 Feb 2024
14 more
- 2023Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Education9 Nov 2023
- 2023Synergizing Human-AI Agency: A Guide of 23 Heuristics for Service Co-Creation with LLM-Based Agents23 Oct 2023
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences6 Oct 2023
- 2023Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI14 Aug 2023
- 2023`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values14 Jul 2023
- 2023Scaling Laws Do Not Scale5 Jul 2023
- 2023Going public: the role of public participation approaches in commercial AI labs16 Jun 2023
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asia19 May 2023
- 2023Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services17 Mar 2023
- 2023Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experience21 Feb 2023
- 2022Seamful XAI: Operationalizing Seamful Design in Explainable AI12 Nov 2022
- 2022Think About the Stakeholders First! Towards an Algorithmic Transparency Playbook for Regulatory Compliance10 Jun 2022
- 2022Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders18 May 2022
- 2022Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics17 Feb 2022
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2023Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Servicescited by 29
- 2022Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethicscited by 28
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiencescited by 21
- 2022Seamful XAI: Operationalizing Seamful Design in Explainable AIcited by 20
- 2023Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experiencecited by 18
- 2023`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Valuescited by 18
- 2022Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholderscited by 15
- 2023Scaling Laws Do Not Scalecited by 13
- 2023Going public: the role of public participation approaches in commercial AI labscited by 11
- 2023Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AIcited by 9
12 most cited of 24 All 24 (JSON)
- 2026A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance15 Sep 2026
- 2026Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study16 Feb 2026
- 2026Information Access of the Oppressed: Freirean Design for Emancipatory Information Access14 Jan 2026
- 2025BiaSWE: An Expert Annotated Dataset for Misogyny Detection in Swedish11 Feb 2025
- 2024From Fake Perfects to Conversational Imperfects: Exploring Image-Generative AI as a Boundary Object for Participatory Design of Public Spaces1 Nov 2024
- 2024Integrating ESG and AI: A Comprehensive Responsible AI Assessment Framework2 Aug 2024
- 2024Operationalizing the Blueprint for an AI Bill of Rights: Recommendations for Practitioners, Researchers, and Policy Makers11 Jul 2024
- 2024Multi-Group Proportional Representation in Retrieval11 Jul 2024
- 2024Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and Use21 May 2024
- 2024Reimagining AI in Social Work: Practitioner Perspectives on Incorporating Technology in their Practice30 Apr 2024
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototyping23 Feb 2024
- 2023Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Education9 Nov 2023
12 newest of 24 All 24 (JSON)