Going public: the role of public participation approaches in commercial AI labs
Not on the map. Why?
Abstract (arXiv)
In recent years, discussions of responsible AI practices have seen growing support for "participatory AI" approaches, intended to involve members of the public in the design and development of AI systems. Prior research has identified a lack of standardised methods or approaches for how to use participatory approaches in the AI development process. At present, there is a dearth of evidence on attitudes to and approaches for participation in the sites driving major AI developments: commercial AI labs. Through 12 semi-structured interviews with industry practitioners and subject-matter experts, this paper explores how commercial AI labs understand participatory AI approaches and the obstacles they have faced implementing these practices in the development of AI systems and research. We find that while interviewees view participation as a normative project that helps achieve "societally beneficial" AI systems, practitioners face numerous barriers to embedding participatory approaches in their companies: participation is expensive and resource intensive, it is "atomised" within companies, there is concern about exploitation, there is no incentive to be transparent about its adoption, and it is complicated by a lack of clear context. These barriers result in a piecemeal approach to participation that confers no decision-making power to participants and has little ongoing impact for AI labs. This papers contribution is to provide novel empirical research on the implementation of public participation in commercial AI labs, and shed light on the current challenges of using participatory approaches in this context.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 19 of its 95 references that are in the map. First posted on arXiv 16 Jun 2023.
Builds on
19 of 95 references.
References · 19
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 155
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
- 2020Participation is not a Design Fix for Machine Learningcited by 110
- 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
- 2022CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotationcited by 59
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 47
- 2020Bringing the People Back In: Contesting Benchmark Machine Learning Datasetscited by 43
- 2023Understanding accountability in algorithmic supply chainscited by 39
- 2020Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamicscited by 31
7 more
- 2021Envisioning Communities: A Participatory Approach Towards AI for Social Goodcited by 29
- 2023Democratising AI: Multiple Meanings, Goals, and Methodscited by 29
- 2021Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"cited by 26
- 2020What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Designcited by 14
- 2021The Limits of Global Inclusion in AI Developmentcited by 14
- 2022Crowdsourcing Impacts: Exploring the Utility of Crowds for Anticipating Societal Impacts of Algorithmic Decision Makingcited by 9
- 2021Towards a New Participatory Approach for Designing Artificial Intelligence and Data-Driven Technologiescited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 3.
11 papers.
- 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 120
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
- 2024Participation in the age of foundation modelscited by 32
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumventioncited by 21
- 2024Epistemic Injustice in Generative AIcited by 16
- 2023Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harmscited by 10
- 2025Stakeholder Participation for Responsible AI Development: Disconnects Between Guidance and Current Practicecited by 5
- 2024Surveys Considered Harmful? Reflecting on the Use of Surveys in AI Research, Development, and Governancecited by 3
- 2025Designing Speech Technologies for Australian Aboriginal English: Opportunities, Risks and Participationcited by 3
- 2023"We'll have to see how it works": An interview study to understand collaborative practices in interdisciplinary artificial intelligence and healthcare researchcited by 0
- 2025RelAItionship Building: Analyzing Recruitment Strategies for Participatory AIcited by 0
- 2025RelAItionship Building: Analyzing Recruitment Strategies for Participatory AI27 Aug 2025
- 2025Stakeholder Participation for Responsible AI Development: Disconnects Between Guidance and Current Practice11 Jun 2025
- 2025Designing Speech Technologies for Australian Aboriginal English: Opportunities, Risks and Participation5 Mar 2025
- 2024Epistemic Injustice in Generative AI21 Aug 2024
- 2024Surveys Considered Harmful? Reflecting on the Use of Surveys in AI Research, Development, and Governance26 Jul 2024
- 2024Collective Constitutional AI: Aligning a Language Model with Public Input12 Jun 2024
- 2024Participation in the age of foundation models29 May 2024
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumvention3 May 2024
- 2023"We'll have to see how it works": An interview study to understand collaborative practices in interdisciplinary artificial intelligence and healthcare research30 Nov 2023
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice2 Oct 2023
- 2023Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harms15 Jul 2023