`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values
Not on the map. Why?
Abstract (arXiv)
Recently, the AI/ML research community has indicated an urgent need to establish Responsible AI (RAI) values and practices as part of the AI/ML lifecycle. Several organizations and communities are responding to this call by sharing RAI guidelines. However, there are gaps in awareness, deliberation, and execution of such practices for multi-disciplinary ML practitioners. This work contributes to the discussion by unpacking co-production challenges faced by practitioners as they align their RAI values. We interviewed 23 individuals, across 10 organizations, tasked to ship AI/ML based products while upholding RAI norms and found that both top-down and bottom-up institutional structures create burden for different roles preventing them from upholding RAI values, a challenge that is further exacerbated when executing conflicted values. We share multiple value levers used as strategies by the practitioners to resolve their challenges. We end our paper with recommendations for inclusive and equitable RAI value-practices, creating supportive organizational structures and opportunities to further aid practitioners.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 34 of its 119 references that are in the map. First posted on arXiv 14 Jul 2023.
Builds on
34 of 119 references.
References · 34
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2018IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architecturescited by 866
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2019Principles alone cannot guarantee ethical AIcited by 134
- 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
- 2019Artificial Intelligence: the global landscape of ethics guidelinescited by 107
- 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
- 2019Problem Formulation and Fairnesscited by 85
- 2017What Does Explainable AI Really Mean? A New Conceptualization of Perspectivescited by 72
- 2022Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotationcited by 67
- 2022How Different Groups Prioritize Ethical Values for Responsible AIcited by 49
- 2021The Who in XAI: How AI Background Shapes Perceptions of AI Explanationscited by 48
22 more
- 2020Algorithmic Fairness in Educationcited by 44
- 2020Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practicescited by 38
- 2022The Forgotten Margins of AI Ethicscited by 30
- 2020Artificial Intelligence for Social Good: A Surveycited by 29
- 2021Envisioning Communities: A Participatory Approach Towards AI for Social Goodcited by 29
- 2021"Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deploymentcited by 28
- 2021Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"cited by 26
- 2018Impossibility and Uncertainty Theorems in AI Value Alignment (or why your AGI should not have a utility function)cited by 22
- 2019The Role of Cooperation in Responsible AI Developmentcited by 21
- 2018Building Ethics into Artificial Intelligencecited by 19
- 2020Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systemscited by 16
- 2020What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Designcited by 14
- 2021The Contestation of Tech Ethics: A Sociotechnical Approach to Technology Ethics in Practicecited by 12
- 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systemscited by 12
- 2016On the (im)possibility of fairnesscited by 11
- 2019Enabling Value Sensitive AI Systems through Participatory Design Fictionscited by 11
- 2021Black Feminist Musings on Algorithmic Oppressioncited by 11
- 2021Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithmscited by 11
- 2021The Moral Consideration of Artificial Entities: A Literature Reviewcited by 10
- 2018The Key Concepts of Ethics of Artificial Intelligence - A Keyword based Systematic Mapping Studycited by 4
- 2018AI for the Common Good?! Pitfalls, challenges, and Ethics Pen-Testingcited by 4
- 2020Value-based Engineering for Ethics by Designcited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 7; 2026: 4.
18 papers.
Sort:
By area:
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agentscited by 18
- 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
- 2024Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Studentscited by 8
- 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
- 2024Data Ethics Emergency Drill: A Toolbox for Discussing Responsible AI for Industry Teamscited by 3
- 2025Street Review: A Participatory AI-Based Framework for Assessing Streetscape Inclusivitycited by 3
- 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
- 2025Talking About the Assumption in the Roomcited by 2
- 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platformcited by 2
- 2025Does AI Coaching Prepare us for Workplace Negotiations?cited by 2
- 2026Investigating Writing Professionals' Relationships with Generative AI: How Combined Perceptions of Rivalry and Collaboration Shape Work Practices and Outcomescited by 2
6 more
- 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stagescited by 1
- 2025The Value of Gen-AI Conversations: A bottom-up Framework for AI Value Alignmentcited by 0
- 2025A Human Behavioral Baseline for Collective Governance in Software Projectscited by 0
- 2026Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 IIcited by 0
- 2026Value-Sensitive Delegation in Everyday AI Agent Use: Evidence from OpenClawcited by 0
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focuscited by 0
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focus22 Sep 2026
- 2026Value-Sensitive Delegation in Everyday AI Agent Use: Evidence from OpenClaw18 Sep 2026
- 2026Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 II27 Mar 2026
- 2026Investigating Writing Professionals' Relationships with Generative AI: How Combined Perceptions of Rivalry and Collaboration Shape Work Practices and Outcomes9 Feb 2026
- 2025A Human Behavioral Baseline for Collective Governance in Software Projects10 Oct 2025
- 2025Does AI Coaching Prepare us for Workplace Negotiations?26 Sep 2025
- 2025Street Review: A Participatory AI-Based Framework for Assessing Streetscape Inclusivity14 Aug 2025
- 2025The Value of Gen-AI Conversations: A bottom-up Framework for AI Value Alignment26 Jun 2025
- 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stages15 May 2025
- 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platform8 Apr 2025
- 2025Talking About the Assumption in the Room18 Feb 2025
- 2024Position: Towards Bidirectional Human-AI Alignment13 Jun 2024
6 more
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agents4 Apr 2024
- 2024Data Ethics Emergency Drill: A Toolbox for Discussing Responsible AI for Industry Teams15 Mar 2024
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototyping23 Feb 2024
- 2024Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Students26 Jan 2024
- 2023The Value-Sensitive Conversational Agent Co-Design Framework18 Oct 2023
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agentscited by 18
- 2024Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Studentscited by 8
- 2024Data Ethics Emergency Drill: A Toolbox for Discussing Responsible AI for Industry Teamscited by 3
- 2025Street Review: A Participatory AI-Based Framework for Assessing Streetscape Inclusivitycited by 3
- 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
- 2025Talking About the Assumption in the Roomcited by 2
- 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platformcited by 2
- 2025Does AI Coaching Prepare us for Workplace Negotiations?cited by 2
- 2026Investigating Writing Professionals' Relationships with Generative AI: How Combined Perceptions of Rivalry and Collaboration Shape Work Practices and Outcomescited by 2
- 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stagescited by 1
- 2025A Human Behavioral Baseline for Collective Governance in Software Projectscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focus22 Sep 2026
- 2026Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 II27 Mar 2026
- 2026Investigating Writing Professionals' Relationships with Generative AI: How Combined Perceptions of Rivalry and Collaboration Shape Work Practices and Outcomes9 Feb 2026
- 2025A Human Behavioral Baseline for Collective Governance in Software Projects10 Oct 2025
- 2025Does AI Coaching Prepare us for Workplace Negotiations?26 Sep 2025
- 2025Street Review: A Participatory AI-Based Framework for Assessing Streetscape Inclusivity14 Aug 2025
- 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stages15 May 2025
- 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platform8 Apr 2025
- 2025Talking About the Assumption in the Room18 Feb 2025
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agents4 Apr 2024
- 2024Data Ethics Emergency Drill: A Toolbox for Discussing Responsible AI for Industry Teams15 Mar 2024
12 newest of 14 All 14 (JSON)