mlsanityData to 7 Oct 2026

`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values

arXiv 2307.10221 ↗First posted 14 Jul 2023cs.AI cs.HCcited by 18

Not on the map. Why?

Abstract (arXiv)

Recently, the AI/ML research community has indicated an urgent need to establish Responsible AI (RAI) values and practices as part of the AI/ML lifecycle. Several organizations and communities are responding to this call by sharing RAI guidelines. However, there are gaps in awareness, deliberation, and execution of such practices for multi-disciplinary ML practitioners. This work contributes to the discussion by unpacking co-production challenges faced by practitioners as they align their RAI values. We interviewed 23 individuals, across 10 organizations, tasked to ship AI/ML based products while upholding RAI norms and found that both top-down and bottom-up institutional structures create burden for different roles preventing them from upholding RAI values, a challenge that is further exacerbated when executing conflicted values. We share multiple value levers used as strategies by the practitioners to resolve their challenges. We end our paper with recommendations for inclusive and equitable RAI value-practices, creating supportive organizational structures and opportunities to further aid practitioners.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 34 of its 119 references that are in the map. First posted on arXiv 14 Jul 2023.

Builds on

34 of 119 references.

References · 34

  1. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  2. 2018IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architecturescited by 866
  3. 2021The Values Encoded in Machine Learning Researchcited by 172
  4. 2019Principles alone cannot guarantee ethical AIcited by 134
  5. 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
  6. 2019Artificial Intelligence: the global landscape of ethics guidelinescited by 107
  7. 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
  8. 2019Problem Formulation and Fairnesscited by 85
  9. 2017What Does Explainable AI Really Mean? A New Conceptualization of Perspectivescited by 72
  10. 2022Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotationcited by 67
  11. 2022How Different Groups Prioritize Ethical Values for Responsible AIcited by 49
  12. 2021The Who in XAI: How AI Background Shapes Perceptions of AI Explanationscited by 48
22 more
  1. 2020Algorithmic Fairness in Educationcited by 44
  2. 2020Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practicescited by 38
  3. 2022The Forgotten Margins of AI Ethicscited by 30
  4. 2020Artificial Intelligence for Social Good: A Surveycited by 29
  5. 2021Envisioning Communities: A Participatory Approach Towards AI for Social Goodcited by 29
  6. 2021"Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deploymentcited by 28
  7. 2021Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"cited by 26
  8. 2018Impossibility and Uncertainty Theorems in AI Value Alignment (or why your AGI should not have a utility function)cited by 22
  9. 2019The Role of Cooperation in Responsible AI Developmentcited by 21
  10. 2018Building Ethics into Artificial Intelligencecited by 19
  11. 2020Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systemscited by 16
  12. 2020What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Designcited by 14
  13. 2021The Contestation of Tech Ethics: A Sociotechnical Approach to Technology Ethics in Practicecited by 12
  14. 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systemscited by 12
  15. 2016On the (im)possibility of fairnesscited by 11
  16. 2019Enabling Value Sensitive AI Systems through Participatory Design Fictionscited by 11
  17. 2021Black Feminist Musings on Algorithmic Oppressioncited by 11
  18. 2021Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithmscited by 11
  19. 2021The Moral Consideration of Artificial Entities: A Literature Reviewcited by 10
  20. 2018The Key Concepts of Ethics of Artificial Intelligence - A Keyword based Systematic Mapping Studycited by 4
  21. 2018AI for the Common Good?! Pitfalls, challenges, and Ethics Pen-Testingcited by 4
  22. 2020Value-based Engineering for Ethics by Designcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 6; 2025: 7; 2026: 4.

18 papers.

Sort:

By area:

  1. 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
  2. 2024Designing for Human-Agent Alignment: Understanding what humans want from their agentscited by 18
  3. 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
  4. 2024Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Studentscited by 8
  5. 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
  6. 2024Data Ethics Emergency Drill: A Toolbox for Discussing Responsible AI for Industry Teamscited by 3
  7. 2025Street Review: A Participatory AI-Based Framework for Assessing Streetscape Inclusivitycited by 3
  8. 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
  9. 2025Talking About the Assumption in the Roomcited by 2
  10. 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platformcited by 2
  11. 2025Does AI Coaching Prepare us for Workplace Negotiations?cited by 2
  12. 2026Investigating Writing Professionals' Relationships with Generative AI: How Combined Perceptions of Rivalry and Collaboration Shape Work Practices and Outcomescited by 2
6 more
  1. 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stagescited by 1
  2. 2025The Value of Gen-AI Conversations: A bottom-up Framework for AI Value Alignmentcited by 0
  3. 2025A Human Behavioral Baseline for Collective Governance in Software Projectscited by 0
  4. 2026Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 IIcited by 0
  5. 2026Value-Sensitive Delegation in Everyday AI Agent Use: Evidence from OpenClawcited by 0
  6. 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focuscited by 0