mlsanityData to 7 Oct 2026

Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice

arXiv 2306.06542 ↗First posted 10 Jun 2023cs.HC cs.CY cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

An emerging body of research indicates that ineffective cross-functional collaboration -- the interdisciplinary work done by industry practitioners across roles -- represents a major barrier to addressing issues of fairness in AI design and development. In this research, we sought to better understand practitioners' current practices and tactics to enact cross-functional collaboration for AI fairness, in order to identify opportunities to support more effective collaboration. We conducted a series of interviews and design workshops with 23 industry practitioners spanning various roles from 17 companies. We found that practitioners engaged in bridging work to overcome frictions in understanding, contextualization, and evaluation around AI fairness across roles. In addition, in organizational contexts with a lack of resources and incentives for fairness work, practitioners often piggybacked on existing requirements (e.g., for privacy assessments) and AI development norms (e.g., the use of quantitative evaluation metrics), although they worry that these tactics may be fundamentally compromised. Finally, we draw attention to the invisible labor that practitioners take on as part of this bridging and piggybacking work to enact interdisciplinary collaboration for fairness. We close by discussing opportunities for both FAccT researchers and AI practitioners to better support cross-functional collaboration for fairness in the design and development of AI systems.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 36 of its 105 references that are in the map. First posted on arXiv 10 Jun 2023.

Builds on

36 of 105 references.

References · 36

  1. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  2. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  3. 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
  4. 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 182
  5. 2021The Values Encoded in Machine Learning Researchcited by 172
  6. 2019Artificial Intelligence: the global landscape of ethics guidelinescited by 107
  7. 2019FairVis: Visual Analytics for Discovering Intersectional Bias in Machine Learningcited by 93
  8. 2020Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditingcited by 89
  9. 2019Problem Formulation and Fairnesscited by 85
  10. 2020How do Data Science Workers Collaborate? Roles, Workflows, and Toolscited by 64
  11. 2021Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Supportcited by 61
  12. 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
24 more
  1. 2022Evaluation Gaps in Machine Learning Practicecited by 48
  2. 2021Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviorscited by 47
  3. 2020Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practicescited by 38
  4. 2022Measuring Representational Harms in Image Captioningcited by 36
  5. 2022Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkitscited by 33
  6. 2019How Data Scientists Work Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?cited by 30
  7. 2022Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practicecited by 30
  8. 2021How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Studycited by 29
  9. 2021Discovering and Validating AI Errors With Crowdsourced Failure Reportscited by 28
  10. 2022Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethicscited by 28
  11. 2020Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projectscited by 24
  12. 2020Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberationcited by 24
  13. 2022Healthsheet: Development of a Transparency Artifact for Health Datasetscited by 23
  14. 2023Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebookcited by 21
  15. 2022REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Researchcited by 20
  16. 2021Towards A Process Model for Co-Creating AI Experiencescited by 18
  17. 2022Symphony: Composing Interactive Interfaces for Machine Learningcited by 18
  18. 2023Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experiencecited by 18
  19. 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"cited by 15
  20. 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Designcited by 15
  21. 2021Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Modelscited by 12
  22. 2021The Contestation of Tech Ethics: A Sociotechnical Approach to Technology Ethics in Practicecited by 12
  23. 2021Orienting, Framing, Bridging, Magic, and Counseling: How Data Scientists Navigate the Outer Loop of Client Collaborations in Industry and Academiacited by 10
  24. 2023fAIlureNotes: Supporting Designers in Understanding the Limits of AI Models for Computer Vision Taskscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 5; 2026: 4.

15 papers.

Sort:

By area:

  1. 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 81
  2. 2025AI Mismatches: Identifying Potential Algorithmic Harms Before AI Developmentcited by 10
  3. 2024"It Might be Technically Impressive, But It's Practically Useless to us": Motivations, Practices, Challenges, and Opportunities for Cross-Functional Collaboration around AI within the News Industrycited by 5
  4. 2024Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviorscited by 5
  5. 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
  6. 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
  7. 2024Ethical AI Governance: Methods for Evaluating Trustworthy AIcited by 2
  8. 2026Engaged AI Governance: Addressing the Last Mile Challenge Through Internal Expert Collaborationcited by 2
  9. 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stagescited by 1
  10. 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Toolscited by 1
  11. 2025Policy alone is probably not the solution: A large-scale experiment on how developers struggle to design meaningful end-user explanationscited by 0
  12. 2025Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systemscited by 0
3 more
  1. 2025A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineeringcited by 0
  2. 2026Intersectional Fairness in Large Language Modelscited by 0
  3. 2026What We Know about Responsible AI Practices in Industry: A Half Decade of Empirical Researchcited by 0