Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice
Not on the map. Why?
Abstract (arXiv)
An emerging body of research indicates that ineffective cross-functional collaboration -- the interdisciplinary work done by industry practitioners across roles -- represents a major barrier to addressing issues of fairness in AI design and development. In this research, we sought to better understand practitioners' current practices and tactics to enact cross-functional collaboration for AI fairness, in order to identify opportunities to support more effective collaboration. We conducted a series of interviews and design workshops with 23 industry practitioners spanning various roles from 17 companies. We found that practitioners engaged in bridging work to overcome frictions in understanding, contextualization, and evaluation around AI fairness across roles. In addition, in organizational contexts with a lack of resources and incentives for fairness work, practitioners often piggybacked on existing requirements (e.g., for privacy assessments) and AI development norms (e.g., the use of quantitative evaluation metrics), although they worry that these tactics may be fundamentally compromised. Finally, we draw attention to the invisible labor that practitioners take on as part of this bridging and piggybacking work to enact interdisciplinary collaboration for fairness. We close by discussing opportunities for both FAccT researchers and AI practitioners to better support cross-functional collaboration for fairness in the design and development of AI systems.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 36 of its 105 references that are in the map. First posted on arXiv 10 Jun 2023.
Builds on
36 of 105 references.
References · 36
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 182
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2019Artificial Intelligence: the global landscape of ethics guidelinescited by 107
- 2019FairVis: Visual Analytics for Discovering Intersectional Bias in Machine Learningcited by 93
- 2020Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditingcited by 89
- 2019Problem Formulation and Fairnesscited by 85
- 2020How do Data Science Workers Collaborate? Roles, Workflows, and Toolscited by 64
- 2021Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Supportcited by 61
- 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
24 more
- 2022Evaluation Gaps in Machine Learning Practicecited by 48
- 2021Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviorscited by 47
- 2020Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practicescited by 38
- 2022Measuring Representational Harms in Image Captioningcited by 36
- 2022Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkitscited by 33
- 2019How Data Scientists Work Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?cited by 30
- 2022Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practicecited by 30
- 2021How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Studycited by 29
- 2021Discovering and Validating AI Errors With Crowdsourced Failure Reportscited by 28
- 2022Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethicscited by 28
- 2020Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projectscited by 24
- 2020Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberationcited by 24
- 2022Healthsheet: Development of a Transparency Artifact for Health Datasetscited by 23
- 2023Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebookcited by 21
- 2022REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Researchcited by 20
- 2021Towards A Process Model for Co-Creating AI Experiencescited by 18
- 2022Symphony: Composing Interactive Interfaces for Machine Learningcited by 18
- 2023Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experiencecited by 18
- 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"cited by 15
- 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Designcited by 15
- 2021Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Modelscited by 12
- 2021The Contestation of Tech Ethics: A Sociotechnical Approach to Technology Ethics in Practicecited by 12
- 2021Orienting, Framing, Bridging, Magic, and Counseling: How Data Scientists Navigate the Outer Loop of Client Collaborations in Industry and Academiacited by 10
- 2023fAIlureNotes: Supporting Designers in Understanding the Limits of AI Models for Computer Vision Taskscited by 10
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 5; 2026: 4.
15 papers.
Sort:
By area:
- 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 81
- 2025AI Mismatches: Identifying Potential Algorithmic Harms Before AI Developmentcited by 10
- 2024"It Might be Technically Impressive, But It's Practically Useless to us": Motivations, Practices, Challenges, and Opportunities for Cross-Functional Collaboration around AI within the News Industrycited by 5
- 2024Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviorscited by 5
- 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
- 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
- 2024Ethical AI Governance: Methods for Evaluating Trustworthy AIcited by 2
- 2026Engaged AI Governance: Addressing the Last Mile Challenge Through Internal Expert Collaborationcited by 2
- 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stagescited by 1
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Toolscited by 1
- 2025Policy alone is probably not the solution: A large-scale experiment on how developers struggle to design meaningful end-user explanationscited by 0
- 2025Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systemscited by 0
- 2026What We Know about Responsible AI Practices in Industry: A Half Decade of Empirical Research11 Aug 2026
- 2026Engaged AI Governance: Addressing the Last Mile Challenge Through Internal Expert Collaboration23 Apr 2026
- 2026Intersectional Fairness in Large Language Models22 Apr 2026
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Tools17 Feb 2026
- 2025A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineering8 Dec 2025
- 2025Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systems26 May 2025
- 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stages15 May 2025
- 2025AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development25 Feb 2025
- 2025Policy alone is probably not the solution: A large-scale experiment on how developers struggle to design meaningful end-user explanations28 Jan 2025
- 2024Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviors26 Sep 2024
- 2024"It Might be Technically Impressive, But It's Practically Useless to us": Motivations, Practices, Challenges, and Opportunities for Cross-Functional Collaboration around AI within the News Industry18 Sep 2024
- 2024Ethical AI Governance: Methods for Evaluating Trustworthy AI28 Aug 2024
3 more
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?29 Jan 2024
- 2023The Value-Sensitive Conversational Agent Co-Design Framework18 Oct 2023
- 2023The Value-Sensitive Conversational Agent Co-Design Framework18 Oct 2023
- 2025AI Mismatches: Identifying Potential Algorithmic Harms Before AI Developmentcited by 10
- 2024"It Might be Technically Impressive, But It's Practically Useless to us": Motivations, Practices, Challenges, and Opportunities for Cross-Functional Collaboration around AI within the News Industrycited by 5
- 2024Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviorscited by 5
- 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
- 2024Ethical AI Governance: Methods for Evaluating Trustworthy AIcited by 2
- 2026Engaged AI Governance: Addressing the Last Mile Challenge Through Internal Expert Collaborationcited by 2
- 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stagescited by 1
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Toolscited by 1
- 2025Policy alone is probably not the solution: A large-scale experiment on how developers struggle to design meaningful end-user explanationscited by 0
- 2025Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systemscited by 0
- 2025A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineeringcited by 0
- 2026Intersectional Fairness in Large Language Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026What We Know about Responsible AI Practices in Industry: A Half Decade of Empirical Research11 Aug 2026
- 2026Engaged AI Governance: Addressing the Last Mile Challenge Through Internal Expert Collaboration23 Apr 2026
- 2026Intersectional Fairness in Large Language Models22 Apr 2026
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Tools17 Feb 2026
- 2025A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineering8 Dec 2025
- 2025Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systems26 May 2025
- 2025AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stages15 May 2025
- 2025AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development25 Feb 2025
- 2025Policy alone is probably not the solution: A large-scale experiment on how developers struggle to design meaningful end-user explanations28 Jan 2025
- 2024Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviors26 Sep 2024
- 2024"It Might be Technically Impressive, But It's Practically Useless to us": Motivations, Practices, Challenges, and Opportunities for Cross-Functional Collaboration around AI within the News Industry18 Sep 2024
- 2024Ethical AI Governance: Methods for Evaluating Trustworthy AI28 Aug 2024
12 newest of 13 All 13 (JSON)