Towards Equitable Agile Research and Development of AI and Robotics
Not on the map. Why?
Abstract (arXiv)
Machine Learning (ML) and 'Artificial Intelligence' ('AI') methods tend to replicate and amplify existing biases and prejudices, as do Robots with AI. For example, robots with facial recognition have failed to identify Black Women as human, while others have categorized people, such as Black Men, as criminals based on appearance alone. A 'culture of modularity' means harms are perceived as 'out of scope', or someone else's responsibility, throughout employment positions in the 'AI supply chain'. Incidents are routine enough (incidentdatabase.ai lists over 2000 examples) to indicate that few organizations are capable of completely respecting peoples' rights; meeting claimed equity, diversity, and inclusion (EDI or DEI) goals; or recognizing and then addressing such failures in their organizations and artifacts. We propose a framework for adapting widely practiced Research and Development (R&D) project management methodologies to build organizational equity capabilities and better integrate known evidence-based best practices. We describe how project teams can organize and operationalize the most promising practices, skill sets, organizational cultures, and methods to detect and address rights-based fairness, equity, accountability, and ethical problems as early as possible when they are often less harmful and easier to mitigate; then monitor for unforeseen incidents to adaptively and constructively address them. Our primary example adapts an Agile development process based on Scrum, one of the most widely adopted approaches to organizing R&D teams. We also discuss limitations of our proposed framework and future research directions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 177 references that are in the map. First posted on arXiv 13 Feb 2024.
Builds on
36 of 177 references.
References · 36
- 2018Datasheets for Datasetscited by 1,371
- 2018Model Cards for Model Reportingcited by 1,068
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 326
- 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 246
- 2020Large image datasets: A pyrrhic win for computer vision?cited by 237
- 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 192
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 168
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
- 2019Principles alone cannot guarantee ethical AIcited by 134
24 more
- 2022Measuring the Carbon Intensity of AI in Cloud Instancescited by 110
- 2020Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Databasecited by 95
- 2022The Fallacy of AI Functionalitycited by 88
- 2021Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Developmentcited by 85
- 2023Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystemcited by 49
- 2023Counting Carbon: A Survey of Factors Influencing the Emissions of Machine Learningcited by 42
- 2017A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turkcited by 38
- 2022Dislocated Accountabilities in the AI Supply Chain: Modularity and Developers' Notions of Responsibilitycited by 33
- 2022The Forgotten Margins of AI Ethicscited by 30
- 2023On Hate Scaling Laws For Data-Swampscited by 28
- 2020Diversity and Inclusion Metrics in Subset Selectioncited by 27
- 2021Learning from Crowds with Crowd-Kitcited by 23
- 2016CoSTAR: Instructing Collaborative Robots with Behavior Trees and Visioncited by 20
- 2021A Framework for Deprecating Datasets: Standardizing Documentation, Identification, and Communicationcited by 18
- 2020Four Years in Review: Statistical Practices of Likert Scales in Human-Robot Interaction Studiescited by 12
- 2020Robot Rights? Let's Talk about Human Welfare Insteadcited by 9
- 2021Designing Accountable Systemscited by 7
- 2022Social Inclusion in Curated Contexts: Insights from Museum Practicescited by 7
- 2018The CoSTAR Block Stacking Dataset: Learning with Workspace Constraintscited by 5
- 2018Evaluating Methods for End-User Creation of Robot Task Planscited by 4
- 2020Ethics in the Software Development Process: From Codes of Conduct to Ethical Deliberationcited by 3
- 2018Agile development for vulnerable populations: lessons learned and recommendationscited by 1
- 2018Implementing SCRUM to develop a connected robotcited by 1
- 2018Safety-Critical Systems and Agile Development: A Mapping Studycited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.