Towards a Roadmap on Software Engineering for Responsible AI
Not on the map. Why?
Abstract (arXiv)
Although AI is transforming the world, there are serious concerns about its ability to behave and make decisions responsibly. Many ethical regulations, principles, and frameworks for responsible AI have been issued recently. However, they are high level and difficult to put into practice. On the other hand, most AI researchers focus on algorithmic solutions, while the responsible AI challenges actually crosscut the entire engineering lifecycle and components of AI systems. To close the gap in operationalizing responsible AI, this paper aims to develop a roadmap on software engineering for responsible AI. The roadmap focuses on (i) establishing multi-level governance for responsible AI systems, (ii) setting up the development processes incorporating process-oriented practices for responsible AI systems, and (iii) building responsible-AI-by-design into AI systems through system-level architectural style, patterns and techniques.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 24 of its 112 references that are in the map. First posted on arXiv 9 Mar 2022.
Builds on
24 of 112 references.
References · 24
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2018LEAF: A Benchmark for Federated Settingscited by 780
- 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
- 2020Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIcited by 166
- 2020Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructurecited by 138
- 2019Artificial Intelligence: the global landscape of ethics guidelinescited by 107
- 2014Differential Privacy and Machine Learning: a Survey and Reviewcited by 66
- 2019Requirements Engineering for Machine Learning: Perspectives from Data Scientistscited by 49
- 2021Question-Driven Design Process for Explainable AI User Experiencescited by 31
- 2020Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberationcited by 24
- 2021Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Makingcited by 23
- 2021AI Certification: Advancing Ethical Practice by Reducing Information Asymmetriescited by 15
12 more
- 2019Towards Traceability in Data Ecosystems using a Bill of Materials Modelcited by 12
- 2020Reflexive Design for Fairness and Other Human Values in Formal Modelscited by 11
- 2021AI and Ethics -- Operationalising Responsible AIcited by 11
- 2020Developing and Operating Artificial Intelligence Models in Trustworthy Autonomous Systemscited by 10
- 2021Software Engineering for Responsible AI: An Empirical Study and Operationalised Patternscited by 9
- 2019A Study on the Prevalence of Human Values in Software Engineering Publications, 2015-2018cited by 4
- 2020Opening the Software Engineering Toolbox for the Assessment of Trustworthy AIcited by 4
- 2021More Reliable AI Solution: Breast Ultrasound Diagnosis Using Multi-AI Combinationcited by 3
- 2021A Decentralized Approach towards Responsible AI in Social Ecosystemscited by 3
- 2021How Can Human Values Be Addressed in Agile Methods? A Case Study on SAFecited by 2
- 2021When is it permissible for artificial intelligence to lie? A trust-based approachcited by 2
- 2020A Methodology for Ethics-by-Design AI Systems: Dealing with Human Value Conflictscited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 1; 2025: 1; 2026: 3.
9 papers.
- 2022Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineeringcited by 20
- 2022Never trust, always verify : a roadmap for Trustworthy AI?cited by 4
- 2023Responsible Design Patterns for Machine Learning Pipelinescited by 4
- 2024Fairness Concerns in App Reviews: A Study on AI-based Mobile Appscited by 4
- 2023Developing Responsible Chatbots for Financial Services: A Pattern-Oriented Responsible AI Engineering Approachcited by 1
- 2026Trustworthy AI Posture (TAIP): A Framework for Continuous AI Assurance of Agentic Systems at Horizontal and Vertical scalecited by 1
- 2025A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineeringcited by 0
- 2026Intersectional Fairness in Large Language Modelscited by 0
- 2026Value-Preserving Architectures for Agentic AI Systemscited by 0
- 2026Value-Preserving Architectures for Agentic AI Systems3 Sep 2026
- 2026Intersectional Fairness in Large Language Models22 Apr 2026
- 2026Trustworthy AI Posture (TAIP): A Framework for Continuous AI Assurance of Agentic Systems at Horizontal and Vertical scale15 Feb 2026
- 2025A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineering8 Dec 2025
- 2024Fairness Concerns in App Reviews: A Study on AI-based Mobile Apps16 Jan 2024
- 2023Responsible Design Patterns for Machine Learning Pipelines31 May 2023
- 2023Developing Responsible Chatbots for Financial Services: A Pattern-Oriented Responsible AI Engineering Approach3 Jan 2023
- 2022Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineering12 Sep 2022
- 2022Never trust, always verify : a roadmap for Trustworthy AI?23 Jun 2022