Developing and Operating Artificial Intelligence Models in Trustworthy Autonomous Systems
Not on the map. Why?
Abstract (arXiv)
Companies dealing with Artificial Intelligence (AI) models in Autonomous Systems (AS) face several problems, such as users' lack of trust in adverse or unknown conditions, gaps between software engineering and AI model development, and operation in a continuously changing operational environment. This work-in-progress paper aims to close the gap between the development and operation of trustworthy AI-based AS by defining an approach that coordinates both activities. We synthesize the main challenges of AI-based AS in industrial settings. We reflect on the research efforts required to overcome these challenges and propose a novel, holistic DevOps approach to put it into practice. We elaborate on four research directions: (a) increased users' trust by monitoring operational AI-based AS and identifying self-adaptation needs in critical situations; (b) integrated agile process for the development and evolution of AI models and AS; (c) continuous deployment of different context-specific instances of AI models in a distributed setting of AS; and (d) holistic DevOps-based lifecycle for AI-based AS.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 1; 2024: 1; 2025: 1; 2026: 1.
10 papers.
- 2021Software Engineering for AI-Based Systems: A Surveycited by 68
- 2022Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineeringcited by 20
- 2021A Survey on AI Assurancecited by 16
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
- 2022Towards a Roadmap on Software Engineering for Responsible AIcited by 9
- 2025ArtMentor: AI-Assisted Evaluation of Artworks to Explore Multimodal Large Language Models Capabilitiescited by 9
- 2022Requirements Engineering for Machine Learning: A Review and Reflectioncited by 7
- 2021Integration of Convolutional Neural Networks in Mobile Applicationscited by 6
- 2024A Framework to Model ML Engineering Processescited by 1
- 2026Software Engineering for AI-driven Building Operationcited by 0
- 2026Software Engineering for AI-driven Building Operation17 Aug 2026
- 2025ArtMentor: AI-Assisted Evaluation of Artworks to Explore Multimodal Large Language Models Capabilities19 Feb 2025
- 2024A Framework to Model ML Engineering Processes29 Apr 2024
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practice21 Jan 2023
- 2022Requirements Engineering for Machine Learning: A Review and Reflection3 Oct 2022
- 2022Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineering12 Sep 2022
- 2022Towards a Roadmap on Software Engineering for Responsible AI9 Mar 2022
- 2021A Survey on AI Assurance15 Nov 2021
- 2021Software Engineering for AI-Based Systems: A Survey5 May 2021
- 2021Integration of Convolutional Neural Networks in Mobile Applications11 Mar 2021