Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebars
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence through machine learning is increasingly used in the digital society. Solutions based on machine learning bring both great opportunities, thus coined "Software 2.0," but also great challenges for the engineering community to tackle. Due to the experimental approach used by data scientists when developing machine learning models, agility is an essential characteristic. In this keynote address, we discuss two contemporary development phenomena that are fundamental in machine learning development, i.e., notebook interfaces and MLOps. First, we present a solution that can remedy some of the intrinsic weaknesses of working in notebooks by supporting easy transitions to integrated development environments. Second, we propose reinforced engineering of AI systems by introducing metaphorical buttresses and rebars in the MLOps context. Machine learning-based solutions are dynamic in nature, and we argue that reinforced continuous engineering is required to quality assure the trustworthy AI systems of tomorrow.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 11 of its 47 references that are in the map. First posted on arXiv 28 Nov 2021.
Builds on
11 of 47 references.
References · 11
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 488
- 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 213
- 2019Requirements Engineering for Machine Learning: Perspectives from Data Scientistscited by 49
- 2018Safely Entering the Deep: A Review of Verification and Validation for Machine Learning and a Challenge Elicitation in the Automotive Industrycited by 38
- 2020Engineering AI Systems: A Research Agendacited by 37
- 2020A Software Engineering Perspective on Engineering Machine Learning Systems: State of the Art and Challengescited by 33
- 2018Verification for Machine Learning, Autonomy, and Neural Networks Surveycited by 24
- 2021Non-functional Requirements for Machine Learning: Understanding Current Use and Challenges in Industrycited by 9
- 2021Certification of embedded systems based on Machine Learning: A surveycited by 6
- 2021Test Automation with Grad-CAM Heatmaps -- A Future Pipe Segment in MLOps for Vision AI?cited by 3
Built on by
Citing papers per year: 2022: 3; 2023: 1.
4 papers.
- 2023MLOps: A Reviewcited by 16
- 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communicationscited by 3
- 2022Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practicecited by 0
- 2022A Systematic Literature Review of Soft Computing Techniques for Software Maintainability Prediction: State-of-the-Art, Challenges and Future Directionscited by 0
- 2023MLOps: A Review19 Aug 2023
- 2022A Systematic Literature Review of Soft Computing Techniques for Software Maintainability Prediction: State-of-the-Art, Challenges and Future Directions21 Sep 2022
- 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communications30 Mar 2022
- 2022Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practice29 Mar 2022