Quality Assurance Challenges for Machine Learning Software Applications During Software Development Life Cycle Phases
Not on the map. Why?
Abstract (arXiv)
In the past decades, the revolutionary advances of Machine Learning (ML) have shown a rapid adoption of ML models into software systems of diverse types. Such Machine Learning Software Applications (MLSAs) are gaining importance in our daily lives. As such, the Quality Assurance (QA) of MLSAs is of paramount importance. Several research efforts are dedicated to determining the specific challenges we can face while adopting ML models into software systems. However, we are aware of no research that offered a holistic view of the distribution of those ML quality assurance challenges across the various phases of software development life cycles (SDLC). This paper conducts an in-depth literature review of a large volume of research papers that focused on the quality assurance of ML models. We developed a taxonomy of MLSA quality assurance issues by mapping the various ML adoption challenges across different phases of SDLC. We provide recommendations and research opportunities to improve SDLC practices based on the taxonomy. This mapping can help prioritize quality assurance efforts of MLSAs where the adoption of ML models can be considered crucial.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 3 May 2021.
Builds on
25 of 43 references.
References · 25
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2013Intriguing properties of neural networkscited by 5,155
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
- 2019Towards Federated Learning at Scale: System Designcited by 832
- 2015DeepDriving: Learning Affordance for Direct Perception in Autonomous Drivingcited by 231
- 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 218
- 2018To Trust Or Not To Trust A Classifiercited by 207
13 more
- 2019Explainable Machine Learning for Scientific Insights and Discoveriescited by 166
- 2020Challenges in Deploying Machine Learning: a Survey of Case Studiescited by 152
- 2017Fairness Testing: Testing Software for Discriminationcited by 126
- 2019Defense Against Adversarial Attacks Using Feature Scattering-based Adversarial Trainingcited by 95
- 2019Requirements Engineering for Machine Learning: Perspectives from Data Scientistscited by 49
- 2018Software Engineering Challenges of Deep Learningcited by 41
- 2020Safety Concerns and Mitigation Approaches Regarding the Use of Deep Learning in Safety-Critical Perception Taskscited by 31
- 2019Can You Trust This Prediction? Auditing Pointwise Reliability After Learningcited by 28
- 2019Tutorial: Safe and Reliable Machine Learningcited by 22
- 2021Quality Assurance for AI-based Systems: Overview and Challengescited by 19
- 2020Deep Learning & Software Engineering: State of Research and Future Directionscited by 9
- 2018Ways of Applying Artificial Intelligence in Software Engineeringcited by 7
- 2019Engineering Reliable Deep Learning Systemscited by 6
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1; 2025: 2.
4 papers.
- 2022"Project smells" -- Experiences in Analysing the Software Quality of ML Projects with mllintcited by 2
- 2024A Systematic Literature Review on the Use of Machine Learning in Software Engineeringcited by 0
- 2025Maturity Framework for Enhancing Machine Learning Qualitycited by 0
- 2025Applications and Challenges of Fairness APIs in Machine Learning Softwarecited by 0
- 2025Applications and Challenges of Fairness APIs in Machine Learning Software22 Aug 2025
- 2025Maturity Framework for Enhancing Machine Learning Quality12 Feb 2025
- 2024A Systematic Literature Review on the Use of Machine Learning in Software Engineering19 Jun 2024
- 2022"Project smells" -- Experiences in Analysing the Software Quality of ML Projects with mllint20 Jan 2022