mlsanityData to 14 Oct 2026

Quality Assurance Challenges for Machine Learning Software Applications During Software Development Life Cycle Phases

arXiv 2105.01195 ↗First posted 3 May 2021cs.SE cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

In the past decades, the revolutionary advances of Machine Learning (ML) have shown a rapid adoption of ML models into software systems of diverse types. Such Machine Learning Software Applications (MLSAs) are gaining importance in our daily lives. As such, the Quality Assurance (QA) of MLSAs is of paramount importance. Several research efforts are dedicated to determining the specific challenges we can face while adopting ML models into software systems. However, we are aware of no research that offered a holistic view of the distribution of those ML quality assurance challenges across the various phases of software development life cycles (SDLC). This paper conducts an in-depth literature review of a large volume of research papers that focused on the quality assurance of ML models. We developed a taxonomy of MLSA quality assurance issues by mapping the various ML adoption challenges across different phases of SDLC. We provide recommendations and research opportunities to improve SDLC practices based on the taxonomy. This mapping can help prioritize quality assurance efforts of MLSAs where the adoption of ML models can be considered crucial.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 3 May 2021.

Builds on

25 of 43 references.

References · 25

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  3. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  4. 2013Intriguing properties of neural networkscited by 5,155
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  6. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
  7. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  8. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
  9. 2019Towards Federated Learning at Scale: System Designcited by 832
  10. 2015DeepDriving: Learning Affordance for Direct Perception in Autonomous Drivingcited by 231
  11. 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 218
  12. 2018To Trust Or Not To Trust A Classifiercited by 207
13 more
  1. 2019Explainable Machine Learning for Scientific Insights and Discoveriescited by 166
  2. 2020Challenges in Deploying Machine Learning: a Survey of Case Studiescited by 152
  3. 2017Fairness Testing: Testing Software for Discriminationcited by 126
  4. 2019Defense Against Adversarial Attacks Using Feature Scattering-based Adversarial Trainingcited by 95
  5. 2019Requirements Engineering for Machine Learning: Perspectives from Data Scientistscited by 49
  6. 2018Software Engineering Challenges of Deep Learningcited by 41
  7. 2020Safety Concerns and Mitigation Approaches Regarding the Use of Deep Learning in Safety-Critical Perception Taskscited by 31
  8. 2019Can You Trust This Prediction? Auditing Pointwise Reliability After Learningcited by 28
  9. 2019Tutorial: Safe and Reliable Machine Learningcited by 22
  10. 2021Quality Assurance for AI-based Systems: Overview and Challengescited by 19
  11. 2020Deep Learning & Software Engineering: State of Research and Future Directionscited by 9
  12. 2018Ways of Applying Artificial Intelligence in Software Engineeringcited by 7
  13. 2019Engineering Reliable Deep Learning Systemscited by 6

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 0; 2024: 1; 2025: 2.

4 papers.