Towards a Common Testing Terminology for Software Engineering and Data Science Experts
Not on the map. Why?
Abstract (arXiv)
Analytical quality assurance, especially testing, is an integral part of software-intensive system development. With the increased usage of Artificial Intelligence (AI) and Machine Learning (ML) as part of such systems, this becomes more difficult as well-understood software testing approaches cannot be applied directly to the AI-enabled parts of the system. The required adaptation of classical testing approaches and the development of new concepts for AI would benefit from a deeper understanding and exchange between AI and software engineering experts. We see the different terminologies used in the two communities as a major obstacle on this way. As we consider a mutual understanding of the testing terminology a key, this paper contributes a mapping between the most important concepts from classical software testing and AI testing. In the mapping, we highlight differences in the relevance and naming of the mapped concepts.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 3 of its 13 references that are in the map. First posted on arXiv 31 Aug 2021.
Builds on
3 of 13 references.
References · 3
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 1.
5 papers.
- 2022Integrating Testing and Operation-related Quantitative Evidences in Assurance Cases to Argue Safety of Data-Driven AI/ML Componentscited by 1
- 2023Timeseries-aware Uncertainty Wrappers for Uncertainty Quantification of Information-Fusion-Enhanced AI Models based on Machine Learningcited by 1
- 2024Pragmatic auditing: a pilot-driven approach for auditing Machine Learning systemscited by 1
- 2023Operationalizing Assurance Cases for Data Scientists: A Showcase of Concepts and Tooling in the Context of Test Data Quality for Machine Learningcited by 0
- 2025Scalability and Maintainability Challenges and Solutions in Machine Learning: Systematic Literature Reviewcited by 0
- 2025Scalability and Maintainability Challenges and Solutions in Machine Learning: Systematic Literature Review15 Apr 2025
- 2024Pragmatic auditing: a pilot-driven approach for auditing Machine Learning systems21 May 2024
- 2023Operationalizing Assurance Cases for Data Scientists: A Showcase of Concepts and Tooling in the Context of Test Data Quality for Machine Learning8 Dec 2023
- 2023Timeseries-aware Uncertainty Wrappers for Uncertainty Quantification of Information-Fusion-Enhanced AI Models based on Machine Learning24 May 2023
- 2022Integrating Testing and Operation-related Quantitative Evidences in Assurance Cases to Argue Safety of Data-Driven AI/ML Components10 Feb 2022