The AIQ Meta-Testbed: Pragmatically Bridging Academic AI Testing and Industrial Q Needs
Not on the map. Why?
Abstract (arXiv)
AI solutions seem to appear in any and all application domains. As AI becomes more pervasive, the importance of quality assurance increases. Unfortunately, there is no consensus on what artificial intelligence means and interpretations range from simple statistical analysis to sentient humanoid robots. On top of that, quality is a notoriously hard concept to pinpoint. What does this mean for AI quality? In this paper, we share our working definition and a pragmatic approach to address the corresponding quality assurance with a focus on testing. Finally, we present our ongoing work on establishing the AIQ Meta-Testbed.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 1.
5 papers.
- 2022Bugs in Machine Learning-based Systems: A Faultload Benchmarkcited by 15
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
- 2021Test Automation with Grad-CAM Heatmaps -- A Future Pipe Segment in MLOps for Vision AI?cited by 3
- 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communicationscited by 3
- 2022Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practicecited by 0
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practice21 Jan 2023
- 2022Bugs in Machine Learning-based Systems: A Faultload Benchmark24 Jun 2022
- 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communications30 Mar 2022
- 2022Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practice29 Mar 2022
- 2021Test Automation with Grad-CAM Heatmaps -- A Future Pipe Segment in MLOps for Vision AI?2 Mar 2021