Reverse N-Wise Output-Oriented Testing for AI/ML and Quantum Computing Systems
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence/machine learning (AI/ML) systems and emerging quantum computing software present unprecedented testing challenges characterized by high-dimensional/continuous input spaces, probabilistic/non-deterministic output distributions, behavioral correctness defined exclusively over observable prediction behaviors and measurement outcomes, and critical quality dimensions, trustworthiness, fairness, calibration, robustness, error syndrome patterns, that manifest through complex multi-way interactions among semantically meaningful output properties rather than deterministic input-output mappings. This paper introduces reverse n-wise output testing, a mathematically principled paradigm inversion that constructs covering arrays directly over domain-specific output equivalence classes, ML confidence calibration buckets, decision boundary regions, fairness partitions, embedding clusters, ranking stability bands, quantum measurement outcome distributions (0-dominant, 1-dominant, superposition collapse), error syndrome patterns (bit-flip, phase-flip, correlated errors), then solves the computationally challenging black-box inverse mapping problem via gradient-free metaheuristic optimization to synthesize input feature configurations or quantum circuit parameters capable of eliciting targeted behavioral signatures from opaque models. The framework delivers synergistic benefits across both domains: explicit customer-centric prediction/measurement coverage guarantees, substantial improvements in fault detection rates for ML calibration/boundary failures and quantum error syndromes, enhanced test suite efficiency, and structured MLOps/quantum validation pipelines with automated partition discovery from uncertainty analysis and coverage drift monitoring.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 29 references that are in the map. First posted on arXiv 15 Feb 2026.
Builds on
7 of 29 references.
References · 7
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
- 2017DeepXplore: Automated Whitebox Testing of Deep Learning Systemscited by 311
- 2018DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systemscited by 147
- 2018Guiding Deep Learning System Testing using Surprise Adequacycited by 124
- 2018Automated Directed Fairness Testingcited by 78
- 2023QuCAT: A Combinatorial Testing Tool for Quantum Softwarecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Assessing Superposition-Targeted Coverage Criteria for Quantum Neural Networks
- 2026Quantum-Enhanced Adversarial Robustness in Artificial Intelligence
- 2024Reinforcement learning-based architecture search for quantum machine learning
- 2025SoK: Critical Evaluation of Quantum Machine Learning for Adversarial Robustness
- 2025Quantum Architecture Search for Solving Quantum Machine Learning Tasks
- 2023MNISQ: A Large-Scale Quantum Circuit Dataset for Machine Learning on/for Quantum Computers in the NISQ era
- 2024JustQ: Automated Deployment of Fair and Accurate Quantum Neural Networks
- 2025Prospects for quantum advantage in machine learning from the representability of functions