Explaining Quantum Circuits with Shapley Values: Towards Explainable Quantum Machine Learning
Not on the map. Why?
Abstract (arXiv)
Methods of artificial intelligence (AI) and especially machine learning (ML) have been growing ever more complex, and at the same time have more and more impact on people's lives. This leads to explainable AI (XAI) manifesting itself as an important research field that helps humans to better comprehend ML systems. In parallel, quantum machine learning (QML) is emerging with the ongoing improvement of quantum computing hardware combined with its increasing availability via cloud services. QML enables quantum-enhanced ML in which quantum mechanics is exploited to facilitate ML tasks, typically in the form of quantum-classical hybrid algorithms that combine quantum and classical resources. Quantum gates constitute the building blocks of gate-based quantum hardware and form circuits that can be used for quantum computations. For QML applications, quantum circuits are typically parameterized and their parameters are optimized classically such that a suitably defined objective function is minimized. Inspired by XAI, we raise the question of the explainability of such circuits by quantifying the importance of (groups of) gates for specific goals. To this end, we apply the well-established concept of Shapley values. The resulting attributions can be interpreted as explanations for why a specific circuit works well for a given task, improving the understanding of how to construct parameterized (or variational) quantum circuits, and fostering their human interpretability in general. An experimental evaluation on simulators and two superconducting quantum hardware devices demonstrates the benefits of the proposed framework for classification, generative modeling, transpilation, and optimization. Furthermore, our results shed some light on the role of specific gates in popular QML approaches.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 32 of its 126 references that are in the map. First posted on arXiv 22 Jan 2023.
Builds on
32 of 126 references.
References · 32
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2020Variational Quantum Algorithmscited by 687
- 2018Supervised learning with quantum enhanced feature spacescited by 654
- 2019The many Shapley values for model explanationcited by 341
- 2020Power of data in quantum machine learningcited by 336
- 2020The effect of data encoding on the expressive power of variational quantum machine learning modelscited by 328
- 2016Quantum Machine Learningcited by 325
- 2020A rigorous and robust quantum speed-up in supervised machine learningcited by 270
- 2021Generalization in quantum machine learning from few training datacited by 214
- 2021Supervised quantum machine learning models are kernel methodscited by 199
20 more
- 2020Problems with Shapley-value-based explanations as feature importance measurescited by 198
- 2021Connecting ansatz expressibility to gradient magnitudes and barren plateauscited by 180
- 2018Visual Interpretability for Deep Learning: a Surveycited by 155
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2022The Shapley Value in Machine Learningcited by 97
- 2020On the Tractability of SHAP Explanationscited by 92
- 2020Quantum circuit architecture search for variational quantum algorithmscited by 81
- 2016Quantum-enhanced machine learningcited by 79
- 2020Generating Hierarchical Explanations on Text Classification via Feature Interaction Detectioncited by 57
- 2020Interpretability and Explainability: A Machine Learning Zoo Mini-tourcited by 55
- 2022A Survey on Quantum Reinforcement Learningcited by 50
- 2021Capacity and quantum geometry of parametrized quantum circuitscited by 32
- 2022The complexity of quantum support vector machinescited by 23
- 2019Noise-Adaptive Compiler Mappings for Noisy Intermediate-Scale Quantum Computerscited by 22
- 2021Learning quantum data with the quantum Earth Mover's distancecited by 13
- 2020Quantum Circuit Evolution on NISQ Devicescited by 9
- 2021Representation of binary classification trees with binary features by quantum circuitscited by 7
- 2019Analysing Neural Network Topologies: a Game Theoretic Approachcited by 6
- 2021Improved Feature Importance Computations for Tree Models: Shapley vs. Banzhafcited by 4
- 2023Shapley Values with Uncertain Value Functionscited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 6; 2025: 7; 2026: 2.
17 papers.
Sort:
By area:
- 2023On the Interpretability of Quantum Neural Networkscited by 13
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 11
- 2024Quantum Gradient Class Activation Map for Model Interpretabilitycited by 9
- 2024Opportunities and limitations of explaining quantum machine learningcited by 6
- 2023Towards interpretable quantum machine learning via single-photon quantum walkscited by 4
- 2024Feature Importance and Explainability in Quantum Machine Learningcited by 4
- 2025Quantum Machine Unlearning: Foundations, Mechanisms, and Taxonomycited by 4
- 2024Quantum Artificial Intelligence: A Brief Surveycited by 3
- 2024Quantum Adjoint Convolutional Layers for Effective Data Representationcited by 2
- 2024A Shapley Value Estimation Speedup for Efficient Explainable Quantum AIcited by 2
- 2025QuXAI: Explainers for Hybrid Quantum Machine Learning Modelscited by 2
- 2025Resting-state fMRI Analysis using Quantum Time-series Transformercited by 1
5 more
- 2025Quantum Artificial Intelligence for Mission-Critical Systems: Foundations, Architectural Elements, and Future Directionscited by 1
- 2026Quantum Circuit-Based Learning Models: Bridging Quantum Computing and Machine Learningcited by 1
- 2025Detecting underdetermination in parameterized quantum circuitscited by 0
- 2025Component Based Quantum Machine Learning Explainabilitycited by 0
- 2026QILP-0: Constructing Observational Declarative Twins of Quantum Circuitscited by 0
- 2026QILP-0: Constructing Observational Declarative Twins of Quantum Circuits1 Sep 2026
- 2026Quantum Circuit-Based Learning Models: Bridging Quantum Computing and Machine Learning19 Jan 2026
- 2025Quantum Artificial Intelligence for Mission-Critical Systems: Foundations, Architectural Elements, and Future Directions13 Nov 2025
- 2025Quantum Machine Unlearning: Foundations, Mechanisms, and Taxonomy1 Nov 2025
- 2025Resting-state fMRI Analysis using Quantum Time-series Transformer31 Aug 2025
- 2025Component Based Quantum Machine Learning Explainability14 Jun 2025
- 2025QuXAI: Explainers for Hybrid Quantum Machine Learning Models15 May 2025
- 2025Detecting underdetermination in parameterized quantum circuits4 Apr 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2024Opportunities and limitations of explaining quantum machine learning19 Dec 2024
- 2024A Shapley Value Estimation Speedup for Efficient Explainable Quantum AI19 Dec 2024
- 2024Quantum Artificial Intelligence: A Brief Survey20 Aug 2024
5 more
- 2024Quantum Gradient Class Activation Map for Model Interpretability12 Aug 2024
- 2024Feature Importance and Explainability in Quantum Machine Learning14 May 2024
- 2024Quantum Adjoint Convolutional Layers for Effective Data Representation26 Apr 2024
- 2023On the Interpretability of Quantum Neural Networks22 Aug 2023
- 2023Towards interpretable quantum machine learning via single-photon quantum walks31 Jan 2023
- 2023On the Interpretability of Quantum Neural Networkscited by 13
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 11
- 2024Quantum Gradient Class Activation Map for Model Interpretabilitycited by 9
- 2024Opportunities and limitations of explaining quantum machine learningcited by 6
- 2023Towards interpretable quantum machine learning via single-photon quantum walkscited by 4
- 2024Feature Importance and Explainability in Quantum Machine Learningcited by 4
- 2024Quantum Artificial Intelligence: A Brief Surveycited by 3
- 2024Quantum Adjoint Convolutional Layers for Effective Data Representationcited by 2
- 2024A Shapley Value Estimation Speedup for Efficient Explainable Quantum AIcited by 2
- 2025QuXAI: Explainers for Hybrid Quantum Machine Learning Modelscited by 2
- 2025Resting-state fMRI Analysis using Quantum Time-series Transformercited by 1
- 2025Quantum Artificial Intelligence for Mission-Critical Systems: Foundations, Architectural Elements, and Future Directionscited by 1
12 most cited of 16 All 16 (JSON)
- 2026QILP-0: Constructing Observational Declarative Twins of Quantum Circuits1 Sep 2026
- 2026Quantum Circuit-Based Learning Models: Bridging Quantum Computing and Machine Learning19 Jan 2026
- 2025Quantum Artificial Intelligence for Mission-Critical Systems: Foundations, Architectural Elements, and Future Directions13 Nov 2025
- 2025Resting-state fMRI Analysis using Quantum Time-series Transformer31 Aug 2025
- 2025Component Based Quantum Machine Learning Explainability14 Jun 2025
- 2025QuXAI: Explainers for Hybrid Quantum Machine Learning Models15 May 2025
- 2025Detecting underdetermination in parameterized quantum circuits4 Apr 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2024Opportunities and limitations of explaining quantum machine learning19 Dec 2024
- 2024A Shapley Value Estimation Speedup for Efficient Explainable Quantum AI19 Dec 2024
- 2024Quantum Artificial Intelligence: A Brief Survey20 Aug 2024
- 2024Quantum Gradient Class Activation Map for Model Interpretability12 Aug 2024
12 newest of 16 All 16 (JSON)