GQHAN: A Grover-inspired Quantum Hard Attention Network
Not on the map. Why?
Abstract (arXiv)
Numerous current Quantum Machine Learning (QML) models exhibit an inadequacy in discerning the significance of quantum data, resulting in diminished efficacy when handling extensive quantum datasets. Hard Attention Mechanism (HAM), anticipated to efficiently tackle the above QML bottlenecks, encounters the substantial challenge of non-differentiability, consequently constraining its extensive applicability. In response to the dilemma of HAM and QML, a Grover-inspired Quantum Hard Attention Mechanism (GQHAM) consisting of a Flexible Oracle (FO) and an Adaptive Diffusion Operator (ADO) is proposed. Notably, the FO is designed to surmount the non-differentiable issue by executing the activation or masking of Discrete Primitives (DPs) with Flexible Control (FC) to weave various discrete destinies. Based on this, such discrete choice can be visualized with a specially defined Quantum Hard Attention Score (QHAS). Furthermore, a trainable ADO is devised to boost the generality and flexibility of GQHAM. At last, a Grover-inspired Quantum Hard Attention Network (GQHAN) based on QGHAM is constructed on PennyLane platform for Fashion MNIST binary classification. Experimental findings demonstrate that GQHAN adeptly surmounts the non-differentiability hurdle, surpassing the efficacy of extant quantum soft self-attention mechanisms in accuracies and learning ability. In noise experiments, GQHAN is robuster to bit-flip noise in accuracy and amplitude damping noise in learning performance. Predictably, the proposal of GQHAN enriches the Quantum Attention Mechanism (QAM), lays the foundation for future quantum computers to process large-scale data, and promotes the development of quantum computer vision.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 16 of its 42 references that are in the map. First posted on arXiv 25 Jan 2024.
Builds on
16 of 42 references.
References · 16
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 672
- 2023Challenges and Opportunities in Quantum Machine Learningcited by 202
- 2019Quantum Natural Gradientcited by 104
- 2020Learning When and Where to Zoom with Deep Reinforcement Learningcited by 43
- 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 42
- 2019Saccader: Improving Accuracy of Hard Attention Models for Visioncited by 35
- 2019Processing Megapixel Images with Deep Attention-Sampling Modelscited by 29
- 2022QSAN: A Near-term Achievable Quantum Self-Attention Networkcited by 25
- 2018Learning Visual Question Answering by Bootstrapping Hard Attentioncited by 24
- 2023QKSAN: A Quantum Kernel Self-Attention Networkcited by 23
4 more
- 2021Hard-Attention for Scalable Image Classificationcited by 18
- 2022Multi-agent Reinforcement Learning for Dynamic Resource Management in 6G in-X Subnetworkscited by 8
- 2020Fast Black-Box Quantum State Preparationcited by 5
- 2022Video Violence Recognition and Localization Using a Semi-Supervised Hard Attention Modelcited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 2.
5 papers.
- 2024Quantum Adjoint Convolutional Layers for Effective Data Representationcited by 2
- 2025HQCC: A Hybrid Quantum-Classical Classifier with Adaptive Structurecited by 1
- 2025Quantum Complex-Valued Self-Attention Modelcited by 0
- 2026Quantum Attention by Overlap Interference: Predicting Classical and Many-Body Quantum Sequencescited by 0
- 2026QTrans: A Quantum Transformer for Sentiment Classificationcited by 0
- 2026QTrans: A Quantum Transformer for Sentiment Classification10 Sep 2026
- 2026Quantum Attention by Overlap Interference: Predicting Classical and Many-Body Quantum Sequences6 Feb 2026
- 2025HQCC: A Hybrid Quantum-Classical Classifier with Adaptive Structure2 Apr 2025
- 2025Quantum Complex-Valued Self-Attention Model24 Mar 2025
- 2024Quantum Adjoint Convolutional Layers for Effective Data Representation26 Apr 2024