mlsanityData to 7 Oct 2026

GQHAN: A Grover-inspired Quantum Hard Attention Network

arXiv 2401.14089 ↗First posted 25 Jan 2024quant-ph cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Numerous current Quantum Machine Learning (QML) models exhibit an inadequacy in discerning the significance of quantum data, resulting in diminished efficacy when handling extensive quantum datasets. Hard Attention Mechanism (HAM), anticipated to efficiently tackle the above QML bottlenecks, encounters the substantial challenge of non-differentiability, consequently constraining its extensive applicability. In response to the dilemma of HAM and QML, a Grover-inspired Quantum Hard Attention Mechanism (GQHAM) consisting of a Flexible Oracle (FO) and an Adaptive Diffusion Operator (ADO) is proposed. Notably, the FO is designed to surmount the non-differentiable issue by executing the activation or masking of Discrete Primitives (DPs) with Flexible Control (FC) to weave various discrete destinies. Based on this, such discrete choice can be visualized with a specially defined Quantum Hard Attention Score (QHAS). Furthermore, a trainable ADO is devised to boost the generality and flexibility of GQHAM. At last, a Grover-inspired Quantum Hard Attention Network (GQHAN) based on QGHAM is constructed on PennyLane platform for Fashion MNIST binary classification. Experimental findings demonstrate that GQHAN adeptly surmounts the non-differentiability hurdle, surpassing the efficacy of extant quantum soft self-attention mechanisms in accuracies and learning ability. In noise experiments, GQHAN is robuster to bit-flip noise in accuracy and amplitude damping noise in learning performance. Predictably, the proposal of GQHAN enriches the Quantum Attention Mechanism (QAM), lays the foundation for future quantum computers to process large-scale data, and promotes the development of quantum computer vision.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 16 of its 42 references that are in the map. First posted on arXiv 25 Jan 2024.

Builds on

16 of 42 references.

References · 16

  1. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  2. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  3. 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 672
  4. 2023Challenges and Opportunities in Quantum Machine Learningcited by 202
  5. 2019Quantum Natural Gradientcited by 104
  6. 2020Learning When and Where to Zoom with Deep Reinforcement Learningcited by 43
  7. 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 42
  8. 2019Saccader: Improving Accuracy of Hard Attention Models for Visioncited by 35
  9. 2019Processing Megapixel Images with Deep Attention-Sampling Modelscited by 29
  10. 2022QSAN: A Near-term Achievable Quantum Self-Attention Networkcited by 25
  11. 2018Learning Visual Question Answering by Bootstrapping Hard Attentioncited by 24
  12. 2023QKSAN: A Quantum Kernel Self-Attention Networkcited by 23
4 more
  1. 2021Hard-Attention for Scalable Image Classificationcited by 18
  2. 2022Multi-agent Reinforcement Learning for Dynamic Resource Management in 6G in-X Subnetworkscited by 8
  3. 2020Fast Black-Box Quantum State Preparationcited by 5
  4. 2022Video Violence Recognition and Localization Using a Semi-Supervised Hard Attention Modelcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 2.

5 papers.