mlsanityData to 7 Oct 2026

Quantum Complex-Valued Self-Attention Model

arXiv 2503.19002 ↗First posted 24 Mar 2025quant-ph cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-attention has revolutionized classical machine learning, yet existing quantum self-attention models underutilize quantum states' potential due to oversimplified or incomplete mechanisms. To address this limitation, we introduce the Quantum Complex-Valued Self-Attention Model (QCSAM), the first framework to leverage complex-valued similarities, which captures amplitude and phase relationships between quantum states more comprehensively. To achieve this, QCSAM extends the Linear Combination of Unitaries (LCUs) into the Complex LCUs (CLCUs) framework, enabling precise complex-valued weighting of quantum states and supporting quantum multi-head attention. Experiments on MNIST and Fashion-MNIST show that QCSAM outperforms recent quantum self-attention models, including QKSAN, QSAN, and GQHAN. With only 4 qubits, QCSAM achieves 100% and 99.2% test accuracies on MNIST and Fashion-MNIST, respectively. Furthermore, we evaluate scalability across 3-8 qubits and 2-4 class tasks, while ablation studies validate the advantages of complex-valued attention weights over real-valued alternatives. This work advances quantum machine learning by enhancing the expressiveness and precision of quantum self-attention in a way that aligns with the inherent complexity of quantum mechanics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 24 Mar 2025.

Builds on

25 of 52 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2020A Survey on Visual Transformercited by 653
  7. 2022Multimodal Learning with Transformers: A Surveycited by 399
  8. 2019Parameterized quantum circuits as machine learning modelscited by 330
  9. 2023Transformer-Based Visual Segmentation: A Surveycited by 124
  10. 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
  11. 2021Contextual Transformer Networks for Visual Recognitioncited by 90
  12. 2016Quantum-enhanced machine learningcited by 79
13 more
  1. 2022Video Transformers: A Surveycited by 63
  2. 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
  3. 2022Quantum Vision Transformerscited by 48
  4. 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 42
  5. 2021Capacity and quantum geometry of parametrized quantum circuitscited by 32
  6. 2022QSAN: A Near-term Achievable Quantum Self-Attention Networkcited by 25
  7. 2023QKSAN: A Quantum Kernel Self-Attention Networkcited by 23
  8. 2022Problem-Dependent Power of Quantum Neural Networks on Multi-Class Classificationcited by 20
  9. 2023NineRec: A Benchmark Dataset Suite for Evaluating Transferable Recommendationcited by 18
  10. 2024Quantum Mixed-State Self-Attention Networkcited by 11
  11. 2024Quantum Transformer: Accelerating model inference via quantum linear algebracited by 8
  12. 2024GQHAN: A Grover-inspired Quantum Hard Attention Networkcited by 5
  13. 2023Implementing any Linear Combination of Unitaries on Intermediate-term Quantum Computerscited by 4

Built on by

Not cited yet.