mlsanityData to 7 Oct 2026

CLAQS: Compact Learnable All-Quantum Token Mixer with Shared-ansatz for Text Classification

arXiv 2510.06532 ↗First posted 8 Oct 2025quant-ph cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Quantum compute is scaling fast, from cloud QPUs to high throughput GPU simulators, making it timely to prototype quantum NLP beyond toy tasks. However, devices remain qubit limited and depth limited, training can be unstable, and classical attention is compute and memory heavy. This motivates compact, phase aware quantum token mixers that stabilize amplitudes and scale to long sequences. We present CLAQS, a compact, fully quantum token mixer for text classification that jointly learns complex-valued mixing and nonlinear transformations within a unified quantum circuit. To enable stable end-to-end optimization, we apply l1 normalization to regulate amplitude scaling and introduce a two-stage parameterized quantum architecture that decouples shared token embeddings from a window-level quantum feed-forward module. Operating under a sliding-window regime with document-level aggregation, CLAQS requires only eight data qubits and shallow circuits, yet achieves 91.64% accuracy on SST-2 and 87.08% on IMDB, outperforming both classical Transformer baselines and strong hybrid quantum-classical counterparts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 19 references that are in the map. First posted on arXiv 8 Oct 2025.

Builds on

10 of 19 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 388
  4. 2021FNet: Mixing Tokens with Fourier Transformscited by 343
  5. 2021QNLP in Practice: Running Compositional Models of Meaning on a Quantum Computercited by 65
  6. 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 42
  7. 2022When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computingcited by 40
  8. 2019The Mathematics of Text Structurecited by 24
  9. 2020Grammar-aware sentence classification on quantum computerscited by 16
  10. 2024Quantum Mixed-State Self-Attention Networkcited by 11

Built on by

Not cited yet.