mlsanityData to 14 Oct 2026

Trainable Quantum-Native Language Models: Dissipative Memory, Capacity Limits, and Hardware Validation

arXiv 2610.12806 ↗First posted 8 Oct 2026quant-ph cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We study byte-level autoregressive language models whose hidden state is a small quantum register, whose transitions are learned token-conditioned quantum channels, and whose next-byte probabilities come directly from Born-rule measurements without a learned classical vocabulary projection or softmax. In the fixed-width recurrent setting, unitary dynamics cannot contract or reset stored distinctions; experimentally, unitary recurrence loses to its retrained one-token control in every tested variant. Introducing learned dissipation, then token-conditioned dissipative gating, yields useful memory beyond one token. The gated model improves test negative log-likelihood by 0.20 +/- 0.03 nats/byte over retrained parameter-matched one-token controls at context length 12, and by 0.29-0.33 at longer contexts, but never beats retrained two-token controls. A key-value recall benchmark shows a width-dependent threshold: one stored pair meets the pre-registered accuracy bar at 4-5 memory qubits, two pairs at 6-7, and three pairs remain unsolved. This is consistent with, but does not establish, a capacity explanation for the short effective memory horizon. As a secondary result, one-qubit models reach lower stationary memory entropy than a heuristically optimized classical predictive frontier at matched error in 9/9 seeds. On IBM Heron hardware, computational-basis memory-register distributions show signal against a uniform null in 12/12 circuits across prefixes of up to 12 tokens, next-bit probabilities pass pre-registered accuracy bars at four-token prefixes, and bytes are generated autoregressively by sampling physically measured bit probabilities. The tested models are classically simulable and substantially worse than classical n-gram baselines. We claim no computational quantum advantage.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

19 of 36 references.

References · 19

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  3. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  4. 2018Barren plateaus in quantum neural network training landscapescited by 630
  5. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 408
  6. 2015Unitary Evolution Recurrent Neural Networkscited by 294
  7. 2019Efficient Learning for Deep Quantum Neural Networkscited by 161
  8. 2020Quantum Long Short-Term Memorycited by 120
  9. 2016Full-Capacity Unitary Recurrent Neural Networkscited by 94
  10. 2018Differentiable Learning of Quantum Circuit Born Machinecited by 93
  11. 2020Recurrent Quantum Neural Networkscited by 80
  12. 2019The Born Supremacy: Quantum Advantage and Training of an Ising Born Machinecited by 76
7 more
  1. 2021QNLP in Practice: Running Compositional Models of Meaning on a Quantum Computercited by 67
  2. 2016Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNscited by 65
  3. 2021lambeq: An Efficient High-Level Python Library for Quantum NLPcited by 44
  4. 2023Quantum Recurrent Neural Networks for Sequential Learningcited by 25
  5. 2020Grammar-aware sentence classification on quantum computerscited by 17
  6. 2022Quantum Natural Language Generation on Near-Term Devicescited by 11
  7. 2025Practical Hybrid Quantum Language Models with Observable Readout on Real Hardwarecited by 1

Built on by

Not cited yet.