mlsanityData to 7 Oct 2026

Deep Sequence Modeling with Quantum Dynamics: Language as a Wave Function

arXiv 2602.22255 ↗First posted 24 Feb 2026cs.LG cs.AI quant-phcited by 2

Not on the map. Why?

Abstract (arXiv)

We introduce a sequence modeling framework in which the latent state is a complex-valued wave function evolving on a finite-dimensional Hilbert space under a learned, time-dependent Hamiltonian. Unlike standard recurrent architectures that rely on gating mechanisms to suppress competing hypotheses, our framework utilizes quantum interference: the Hamiltonian steers the phases of complex amplitudes so that conflicting interpretations cancel while compatible ones reinforce. The dynamics are strictly unitary, ensuring that the state norm is preserved exactly at every time step via a Cayley (Crank--Nicolson) discretization. Token probabilities are extracted using the Born rule, a quadratic measurement operator that couples magnitudes and relative phases. Our primary theoretical contribution is a separation theorem characterizing the representational advantage of this readout: we define a family of disambiguation tasks that a complex unitary model of dimension N solves exactly, but which requires a state dimension of Omega(N2) for any real-valued orthogonal model equipped with a standard affine-softmax readout. This quadratic gap arises because the Born rule implicitly lifts the N-dimensional state into the space of rank-one Hermitian matrices, accessing pairwise phase correlations that are inaccessible to linear projections. Finally, we derive a continuity equation for the latent probability mass, yielding conserved pairwise currents that serve as a built-in diagnostic for tracing information flow between dimensions.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 61 references that are in the map. First posted on arXiv 24 Feb 2026.

Builds on

34 of 61 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  5. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  6. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  7. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  8. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  9. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  10. 2022Simplified State Space Layers for Sequence Modelingcited by 776
  11. 2019Hamiltonian Neural Networkscited by 702
  12. 2020Variational Quantum Algorithmscited by 687
22 more
  1. 2018Supervised learning with quantum enhanced feature spacescited by 654
  2. 2018Barren plateaus in quantum neural network training landscapescited by 624
  3. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  4. 2019Augmented Neural ODEscited by 396
  5. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 388
  6. 2020The power of quantum neural networkscited by 377
  7. 2017Stable Architectures for Deep Neural Networkscited by 340
  8. 2015Unitary Evolution Recurrent Neural Networkscited by 291
  9. 2017Deep Complex Networkscited by 215
  10. 2020Liquid Time-constant Networkscited by 160
  11. 2017Breaking the Softmax Bottleneck: A High-Rank RNN Language Modelcited by 147
  12. 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
  13. 2016Pymanopt: A Python Toolbox for Optimization on Manifolds using Automatic Differentiationcited by 93
  14. 2016Full-Capacity Unitary Recurrent Neural Networkscited by 90
  15. 2018Differentiable Learning of Quantum Circuit Born Machinecited by 90
  16. 2017On orthogonality and learning recurrent networks with long term dependenciescited by 82
  17. 2018A quantum-inspired classical algorithm for recommendation systemscited by 70
  18. 2021Closed-form Continuous-time Neural Modelscited by 65
  19. 2016Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflectionscited by 56
  20. 2016Supervised Learning with Quantum-Inspired Tensor Networkscited by 35
  21. 2017Information Perspective to Probabilistic Modeling: Boltzmann Machines versus Born Machinescited by 33
  22. 2017Better than Real: Complex-valued Neural Nets for MRI Fingerprintingcited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.