Deep Sequence Modeling with Quantum Dynamics: Language as a Wave Function
Not on the map. Why?
Abstract (arXiv)
We introduce a sequence modeling framework in which the latent state is a complex-valued wave function evolving on a finite-dimensional Hilbert space under a learned, time-dependent Hamiltonian. Unlike standard recurrent architectures that rely on gating mechanisms to suppress competing hypotheses, our framework utilizes quantum interference: the Hamiltonian steers the phases of complex amplitudes so that conflicting interpretations cancel while compatible ones reinforce. The dynamics are strictly unitary, ensuring that the state norm is preserved exactly at every time step via a Cayley (Crank--Nicolson) discretization. Token probabilities are extracted using the Born rule, a quadratic measurement operator that couples magnitudes and relative phases. Our primary theoretical contribution is a separation theorem characterizing the representational advantage of this readout: we define a family of disambiguation tasks that a complex unitary model of dimension N solves exactly, but which requires a state dimension of Omega(N2) for any real-valued orthogonal model equipped with a standard affine-softmax readout. This quadratic gap arises because the Born rule implicitly lifts the N-dimensional state into the space of rank-one Hermitian matrices, accessing pairwise phase correlations that are inaccessible to linear projections. Finally, we derive a continuity equation for the latent probability mass, yielding conserved pairwise currents that serve as a built-in diagnostic for tracing information flow between dimensions.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 61 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
34 of 61 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2019Hamiltonian Neural Networkscited by 702
- 2020Variational Quantum Algorithmscited by 687
22 more
- 2018Supervised learning with quantum enhanced feature spacescited by 654
- 2018Barren plateaus in quantum neural network training landscapescited by 624
- 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
- 2019Augmented Neural ODEscited by 396
- 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 388
- 2020The power of quantum neural networkscited by 377
- 2017Stable Architectures for Deep Neural Networkscited by 340
- 2015Unitary Evolution Recurrent Neural Networkscited by 291
- 2017Deep Complex Networkscited by 215
- 2020Liquid Time-constant Networkscited by 160
- 2017Breaking the Softmax Bottleneck: A High-Rank RNN Language Modelcited by 147
- 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
- 2016Pymanopt: A Python Toolbox for Optimization on Manifolds using Automatic Differentiationcited by 93
- 2016Full-Capacity Unitary Recurrent Neural Networkscited by 90
- 2018Differentiable Learning of Quantum Circuit Born Machinecited by 90
- 2017On orthogonality and learning recurrent networks with long term dependenciescited by 82
- 2018A quantum-inspired classical algorithm for recommendation systemscited by 70
- 2021Closed-form Continuous-time Neural Modelscited by 65
- 2016Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflectionscited by 56
- 2016Supervised Learning with Quantum-Inspired Tensor Networkscited by 35
- 2017Information Perspective to Probabilistic Modeling: Boltzmann Machines versus Born Machinescited by 33
- 2017Better than Real: Complex-valued Neural Nets for MRI Fingerprintingcited by 30
Built on by
Citing papers per year: 2026: 2.
2 papers.