Geometry-Induced Long-Range Correlations in Recurrent Neural Network Quantum States
Not on the map. Why?
Abstract (arXiv)
Neural Quantum States based on autoregressive recurrent neural network (RNN) wave functions enable efficient sampling without Markov-chain autocorrelation, but standard RNN architectures are biased toward finite-length correlations and can fail on states with long-range dependencies. A common response is to adopt transformer-style self-attention, but this typically comes with substantially higher computational and memory overhead. Here we introduce dilated RNN wave functions, where recurrent units access distant sites through dilated connections, injecting an explicit long-range inductive bias while retaining a favorable O(N log N) forward pass scaling. We show analytically that dilation changes the correlation geometry and can induce power-law correlation scaling in a simplified linearized and perturbative setting. Numerically, for the critical 1D transverse-field Ising model, dilated RNNs reproduce the expected power-law connected two-point correlations in contrast to the exponential decay typical of conventional RNN ans"atze. We further show that the dilated RNN accurately approximates the one-dimensional Cluster state, a paradigmatic example with long-range conditional correlations that has previously been reported to be challenging for RNN-based wave functions. These results highlight dilation as a simple geometric mechanism for building correlation-aware autoregressive neural quantum states.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 57 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
23 of 57 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2015MADE: Masked Autoencoder for Distribution Estimationcited by 307
- 2015A Critical Review of Recurrent Neural Networks for Sequence Learningcited by 224
- 2014Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognitioncited by 111
- 2018Solving Statistical Mechanics Using Variational Autoregressive Networkscited by 100
- 2016Neural Autoregressive Distribution Estimationcited by 95
- 2017Dilated Recurrent Neural Networkscited by 83
- 2014A Clockwork RNNcited by 72
- 2019Deep autoregressive models for the efficient variational simulation of many-body quantum systemscited by 64
- 2021Variational Neural Annealingcited by 47
11 more
- 2016Minimal Gated Unit for Recurrent Neural Networkscited by 40
- 2021Gauge Invariant and Anyonic Symmetric Transformer and RNN Quantum States for Quantum Lattice Modelscited by 18
- 2019Mutual Information Scaling and Expressive Power of Sequence Modelscited by 14
- 2024Recurrent neural network wave functions for Rydberg atom arrays on kagome latticecited by 8
- 2022Supplementing Recurrent Neural Networks with Annealing to Solve Combinatorial Optimization Problemscited by 6
- 2024When can classical neural networks represent quantum states?cited by 6
- 2025Lattice Protein Folding with Variational Annealingcited by 3
- 2025Functional Neural Wavefunction Optimizationcited by 3
- 2025GeoHNNs: Geometric Hamiltonian Neural Networkscited by 3
- 2025Are GNNs doomed by the topology of their input graph?cited by 1
- 2025Adaptive Neural Quantum States: A Recurrent Neural Network Perspectivecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.