Apparent Compression, Real Stability: The Intrinsic Dimension of Learning a Quantum Wavefunction
Not on the map. Why?
Abstract (arXiv)
How many directions in weight space does training need? The intrinsic dimension answers this with the smallest number of random directions in which training still reaches a target accuracy, and small values have motivated parameter-efficient methods such as LoRA. We measure it for variational Monte Carlo (VMC), which trains a neural network to represent the ground state of a quantum many-body system. VMC is a demanding test, because the network generates its own training samples and every gradient is noisy, and a revealing one, because the exact answer is known and every run can be scored. We train only a small latent vector that a frozen random map turns into the network's weights, with no change to the standard natural-gradient optimizer. We find that a small dimension can be misleading, while the stability it brings is real. On a magnet with a hard sign pattern, a network that cannot represent signs reaches its best energy in 8 of 28,642 directions, but only because no such network can go lower; once signs are learnable, neither the signs nor the magnitudes are cheap. The dimension rises across a quantum phase transition, so it tracks how difficult a state is at far less compute than fitting a scaling law, yet it never falls below a floor set by the random subspace itself, even where the ground state is nearly trivial. Training in the subspace, in contrast, never diverged in our experiments, whereas full-parameter training with the same settings did, and a control with matched solvers attributes the difference to the reduced dimension.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 38 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
13 of 38 references.
References · 13
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
- 2019Quantum Natural Gradientcited by 106
- 2019Deep autoregressive models for the efficient variational simulation of many-body quantum systemscited by 64
- 2021How many degrees of freedom do we need to train deep networks: a loss landscape perspectivecited by 28
- 2021NetKet 3: Machine Learning Toolbox for Many-Body Quantum Systemscited by 28
- 2020Neural network wave functions and the sign problemcited by 20
- 2019Geometry of learning neural quantum statescited by 14
- 2025Adiabatic Fine-Tuning of Neural Quantum States Enables Detection of Phase Transitions in Weight Spacecited by 3
- 2026Parametric Quantum State Tomography with HyperRBMscited by 1
- 2026Mapping Networkscited by 1
Built on by
Not cited yet.