Is Variational Monte Carlo Robust? Sharp Moment Thresholds and Heavy-tailed Stochastic Optimization
Not on the map. Why?
Abstract (arXiv)
Variational Monte Carlo (VMC) is a central algorithm in electronic structure theory and has gained renewed importance through modern neural-network ans"atze such as FermiNet. At its core, VMC seeks ground states by minimizing the Rayleigh quotient by stochastic optimization. In this work, we show that the resulting stochastic optimization problem is intrinsically governed by the nodal geometry of the underlying wave function. More precisely, we establish that properties of the nodal set determine the integrability of the local energy and gradient estimators that drive VMC. For broad and practically relevant ansatz classes, including Slater-Jastrow wave functions with variable-exponent Slater-type orbitals, we prove that these estimators are generically heavy-tailed and fail to admit higher moments. At the same time, for general analytic ans"atze, we prove weak moment bounds for the relevant estimators and identify precise low-moment regimes, showing how generic and degenerate nodal structures lead to different integrability thresholds. Building on this analysis, we introduce a new robust variant of VMC unicodex2013 coined PS-Clip-VMC unicodex2013 which is based on clipping both the local energies and the per-sample gradients. We prove that PS-Clip-VMC converges both in expectation and with high probability in the weak moment regime of VMC. The robustness of our method is confirmed experimentally by training FermiNet on atoms with up to 18 electrons.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 43 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
19 of 43 references.
References · 19
- 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 195
- 2017Sub-sampled Cubic Regularization for Non-convex Optimizationcited by 63
- 2022A Self-Attention Ansatz for Ab-initio Quantum Chemistrycited by 45
- 2021Ab-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functionscited by 36
- 2020Better, Faster Fermionic Neural Networkscited by 28
- 2022Ab-initio quantum chemistry with neural-network wavefunctionscited by 28
- 2023Generalizing Neural Wave Functionscited by 26
- 2022Gold-standard solutions to the Schr"odinger equation using deep learning: How much physics do we need?cited by 25
- 2022Sampling-free Inference for Ab-Initio Potential Energy Surface Networkscited by 19
- 2021Explicitly antisymmetrized neural network layers for variational Monte Carlo simulationcited by 14
- 2023Variational Monte Carlo on a Budget -- Fine-tuning pre-trained Neural Wavefunctionscited by 8
- 2025Accurate Ab-initio Neural-network Solutions to Large-Scale Electronic Structure Problemscited by 8
7 more
- 2024Transferable Neural Wavefunctions for Solidscited by 7
- 2023Towards a Foundation Model for Neural Network Wavefunctionscited by 6
- 2023Convergence Analysis of Stochastic Gradient Descent with MCMC Estimatorscited by 3
- 2025Functional Neural Wavefunction Optimizationcited by 3
- 2023Convergence of variational Monte Carlo simulation and scale-invariant pre-trainingcited by 2
- 2022O(N2) Universal Antisymmetry in Fermionic Neural Networkscited by 1
- 2026Robust and Fast Training via Per-Sample Clippingcited by 1
Built on by
Not cited yet.