mlsanityData to 7 Oct 2026

Gradient-estimator design overcomes trainability barriers in neural-network-based variational optimization

arXiv 2609.22342 ↗First posted 16 Sep 2026cond-mat.dis-nn cond-mat.str-el cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural networks provide expressive representations for scientific computing. However, even sufficiently expressive networks can suffer training failure in weak-gradient regimes, limiting their practical use in quantum many-body physics and ab initio quantum chemistry. Here we derive an unbiased direct gradient estimator and introduce the adaptive minimum-variance phase (AMVP) estimator for neural-network variational optimization. By improving the signal-to-noise ratio of weak gradients, these methods enable reliable scientific calculations where training previously failed, while substantially reducing computational cost. The framework enables compact networks to outperform larger and fine-tuned default standard-estimator models with over an order of magnitude less GPU time on correlated flux models, and ultimately exceed the density matrix renormalization group (DMRG) accuracy. It further achieves chemical accuracy in N2 bond breaking and, for the first time, in heavy-element I2 with explicit spin-orbit coupling. These results demonstrate that gradient-estimator design expands the capabilities of neural-network variational methods for accurate scientific computing.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 48 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

12 of 48 references.

References · 12

  1. 2016Optimization Methods for Large-Scale Machine Learningcited by 1,140
  2. 2013Black Box Variational Inferencecited by 317
  3. 2019Monte Carlo Gradient Estimation in Machine Learningcited by 281
  4. 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 195
  5. 2017Backpropagation through the Void: Optimizing control variates for black-box gradient estimationcited by 104
  6. 2018Understanding and correcting pathologies in the training of learned optimizerscited by 97
  7. 2019Deep autoregressive models for the efficient variational simulation of many-body quantum systemscited by 64
  8. 2019PIPPS: Flexible Model-Based Policy Search Robust to the Curse of Chaoscited by 56
  9. 2022A Self-Attention Ansatz for Ab-initio Quantum Chemistrycited by 45
  10. 2018Doubly Reparameterized Gradient Estimators for Monte Carlo Objectivescited by 41
  11. 2021Autoregressive neural-network wavefunctions for ab initio quantum chemistrycited by 21
  12. 2020Neural network wave functions and the sign problemcited by 20

Built on by

Not cited yet.