Solving Statistical Mechanics Using Variational Autoregressive Networks
Not on the map. Why?
Abstract (arXiv)
We propose a general framework for solving statistical mechanics of systems with finite size. The approach extends the celebrated variational mean-field approaches using autoregressive neural networks, which support direct sampling and exact calculation of normalized probability of configurations. It computes variational free energy, estimates physical quantities such as entropy, magnetizations and correlations, and generates uncorrelated samples all at once. Training of the network employs the policy gradient approach in reinforcement learning, which unbiasedly estimates the gradient of variational parameters. We apply our approach to several classic systems, including 2D Ising models, the Hopfield model, the Sherrington-Kirkpatrick model, and the inverse Ising model, for demonstrating its advantages over existing variational mean-field methods. Our approach sheds light on solving statistical physics problems using modern deep generative neural networks.
Key facts. Cited by 99 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 16; 2023: 14; 2024: 10; 2025: 27; 2026: 20.
99 papers.
Sort:
By area:
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 58
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2021Variational Neural Annealingcited by 45
- 2025LEAPS: A discrete neural sampler via locally equivariant networkscited by 30
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physicscited by 28
- 2021NetKet 3: Machine Learning Toolbox for Many-Body Quantum Systemscited by 27
- 2022Aspects of scaling and scalability for flow-based sampling of lattice QCDcited by 26
- 2023Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspectivecited by 26
- 2022Gradients should stay on Path: Better Estimators of the Reverse- and Forward KL Divergence for Normalizing Flowscited by 22
- 2021Local-Global MCMC kernels: the best of both worldscited by 21
- 2023Variational Annealing on Graphs for Combinatorial Optimizationcited by 21
- 2021Tensor networks for unsupervised machine learningcited by 20
38 more
- 2021Unbiased Monte Carlo Cluster Updates with Autoregressive Neural Networkscited by 17
- 2021Ab-initio study of interacting fermions at finite temperature with neural canonical transformationcited by 16
- 2023Controlling Continuous Relaxation for Combinatorial Optimizationcited by 16
- 2021Efficient Bayesian Sampling Using Normalizing Flows to Assist Markov Chain Monte Carlo Methodscited by 15
- 2022Applications of Machine Learning to Lattice Quantum Field Theorycited by 14
- 2022Precision Machine Learningcited by 14
- 2024A theoretical perspective on mode collapse in variational inferencecited by 14
- 2025Discrete Neural Flow Samplers with Locally Equivariant Transformercited by 13
- 2022Hierarchical autoregressive neural networks for statistical systemscited by 12
- 2025Reinforcement Fine-Tuning for Materials Designcited by 11
- 2021Analysis of autocorrelation times in Neural Markov Chain Monte Carlo simulationscited by 10
- 2021Machine Learning of Thermodynamic Observables in the Presence of Mode Collapsecited by 10
- 2022Path-Gradient Estimators for Continuous Normalizing Flowscited by 10
- 2025Artificial intelligence for representing and characterizing quantum systemscited by 9
- 2022Neural-network solutions to stochastic reaction networkscited by 8
- 2023The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systemscited by 8
- 2023qecGPT: decoding Quantum Error-correcting Codes with Generative Pre-trained Transformerscited by 8
- 2022m^ast of two-dimensional electron gas: a neural canonical transformation studycited by 7
- 2025Rethinking Losses for Diffusion Bridge Samplerscited by 7
- 2022Supplementing Recurrent Neural Networks with Annealing to Solve Combinatorial Optimization Problemscited by 6
- 2022Deep Variational Free Energy Approach to Dense Hydrogencited by 6
- 2023eVAE: Evolutionary Variational Autoencodercited by 6
- 2022Simulating first-order phase transition with hierarchical autoregressive networkscited by 5
- 2024Message Passing Variational Autoregressive Network for Solving Intractable Ising Modelscited by 5
- 2025Multilevel Generative Samplers for Investigating Critical Phenomenacited by 5
- 2025Mitigating mode collapse in normalizing flows by annealing with an adaptive schedule: Application to parameter estimationcited by 5
- 2025Performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics modelscited by 5
- 2025Quantum computing and artificial intelligence: status and perspectivescited by 5
- 2025Boltzmann generators for amorphous particle systemscited by 5
- 2021Scaling of neural-network quantum states for time evolutioncited by 4
- 2021A Bayesian generative neural network framework for epidemic inference problemscited by 4
- 2023Mutual information of spin systems from autoregressive neural networkscited by 4
- 2023Balanced Training of Energy-Based Models with Adaptive Flow Samplingcited by 4
- 2023Empirical Sample Complexity of Neural Network Mixed State Reconstructioncited by 4
- 2023Generative Marginalization Modelscited by 4
- 2022Estimating the Euclidean quantum propagator with deep generative modeling of Feynman pathscited by 3
- 2024CoRMF: Criticality-Ordered Recurrent Mean Field Ising Solvercited by 3
- 2025Lattice Protein Folding with Variational Annealingcited by 3
50 most cited of 99 All 99 (JSON)
- 2026Fixed-point neural samplers on discrete spaces1 Oct 2026
- 2026Iterative Exact Discrete Guidance for Energy-Based Sampling29 Sep 2026
- 2026One Proposal for Every Margin: Zero-Shot Amortized Sequential Importance Sampling for Binary Matrices28 Sep 2026
- 2026Discrete Diffusion Models via Evolving Variational Autoregressive Networks23 Sep 2026
- 2026FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions1 Sep 2026
- 2026Overcoming critical slowing down in frustrated spin systems by learned multiscale sampling31 Aug 2026
- 2026Nonequilibrium Dynamics of Simple Exclusion Processes Across Dimensions26 Aug 2026
- 2026Perspectives on Tsallis Statistics for Artificial Intelligence2 Aug 2026
- 2026Enhanced Neural Quantum State via Annealed Gradient Descent21 Jul 2026
- 2026Scalable Physics-Inspired Transformers for Spin Glasses22 Jun 2026
- 2026Variational Autoregressive Networks with probability priors15 May 2026
- 2026The critical slowing down in training diffusion models12 May 2026
38 more
- 2026Sampling two-dimensional spin systems with transformers30 Apr 2026
- 2026Differentiable free energy surface: a variational approach to directly observing rare events using generative deep-learning models10 Apr 2026
- 2026Geometry-Induced Long-Range Correlations in Recurrent Neural Network Quantum States9 Apr 2026
- 2026Scaling Autoregressive Models for Lattice Thermodynamics16 Mar 2026
- 2026A Generative Sampler for distributions with possible discrete parameter based on Reversibility10 Mar 2026
- 2026Annealing in variational inference mitigates mode collapse: A theoretical study on Gaussian mixtures13 Feb 2026
- 2026Boltzmann Reinforcement Learning for Noise resilience in Analog Ising Machines9 Feb 2026
- 2026Toward Scalable Normalizing Flows for the Hubbard Model26 Jan 2026
- 2025Boltzmann generators for amorphous particle systems18 Dec 2025
- 2025Tracking large chemical reaction networks and rare events by neural networks11 Dec 2025
- 2025One-Step Diffusion Samplers via Self-Distillation and Deterministic Flow4 Dec 2025
- 2025Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learning1 Dec 2025
- 2025On the flow matching interpretability24 Oct 2025
- 2025Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimization22 Oct 2025
- 2025IsingFormer: Augmenting Parallel Tempering With Learned Proposals27 Sep 2025
- 2025Artificial intelligence for representing and characterizing quantum systems5 Sep 2025
- 2025The neural networks with tensor weights and emergent fermionic Wick rules in the large-width limit7 Jul 2025
- 2025Rethinking Losses for Diffusion Bridge Samplers12 Jun 2025
- 2025Estimation of the reduced density matrix and entanglement entropies using autoregressive networks4 Jun 2025
- 2025Quantum computing and artificial intelligence: status and perspectives29 May 2025
- 2025Performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models28 May 2025
- 2025SESaMo: Symmetry-Enforcing Stochastic Modulation for Normalizing Flows26 May 2025
- 2025Discrete Neural Flow Samplers with Locally Equivariant Transformer23 May 2025
- 2025A Generative Neural Annealer for Black-Box Combinatorial Optimization14 May 2025
- 2025Mitigating mode collapse in normalizing flows by annealing with an adaptive schedule: Application to parameter estimation6 May 2025
- 2025Reinforcement Fine-Tuning for Materials Design3 Apr 2025
- 2025NeuMC -- a package for neural sampling for lattice field theories14 Mar 2025
- 2025Multilevel Generative Samplers for Investigating Critical Phenomena11 Mar 2025
- 2025Hierarchical autoregressive neural networks in three-dimensional statistical system11 Mar 2025
- 2025Lattice Protein Folding with Variational Annealing28 Feb 2025
- 2025LEAPS: A discrete neural sampler via locally equivariant networks15 Feb 2025
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physics12 Feb 2025
- 2025Single-Step Consistent Diffusion Samplers11 Feb 2025
- 2025Accurate and thermodynamically consistent hydrogen equation of state for planetary modeling with flow matching17 Jan 2025
- 2025Simulating the Hubbard Model with Equivariant Normalizing Flows13 Jan 2025
- 2024Scalable Quantum-Inspired Optimization through Dynamic Qubit Compression24 Dec 2024
- 2024Machine learning the Ising transition: A comparison between discriminative and generative approaches28 Nov 2024
- 2024A theoretical perspective on mode collapse in variational inference17 Oct 2024
50 newest of 99 All 99 (JSON)
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 58
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physicscited by 28
- 2025Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learningcited by 2
- 2025One-Step Diffusion Samplers via Self-Distillation and Deterministic Flowcited by 1
- 2026The critical slowing down in training diffusion modelscited by 1
- 2025Single-Step Consistent Diffusion Samplerscited by 0
- 2025On the flow matching interpretabilitycited by 0
- 2026Discrete Diffusion Models via Evolving Variational Autoregressive Networkscited by 0
- 2026Discrete Diffusion Models via Evolving Variational Autoregressive Networks23 Sep 2026
- 2026The critical slowing down in training diffusion models12 May 2026
- 2025One-Step Diffusion Samplers via Self-Distillation and Deterministic Flow4 Dec 2025
- 2025Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learning1 Dec 2025
- 2025On the flow matching interpretability24 Oct 2025
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physics12 Feb 2025
- 2025Single-Step Consistent Diffusion Samplers11 Feb 2025
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimization3 Jun 2024
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2021Variational Neural Annealingcited by 45
- 2025LEAPS: A discrete neural sampler via locally equivariant networkscited by 30
- 2021NetKet 3: Machine Learning Toolbox for Many-Body Quantum Systemscited by 27
- 2022Aspects of scaling and scalability for flow-based sampling of lattice QCDcited by 26
- 2023Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspectivecited by 26
- 2022Gradients should stay on Path: Better Estimators of the Reverse- and Forward KL Divergence for Normalizing Flowscited by 22
- 2021Local-Global MCMC kernels: the best of both worldscited by 21
- 2023Variational Annealing on Graphs for Combinatorial Optimizationcited by 21
- 2021Tensor networks for unsupervised machine learningcited by 20
- 2021Unbiased Monte Carlo Cluster Updates with Autoregressive Neural Networkscited by 17
- 2021Ab-initio study of interacting fermions at finite temperature with neural canonical transformationcited by 16
12 most cited of 91 All 91 (JSON)
- 2026Fixed-point neural samplers on discrete spaces1 Oct 2026
- 2026Iterative Exact Discrete Guidance for Energy-Based Sampling29 Sep 2026
- 2026One Proposal for Every Margin: Zero-Shot Amortized Sequential Importance Sampling for Binary Matrices28 Sep 2026
- 2026FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions1 Sep 2026
- 2026Overcoming critical slowing down in frustrated spin systems by learned multiscale sampling31 Aug 2026
- 2026Nonequilibrium Dynamics of Simple Exclusion Processes Across Dimensions26 Aug 2026
- 2026Perspectives on Tsallis Statistics for Artificial Intelligence2 Aug 2026
- 2026Enhanced Neural Quantum State via Annealed Gradient Descent21 Jul 2026
- 2026Scalable Physics-Inspired Transformers for Spin Glasses22 Jun 2026
- 2026Variational Autoregressive Networks with probability priors15 May 2026
- 2026Sampling two-dimensional spin systems with transformers30 Apr 2026
- 2026Differentiable free energy surface: a variational approach to directly observing rare events using generative deep-learning models10 Apr 2026
12 newest of 91 All 91 (JSON)