Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimization
Not on the map. Why?
Abstract (arXiv)
Combinatorial optimization problems are central to both practical applications and the development of optimization methods. While classical and quantum algorithms have been refined over decades, machine learning--assisted approaches are comparatively recent and have not yet consistently outperformed simple, state-of-the-art classical methods. Here, we focus on a class of Quadratic Unconstrained Binary Optimization (QUBO) problems, specifically the challenge of finding minimum energy configurations in three-dimensional Ising spin glasses. We use a Global Annealing Monte Carlo algorithm that integrates standard local moves with global moves proposed via machine learning. We show that local moves play a crucial role in achieving optimal performance. Benchmarking against Simulated Annealing and Population Annealing, we demonstrate that Global Annealing not only surpasses the performance of Simulated Annealing but also exhibits greater robustness than Population Annealing, maintaining effectiveness across problem hardness and system size without hyperparameter tuning. These results provide clear and robust evidence that a machine learning--assisted optimization method can exceed the capabilities of classical state-of-the-art techniques in a combinatorial optimization setting.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 34 of its 110 references that are in the map. First posted on arXiv 22 Oct 2025.
Builds on
34 of 110 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2015MADE: Masked Autoencoder for Distribution Estimationcited by 307
- 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 250
- 2013Ising formulations of many NP problemscited by 207
- 2019Flow-based generative models for Markov chain Monte Carlo in lattice field theorycited by 148
- 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 108
- 2020Equivariant flow-based sampling for lattice gauge theorycited by 103
- 2018Solving Statistical Mechanics Using Variational Autoregressive Networkscited by 100
22 more
- 2021Variational Neural Annealingcited by 47
- 2022Learning Lattice Quantum Field Theories with Equivariant Continuous Flowscited by 37
- 2022Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 33
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physicscited by 29
- 2021Scaling Up Machine Learning For Quantum Field Theory with Equivariant Continuous Flowscited by 24
- 2022Inability of a graph neural network heuristic to outperform greedy algorithms in solving combinatorial optimization problems like Max-Cutcited by 19
- 2022Wavelet Conditional Renormalization Groupcited by 11
- 2023Accelerating Markov Chain Monte Carlo sampling with diffusion modelscited by 10
- 2025Generative diffusion model with inverse renormalization group flowscited by 10
- 2019Monte Carlo algorithms are very effective in finding the largest independent set in sparse random graphscited by 9
- 2025Performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics modelscited by 5
- 2025Sequential Stochastic Combinatorial Optimization Using Hierarchal Reinforcement Learningcited by 4
- 2019Analysis of the Relation between Quadratic Unconstrained Binary Optimization (QUBO) and the Spin Glass Ground-State Problemcited by 3
- 2023Deep reinforced learning heuristic tested on spin-glass ground states: The larger picturecited by 3
- 2025Hierarchical autoregressive neural networks in three-dimensional statistical systemcited by 3
- 2025IsingFormer: Augmenting Parallel Tempering With Learned Proposalscited by 3
- 2020BiqBin: a parallel branch-and-bound solver for binary quadratic problems with linear constraintscited by 2
- 2021How we are leading a 3-XORSAT challenge: from the energy landscape to the algorithm and its efficient implementation on GPUscited by 1
- 2025SpinGlassPEPS.jl: Tensor-network package for Ising-like optimization on quasi-two-dimensional graphscited by 1
- 2025Uncertainty in AI-driven Monte Carlo simulationscited by 1
- 2025Nonlocal Monte Carlo via Reinforcement Learningcited by 1
- 2025GTA -- An ATSP Method: Shifting the Bottleneck from Algorithm to RAMcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Scalable Physics-Inspired Transformers for Spin Glassescited by 2
- 2026The critical slowing down in training diffusion modelscited by 1
- 2026Leveraging generative models to assist Monte Carlo samplingcited by 1
- 2026Discrete Diffusion Models via Evolving Variational Autoregressive Networkscited by 0
- 2026Probabilistic Algorithms for Ising Machines from Optimization to Generative AIcited by 0
- 2026Probabilistic Algorithms for Ising Machines from Optimization to Generative AI2 Oct 2026
- 2026Discrete Diffusion Models via Evolving Variational Autoregressive Networks23 Sep 2026
- 2026Leveraging generative models to assist Monte Carlo sampling7 Aug 2026
- 2026Scalable Physics-Inspired Transformers for Spin Glasses22 Jun 2026
- 2026The critical slowing down in training diffusion models12 May 2026