Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics
Not on the map. Why?
Abstract (arXiv)
Sampling from known probability distributions is a ubiquitous task in computational science, underlying calculations in domains from linguistics to biology and physics. Generative machine-learning (ML) models have emerged as a promising tool in this space, building on the success of this approach in applications such as image, text, and audio generation. Often, however, generative tasks in scientific domains have unique structures and features -- such as complex symmetries and the requirement of exactness guarantees -- that present both challenges and opportunities for ML. This Perspective outlines the advances in ML-based sampling motivated by lattice quantum field theory, in particular for the theory of quantum chromodynamics. Enabling calculations of the structure and interactions of matter from our most fundamental understanding of particle physics, lattice quantum chromodynamics is one of the main consumers of open-science supercomputing worldwide. The design of ML algorithms for this application faces profound challenges, including the necessity of scaling custom ML architectures to the largest supercomputers, but also promises immense benefits, and is spurring a wave of development in ML-based sampling more broadly. In lattice field theory, if this approach can realize its early promise it will be a transformative step towards first-principles physics calculations in particle, nuclear and condensed matter physics that are intractable with traditional approaches.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 58 of its 107 references that are in the map. First posted on arXiv 3 Sep 2023.
Builds on
58 of 107 references.
References · 58
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
38 more
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2016Pixel Recurrent Neural Networkscited by 814
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 557
- 2020Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Imagescited by 261
- 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 254
- 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 248
- 2020Representation Learning via Invariant Causal Mechanismscited by 197
- 2020Stochastic Normalizing Flowscited by 156
- 2018Neural Importance Samplingcited by 154
- 2019Flow-based generative models for Markov chain Monte Carlo in lattice field theorycited by 147
- 2020Equivariant flow-based sampling for lattice gauge theorycited by 102
- 2021Annealed Flow Transport Monte Carlocited by 90
- 2020Sampling using SU(N) gauge equivariant flowscited by 83
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
- 2019NeuTra-lizing Bad Geometry in Hamiltonian Monte Carlo Using Neural Transportcited by 73
- 2020Augmented Normalizing Flows: Bridging the Gap Between Generative Flows and Latent Variable Modelscited by 66
- 2022Continual Repeated Annealed Flow Transport Monte Carlocited by 66
- 2020An overview on deep learning-based approximation methods for partial differential equationscited by 65
- 2018Neural Network Renormalization Groupcited by 48
- 2019Equivariant Hamiltonian Flowscited by 39
- 2022Learning Lattice Quantum Field Theories with Equivariant Continuous Flowscited by 37
- 2017A-NICE-MC: Adversarial Training for MCMCcited by 36
- 2019Bayesian parameter estimation using conditional variational autoencoders for gravitational-wave astronomycited by 36
- 2020Neural Control Variatescited by 34
- 2022Gauge-equivariant flow models for sampling in lattice field theories with pseudofermionscited by 30
- 2021Flow-based sampling for fermionic lattice field theoriescited by 27
- 2022Aspects of scaling and scalability for flow-based sampling of lattice QCDcited by 26
- 2021Flow-based sampling for multimodal and extended-mode distributions in lattice field theorycited by 25
- 2022Stochastic normalizing flows as non-equilibrium transformationscited by 25
- 2021Scaling Up Machine Learning For Quantum Field Theory with Equivariant Continuous Flowscited by 24
- 2016Accelerate Monte Carlo Simulations with Restricted Boltzmann Machinescited by 21
- 2017Continuous-Time Flows for Efficient Inference and Density Estimationcited by 21
- 2021Equivariant Manifold Flowscited by 20
- 2022Flow-based sampling in the lattice Schwinger model at criticalitycited by 20
- 2019Neural Networks with Cheap Differential Operatorscited by 18
- 2019Neural Canonical Transformation with Symplectic Flowscited by 16
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2023: 3; 2024: 9; 2025: 8; 2026: 3.
23 papers.
Sort:
By area:
- 2023Generative Diffusion Models for Lattice Field Theorycited by 13
- 2024Flow-Based Sampling for Entanglement Entropy and the Machine Learning of Defectscited by 13
- 2024Applications of flow models to the generation of correlated lattice QCD ensemblescited by 10
- 2024On learning higher-order cumulants in diffusion modelscited by 10
- 2024Scaling of Stochastic Normalizing Flows in SU(3) lattice gauge theorycited by 10
- 2024Bayesian RG Flow in Neural Network Field Theoriescited by 9
- 2025Physics-Conditioned Diffusion Models for Lattice Gauge Theorycited by 9
- 2025Physics-Driven Learning for Inverse Problems in Quantum Chromodynamicscited by 7
- 2024Practical applications of machine-learned flows on gauge fieldscited by 6
- 2024Numerical determination of the width and shape of the effective string using Stochastic Normalizing Flowscited by 6
- 2025Scaling flow-based approaches for topology sampling in SU(3) gauge theorycited by 6
- 2024Fast and Unified Path Gradient Estimators for Normalizing Flowscited by 5
11 more
- 2025Multilevel Generative Samplers for Investigating Critical Phenomenacited by 5
- 2023Equivariant Transformer is all you needcited by 3
- 2025Group-Equivariant Diffusion Models for Lattice Field Theorycited by 3
- 2023The NFLikelihood: an unsupervised DNNLikelihood from Normalizing Flowscited by 2
- 2026Toward Scalable Normalizing Flows for the Hubbard Modelcited by 2
- 2025Simulating the Hubbard Model with Equivariant Normalizing Flowscited by 1
- 2025Phase diagram and eigenvalue dynamics of stochastic gradient descent in multilayer neural networkscited by 1
- 2024Stochastic normalizing flows for Effective String Theorycited by 0
- 2025Studying Effective String Theory using deep generative modelscited by 0
- 2026What Neural Network Field Theory Can and Cannot Realise on a Computercited by 0
- 2026Accurate Sampling from Diffusion Modelscited by 0
- 2026Accurate Sampling from Diffusion Models24 Sep 2026
- 2026What Neural Network Field Theory Can and Cannot Realise on a Computer21 Aug 2026
- 2026Toward Scalable Normalizing Flows for the Hubbard Model26 Jan 2026
- 2025Group-Equivariant Diffusion Models for Lattice Field Theory30 Oct 2025
- 2025Scaling flow-based approaches for topology sampling in SU(3) gauge theory29 Oct 2025
- 2025Phase diagram and eigenvalue dynamics of stochastic gradient descent in multilayer neural networks1 Sep 2025
- 2025Studying Effective String Theory using deep generative models28 Aug 2025
- 2025Multilevel Generative Samplers for Investigating Critical Phenomena11 Mar 2025
- 2025Physics-Conditioned Diffusion Models for Lattice Gauge Theory8 Feb 2025
- 2025Simulating the Hubbard Model with Equivariant Normalizing Flows13 Jan 2025
- 2025Physics-Driven Learning for Inverse Problems in Quantum Chromodynamics9 Jan 2025
- 2024Stochastic normalizing flows for Effective String Theory26 Dec 2024
11 more
- 2024Scaling of Stochastic Normalizing Flows in SU(3) lattice gauge theory29 Nov 2024
- 2024On learning higher-order cumulants in diffusion models28 Oct 2024
- 2024Flow-Based Sampling for Entanglement Entropy and the Machine Learning of Defects18 Oct 2024
- 2024Numerical determination of the width and shape of the effective string using Stochastic Normalizing Flows24 Sep 2024
- 2024Bayesian RG Flow in Neural Network Field Theories27 May 2024
- 2024Practical applications of machine-learned flows on gauge fields17 Apr 2024
- 2024Fast and Unified Path Gradient Estimators for Normalizing Flows23 Mar 2024
- 2024Applications of flow models to the generation of correlated lattice QCD ensembles19 Jan 2024
- 2023Generative Diffusion Models for Lattice Field Theory6 Nov 2023
- 2023Equivariant Transformer is all you need20 Oct 2023
- 2023The NFLikelihood: an unsupervised DNNLikelihood from Normalizing Flows18 Sep 2023
- 2023Generative Diffusion Models for Lattice Field Theorycited by 13
- 2024On learning higher-order cumulants in diffusion modelscited by 10
- 2025Physics-Conditioned Diffusion Models for Lattice Gauge Theorycited by 9
- 2025Group-Equivariant Diffusion Models for Lattice Field Theorycited by 3
- 2026Accurate Sampling from Diffusion Modelscited by 0
- 2026Accurate Sampling from Diffusion Models24 Sep 2026
- 2025Group-Equivariant Diffusion Models for Lattice Field Theory30 Oct 2025
- 2025Physics-Conditioned Diffusion Models for Lattice Gauge Theory8 Feb 2025
- 2024On learning higher-order cumulants in diffusion models28 Oct 2024
- 2023Generative Diffusion Models for Lattice Field Theory6 Nov 2023
- 2024Flow-Based Sampling for Entanglement Entropy and the Machine Learning of Defectscited by 13
- 2024Applications of flow models to the generation of correlated lattice QCD ensemblescited by 10
- 2024Scaling of Stochastic Normalizing Flows in SU(3) lattice gauge theorycited by 10
- 2024Bayesian RG Flow in Neural Network Field Theoriescited by 9
- 2025Physics-Driven Learning for Inverse Problems in Quantum Chromodynamicscited by 7
- 2024Practical applications of machine-learned flows on gauge fieldscited by 6
- 2024Numerical determination of the width and shape of the effective string using Stochastic Normalizing Flowscited by 6
- 2025Scaling flow-based approaches for topology sampling in SU(3) gauge theorycited by 6
- 2024Fast and Unified Path Gradient Estimators for Normalizing Flowscited by 5
- 2025Multilevel Generative Samplers for Investigating Critical Phenomenacited by 5
- 2023Equivariant Transformer is all you needcited by 3
- 2023The NFLikelihood: an unsupervised DNNLikelihood from Normalizing Flowscited by 2
12 most cited of 18 All 18 (JSON)
- 2026What Neural Network Field Theory Can and Cannot Realise on a Computer21 Aug 2026
- 2026Toward Scalable Normalizing Flows for the Hubbard Model26 Jan 2026
- 2025Scaling flow-based approaches for topology sampling in SU(3) gauge theory29 Oct 2025
- 2025Phase diagram and eigenvalue dynamics of stochastic gradient descent in multilayer neural networks1 Sep 2025
- 2025Studying Effective String Theory using deep generative models28 Aug 2025
- 2025Multilevel Generative Samplers for Investigating Critical Phenomena11 Mar 2025
- 2025Simulating the Hubbard Model with Equivariant Normalizing Flows13 Jan 2025
- 2025Physics-Driven Learning for Inverse Problems in Quantum Chromodynamics9 Jan 2025
- 2024Stochastic normalizing flows for Effective String Theory26 Dec 2024
- 2024Scaling of Stochastic Normalizing Flows in SU(3) lattice gauge theory29 Nov 2024
- 2024Flow-Based Sampling for Entanglement Entropy and the Machine Learning of Defects18 Oct 2024
- 2024Numerical determination of the width and shape of the effective string using Stochastic Normalizing Flows24 Sep 2024
12 newest of 18 All 18 (JSON)