Wavelet Conditional Renormalization Group
Not on the map. Why?
Abstract (arXiv)
We develop a multiscale approach to estimate high-dimensional probability distributions from a dataset of physical fields or configurations observed in experiments or simulations. In this way we can estimate energy functions (or Hamiltonians) and efficiently generate new samples of many-body systems in various domains, from statistical physics to cosmology. Our method -- the Wavelet Conditional Renormalization Group (WC-RG) -- proceeds scale by scale, estimating models for the conditional probabilities of "fast degrees of freedom" conditioned by coarse-grained fields. These probability distributions are modeled by energy functions associated with scale interactions, and are represented in an orthogonal wavelet basis. WC-RG decomposes the microscopic energy function as a sum of interaction energies at all scales and can efficiently generate new samples by going from coarse to fine scales. Near phase transitions, it avoids the "critical slowing down" of direct estimation and sampling algorithms. This is explained theoretically by combining results from RG and wavelet theories, and verified numerically for the Gaussian and varphi4 field theories. We show that multiscale WC-RG energy-based models are more general than local potential models and can capture the physics of complex many-body interacting systems at all length scales. This is demonstrated for weak-gravitational-lensing fields reflecting dark matter distributions in cosmology, which include long-range interactions with long-tail probability distributions. WC-RG has a large number of potential applications in non-equilibrium systems, where the underlying distribution is not known it a priori. Finally, we discuss the connection between WC-RG and deep network architectures.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 13 of its 93 references that are in the map. First posted on arXiv 11 Jul 2022.
Builds on
13 of 93 references.
References · 13
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2021The Principles of Deep Learning Theorycited by 169
- 2016Why does deep and cheap learning work so well?cited by 100
- 2016Understanding Deep Convolutional Networkscited by 76
- 2014An exact mapping between the Variational Renormalization Group and Deep Learningcited by 52
- 2018Neural Network Renormalization Groupcited by 48
- 2021Efficient Bayesian Sampling Using Normalizing Flows to Assist Markov Chain Monte Carlo Methodscited by 15
- 2018Scale-invariant Feature Extraction of Neural Network and Renormalization Group Flowcited by 14
- 2018Multiscale Sparse Microcanonical Modelscited by 13
- 2019Maximum Entropy Models from Phase Harmonic Covariancescited by 13
- 2018Non-Gaussian information from weak lensing data via deep learningcited by 11
- 2019Cosmological N-body simulations: a challenge for scalable generative modelscited by 11
1 more
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 3; 2025: 4.
11 papers.
- 2022Wavelet Score-Based Generative Modelingcited by 61
- 2025How Compositional Generalization and Creativity Improve as Diffusion Models are Trainedcited by 24
- 2023Learning multi-scale local conditional probability models of imagescited by 21
- 2023MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimationcited by 5
- 2025Performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics modelscited by 5
- 2024WhaleNet: a Novel Deep Learning Architecture for Marine Mammals Vocalizations on Watkins Marine Mammal Sound Databasecited by 3
- 2024Hierarchic Flows to Estimate and Sample High-dimensional Probabilitiescited by 3
- 2025Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimizationcited by 3
- 2023Conditionally Strongly Log-Concave Generative Modelscited by 2
- 2024Hamiltonian bridge: A physics-driven generative framework for targeted pattern controlcited by 1
- 2025Symmetry and Generalisation in Neural Approximations of Renormalisation Transformationscited by 0
- 2025Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimization22 Oct 2025
- 2025Symmetry and Generalisation in Neural Approximations of Renormalisation Transformations18 Oct 2025
- 2025Performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models28 May 2025
- 2025How Compositional Generalization and Creativity Improve as Diffusion Models are Trained17 Feb 2025
- 2024Hamiltonian bridge: A physics-driven generative framework for targeted pattern control16 Oct 2024
- 2024Hierarchic Flows to Estimate and Sample High-dimensional Probabilities6 May 2024
- 2024WhaleNet: a Novel Deep Learning Architecture for Marine Mammals Vocalizations on Watkins Marine Mammal Sound Database20 Feb 2024
- 2023MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation7 Jun 2023
- 2023Conditionally Strongly Log-Concave Generative Models31 May 2023
- 2023Learning multi-scale local conditional probability models of images6 Mar 2023
- 2022Wavelet Score-Based Generative Modeling9 Aug 2022