A blob method for inhomogeneous diffusion with applications to multi-agent control and sampling
Not on the map. Why?
Abstract (arXiv)
As a counterpoint to classical stochastic particle methods for linear diffusion equations, we develop a deterministic particle method for the weighted porous medium equation (WPME) and prove its convergence on bounded time intervals. This generalizes related work on blob methods for unweighted porous medium equations. From a numerical analysis perspective, our method has several advantages: it is meshfree, preserves the gradient flow structure of the underlying PDE, converges in arbitrary dimension, and captures the correct asymptotic behavior in simulations. That our method succeeds in capturing the long time behavior of WPME is significant from the perspective of related problems in quantization. Just as the Fokker-Planck equation provides a way to quantize a probability measure barρ by evolving an empirical measure according to stochastic Langevin dynamics so that the empirical measure flows toward barρ, our particle method provides a way to quantize barρ according to deterministic particle dynamics approximating WMPE. In this way, our method has natural applications to multi-agent coverage algorithms and sampling probability measures. A specific case of our method corresponds exactly to confined mean-field dynamics of training a two-layer neural network for a radial basis function activation function. From this perspective, our convergence result shows that, in the overparametrized regime and as the variance of the radial basis functions goes to zero, the continuum limit is given by WPME. This generalizes previous results, which considered the case of a uniform data distribution, to the more general inhomogeneous setting. As a consequence of our convergence result, we identify conditions on the target function and data distribution for which convexity of the energy landscape emerges in the continuum limit.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 18 of its 86 references that are in the map. First posted on arXiv 25 Feb 2022.
Builds on
18 of 86 references.
References · 18
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
- 2018A Mean Field View of the Landscape of Two-Layers Neural Networkscited by 463
- 2018On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transportcited by 422
- 2017Stein Variational Gradient Descent as Gradient Flowcited by 149
- 2018Trainability and Accuracy of Neural Networks: An Interacting Particle System Approachcited by 105
- 2020SVGD as a kernelized Wasserstein gradient flow of the chi-squared divergencecited by 64
- 2020A Non-Asymptotic Analysis for Stein Variational Gradient Descentcited by 61
- 2019Machine Learning from a Continuous Viewpointcited by 50
- 2020On the Convergence of Gradient Descent Training for Two-layer ReLU-networks in the Mean Field Regimecited by 38
- 2018Scaling limit of the Stein variational gradient descent: the mean field regimecited by 35
- 2019Analysis of a Two-Layer Neural Network via Displacement Convexitycited by 27
- 2021An Introduction to Hamiltonian Monte Carlo Method for Samplingcited by 8
6 more
- 2017Velocity Field Generation for Density Control of Swarms using Heat Equation and Smoothing Kernelscited by 5
- 2016Coverage and Field Estimation on Bounded Domains by Diffusive Swarmscited by 1
- 2017A gradient flow perspective on the quantization problemcited by 1
- 2018Quantitative Assessment of Robotic Swarm Coveragecited by 1
- 2019Quantifying Robotic Swarm Coveragecited by 1
- 2020Asymptotic optimality of the triangular lattice for a class of optimal location problemscited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 4; 2025: 0; 2026: 1.
6 papers.
- 2022Variational inference via Wasserstein gradient flowscited by 84
- 2024Theoretical Guarantees for Variational Inference with Fixed-Variance Mixture of Gaussianscited by 11
- 2024Interaction-Force Transport Gradient Flowscited by 7
- 2024Kernel Approximation of Fisher-Rao Gradient Flowscited by 7
- 2024Inclusive KL Gradient Flows: Otto-Wasserstein, Fisher-Rao-Gaussian, and Local-Estimator Dynamicscited by 4
- 2026Variational Inference via Entropic Transport Descentcited by 0
- 2026Variational Inference via Entropic Transport Descent24 Jun 2026
- 2024Inclusive KL Gradient Flows: Otto-Wasserstein, Fisher-Rao-Gaussian, and Local-Estimator Dynamics31 Oct 2024
- 2024Kernel Approximation of Fisher-Rao Gradient Flows27 Oct 2024
- 2024Theoretical Guarantees for Variational Inference with Fixed-Variance Mixture of Gaussians6 Jun 2024
- 2024Interaction-Force Transport Gradient Flows27 May 2024
- 2022Variational inference via Wasserstein gradient flows31 May 2022