Convergence of the Deep Galerkin Method for Finite State Mean Field Control Problems
Not on the map. Why?
Abstract (arXiv)
We establish the convergence of the deep Galerkin method (DGM), a deep learning-based scheme for solving high-dimensional nonlinear PDEs, for Hamilton-Jacobi-Bellman (HJB) equations that arise from the study of mean field control problems (MFCPs). Based on a recent characterization of the value function of the MFCP as the unique viscosity solution of an HJB equation on the simplex, we establish both an existence and convergence result for the DGM. First, we show that the loss functional of the DGM can be made arbitrarily small given that the value function of the MFCP possesses sufficient regularity. Then, we show that if the loss functional of the DGM converges to zero, the corresponding neural network approximators must converge uniformly to the true value function on the simplex. We also provide numerical experiments demonstrating the DGM's ability to generalize to high-dimensional HJB equations.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 58 references that are in the map. First posted on arXiv 22 May 2024.
Builds on
20 of 58 references.
References · 20
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
- 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 191
- 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 113
- 2019A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problemscited by 97
- 2021On the approximation of functions by tanh neural networkscited by 81
- 2019Convergence Analysis of Machine Learning Algorithms for the Numerical Solution of Mean Field Control and Games: II -- The Finite Horizon Casecited by 34
- 2016Minimizing the Maximal Loss: How and Why?cited by 30
- 2021Actor-Critic Method for High Dimensional Static Hamilton--Jacobi--Bellman Partial Differential Equations based on Neural Networkscited by 29
- 2022Simultaneous approximation of a smooth function and its derivatives by deep neural networks with piecewise-polynomial activationscited by 29
- 2019Deep Learning Methods for Mean Field Control Problems with Delaycited by 25
- 2019Mean-field Markov decision processes with common noise and open-loop controlscited by 25
- 2021Deep Learning for Mean Field Games and Mean Field Control with Applications to Financecited by 20
8 more
- 2016Dynamic programming for optimal control of stochastic McKean-Vlasov dynamicscited by 12
- 2016Limit theory for controlled McKean-Vlasov dynamicscited by 12
- 2015Bellman equation and viscosity solutions for mean-field stochastic control problemcited by 11
- 2023Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equationscited by 10
- 2023Partially Observable Mean Field Multi-Agent Reinforcement Learning Based on Graph-Attentioncited by 7
- 2024Deep Backward and Galerkin Methods for the Finite State Master Equationcited by 6
- 2016Incentivizing Sharing in Realtime D2D Streaming Networks: A Mean Field Game Perspectivecited by 1
- 2020Finite state N-agent and mean field control problemscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.