Signatured Deep Fictitious Play for Mean Field Games with Common Noise
Not on the map. Why?
Abstract (arXiv)
Existing deep learning methods for solving mean-field games (MFGs) with common noise fix the sampling common noise paths and then solve the corresponding MFGs. This leads to a nested-loop structure with millions of simulations of common noise paths in order to produce accurate solutions, which results in prohibitive computational cost and limits the applications to a large extent. In this paper, based on the rough path theory, we propose a novel single-loop algorithm, named signatured deep fictitious play, by which we can work with the unfixed common noise setup to avoid the nested-loop structure and reduce the computational complexity significantly. The proposed algorithm can accurately capture the effect of common uncertainty changes on mean-field equilibria without further training of neural networks, as previously needed in the existing machine learning algorithms. The efficiency is supported by three applications, including linear-quadratic MFGs, mean-field portfolio game, and mean-field game of optimal consumption and investment. Overall, we provide a new point of view from the rough path theory to solve MFGs with common noise with significantly improved efficiency and an extensive range of applications. In addition, we report the first deep learning work to deal with extended MFGs (a mean-field interaction via both the states and controls) with common noise.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 27 of its 56 references that are in the map. First posted on arXiv 6 Jun 2021.
Builds on
27 of 56 references.
References · 27
- 2019A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problemscited by 97
- 2016Kernels for sequentially ordered datacited by 84
- 2019Deep Signature Transformscited by 75
- 2020Fictitious Play for Mean Field Games: Continuous Time Analysis and Applicationscited by 62
- 2018Signature moments to characterize laws of stochastic processescited by 56
- 2016Deep Learning Approximation for Stochastic Control Problemscited by 55
- 2020Unified Reinforcement Q-Learning for Mean Field Game and Control Problemscited by 49
- 2019On the Convergence of Model Free Learning in Mean Field Gamescited by 48
- 2020Signatory: differentiable computations of the signature and logsignature transforms, on both CPU and GPUcited by 46
- 2015Learning in Mean Field Games: the Fictitious Playcited by 38
- 2019Convergence Analysis of Machine Learning Algorithms for the Numerical Solution of Mean Field Control and Games: II -- The Finite Horizon Casecited by 34
- 2016Mean Field Game of Controls and An Application To Trade Crowdingcited by 23
15 more
- 2019Deep Fictitious Play for Finding Markovian Nash Equilibrium in Multi-Agent Gamescited by 16
- 2019Deep Fictitious Play for Stochastic Differential Gamescited by 13
- 2020Convergence of Deep Fictitious Play for Stochastic Differential Gamescited by 10
- 2013Efficiency of the Price Formation Process in Presence of High Frequency Participants: a Mean Field Game analysiscited by 6
- 2016Linear Quadratic Mean Field Type Control and Mean Field Games with Common Noise, with Application to Production of an Exhaustible Resourcecited by 6
- 2020Optimal Policies for a Pandemic: A Stochastic Game Approach and a Deep Learning Algorithmcited by 6
- 2019Reinforcement Learning for Mean Field Gamecited by 5
- 2020Contact rate epidemic control of COVID-19: an equilibrium viewcited by 5
- 2014The Master Equation in Mean Field Theorycited by 4
- 2019Many-player games of optimal consumption and investment under relative performance criteriacited by 3
- 2020Convolutional Signature for Sequential Datacited by 3
- 2021N-player and Mean-field Games in Ito-diffusion Markets with Competitive or Homophilous Interactioncited by 3
- 2014Wellposedness of Mean Field Games with Common Noise Under a Weak Monotonicity Conditioncited by 1
- 2014Translation invariant mean field games with common noisecited by 1
- 2016Stable solutions in potential mean field game systemscited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 5; 2024: 2; 2025: 0; 2026: 2.
12 papers.
- 2023Recent Developments in Machine Learning Methods for Stochastic Control and Gamescited by 24
- 2023Global universal approximation of functional input maps on weighted spacescited by 19
- 2021Reinforcement Learning for Mean Field Games, with Applications to Economicscited by 15
- 2022Learning High-Dimensional McKean-Vlasov Forward-Backward Stochastic Differential Equations with General Distribution Dependencecited by 13
- 2023A Policy Gradient Framework for Stochastic Optimal Control Problems with Global Convergence Guaranteecited by 10
- 2026Generative models for decision-making under distributional shiftcited by 4
- 2022Deep Learning for Systemic Risk Measurescited by 3
- 2024Learning Mean Field Games on Sparse Graphs: A Hybrid Graphex Approachcited by 3
- 2024Global Solutions to Master Equations for Continuous Time Heterogeneous Agent Macroeconomic Modelscited by 2
- 2026Operator Learning for Families of Finite-State Mean-Field Gamescited by 2
- 2023Multivariate Systemic Risk Measures and Computation by Deep Learning Algorithmscited by 1
- 2023Directed Chain Generative Adversarial Networkscited by 0
- 2026Generative models for decision-making under distributional shift6 Apr 2026
- 2026Operator Learning for Families of Finite-State Mean-Field Games13 Feb 2026
- 2024Global Solutions to Master Equations for Continuous Time Heterogeneous Agent Macroeconomic Models19 Jun 2024
- 2024Learning Mean Field Games on Sparse Graphs: A Hybrid Graphex Approach23 Jan 2024
- 2023Global universal approximation of functional input maps on weighted spaces5 Jun 2023
- 2023Directed Chain Generative Adversarial Networks25 Apr 2023
- 2023Recent Developments in Machine Learning Methods for Stochastic Control and Games17 Mar 2023
- 2023A Policy Gradient Framework for Stochastic Optimal Control Problems with Global Convergence Guarantee11 Feb 2023
- 2023Multivariate Systemic Risk Measures and Computation by Deep Learning Algorithms2 Feb 2023
- 2022Deep Learning for Systemic Risk Measures2 Jul 2022
- 2022Learning High-Dimensional McKean-Vlasov Forward-Backward Stochastic Differential Equations with General Distribution Dependence25 Apr 2022
- 2021Reinforcement Learning for Mean Field Games, with Applications to Economics25 Jun 2021