Self-supervised In-context Operator Learning for Stochastic Mean-Field Control
Not on the map. Why?
Abstract (arXiv)
Stochastic mean-field control (MFC) provides a fundamental framework for coordinating large populations of interacting agents under uncertainty, with a wide range of applications. Existing numerical and deep-learning methods solve one MFC problem instance at a time and must be re-optimized whenever the task changes. In this work, we formulate stochastic MFC as an operator-learning problem and develop, to the best of our knowledge, the first mesh-free, self-supervised neural operator for stochastic MFC. The main challenge is that the diffusion term in the controlled Fokker--Planck equation precludes deterministic transport-map representations. We address this challenge by combining the probability-flow ODE with an invertible normalizing-flow-based transformer, which recasts the dynamics as a deterministic continuity equation and enables closed-form score evaluation through the exact inverse and analytical log-determinant of the normalizing flow, with O(d) cost per particle for networks of fixed size. Through transformer-based in-context learning, task prompts, represented by compact distribution parameters or raw particle clouds, condition the transport map, enabling a single pretrained operator to solve unseen tasks in one forward pass. The resulting Normalizing Flow Invertible Solution Transformer (NFIST) is trained end-to-end by minimizing the stochastic control objective directly, requiring no precomputed numerical solutions for training. We further prove the consistency of the proposed operator-learning formulation with task-by-task optimization. Numerical experiments on stochastic optimal control, Schr"odinger bridge, systemic-risk control, and obstacle-avoiding path planning demonstrate effective zero-shot generalization while substantially reducing the computational cost of solving large families of stochastic MFC problems.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 42 of its 58 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
42 of 58 references.
References · 42
- 2017Attention Is All You Needcited by 60,106
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,028
- 2022Flow Matching for Generative Modelingcited by 5,542
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,857
- 2015Variational Inference with Normalizing Flowscited by 2,163
- 2016Density estimation using Real NVPcited by 2,033
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,989
- 2017Deep Setscited by 1,404
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,317
- 2014NICE: Non-linear Independent Components Estimationcited by 1,054
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 925
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 706
30 more
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 676
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 598
- 2019Neural Spline Flowscited by 590
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 582
- 2017Solving high-dimensional partial differential equations using deep learningcited by 550
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 454
- 2018Conditional Neural Processescited by 423
- 2023Flow Matching on General Geometriescited by 262
- 2023Diffusion Schr"odinger Bridge Matchingcited by 151
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 107
- 2014On the relation between optimal transport and Schr"odinger bridges: A stochastic control viewpointcited by 99
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
- 2019A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problemscited by 95
- 2022The Schr"odinger Bridge between Gaussian Measures has a Closed Formcited by 63
- 2022Probability flow solution of the Fokker-Planck equationcited by 46
- 2020Alternating the Population and Control Neural Networks to Solve High-Dimensional Stochastic Mean-Field Gamescited by 35
- 2021Actor-Critic Method for High Dimensional Static Hamilton--Jacobi--Bellman Partial Differential Equations based on Neural Networkscited by 27
- 2023Recent Developments in Machine Learning Methods for Stochastic Control and Gamescited by 19
- 2022Bridging Mean-Field Games and Normalizing Flows with Trajectory Regularizationcited by 17
- 2024Jet: A Modern Transformer-Based Normalizing Flowcited by 12
- 2026In-Context Operator Learning on the Space of Probability Measurescited by 9
- 2024Score-based Neural Ordinary Differential Equations for Computing Mean Field Control Problemscited by 7
- 2024Solving Time-Continuous Stochastic Optimal Control Problems: Algorithm Design and Convergence Analysis of Actor-Critic Flowcited by 6
- 2024A deep learning algorithm for computing mean field control problems via forward-backward score dynamicscited by 5
- 2021A Fast Proximal Gradient Method and Convergence Analysis for Dynamic Mean Field Planningcited by 4
- 2025Variational conditional normalizing flows for computing second-order mean field control problemscited by 3
- 2025Simulating Fokker-Planck equations via mean field control of score-based normalizing flowscited by 3
- 2025Simultaneously Solving Infinitely Many LQ Mean Field Games In Hilbert Spaces: The Power of Neural Operatorscited by 3
- 2025High-dimensional Mean-Field Games by Particle-based Flow Matchingcited by 3
- 2026Operator Learning for Families of Finite-State Mean-Field Gamescited by 2
Built on by
Not cited yet.