Deep Learning Approximation for Stochastic Control Problems
Not on the map. Why?
Abstract (arXiv)
Many real world stochastic control problems suffer from the "curse of dimensionality". To overcome this difficulty, we develop a deep learning approach that directly solves high-dimensional stochastic control problems based on Monte-Carlo sampling. We approximate the time-dependent controls as feedforward neural networks and stack these networks together through model dynamics. The objective function for the control problem plays the role of the loss function for the deep neural network. We test this approach using examples from the areas of optimal trading and energy storage. Our results suggest that the algorithm presented here achieves satisfactory accuracy and at the same time, can handle rather high dimensional problems.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 14; 2023: 7; 2024: 9; 2025: 9; 2026: 3.
51 papers.
Sort:
By area:
- 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 222
- 2022Finite Expression Method for Solving High-Dimensional Partial Differential Equationscited by 21
- 2021Deep Learning for Mean Field Games and Mean Field Control with Applications to Financecited by 20
- 2023Recent Developments in Machine Learning Methods for Stochastic Control and Gamescited by 19
- 2024Non-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning ratescited by 14
- 2021Signatured Deep Fictitious Play for Mean Field Games with Common Noisecited by 12
- 2022Convergence of a robust deep FBSDE method for stochastic controlcited by 11
- 2021DeepHAM: A Global Solution Method for Heterogeneous Agent Models with Aggregate Shockscited by 10
- 2022Mean-field neural networks-based algorithms for McKean-Vlasov control problems *cited by 9
- 2024Entropy annealing for policy mirror descent in continuous time and spacecited by 9
- 2021Data-Driven Computational Methods for the Domain of Attraction and Zubov's Equationcited by 7
- 2023Data-Driven Merton's Strategies via Policy Randomizationcited by 6
38 more
- 2025Deep Learning for Continuous-Time Stochastic Control with Jumpscited by 6
- 2022An application of the splitting-up method for the computation of a neural network representation for the solution for the filtering equationscited by 5
- 2025A brief review of the Deep BSDE method for solving high-dimensional partial differential equationscited by 5
- 2025Generative Neural Operators of Log-Complexity Can Simultaneously Solve Infinitely Many Convex Programscited by 5
- 2022Temporal Difference Learning with Continuous Time and State in the Stochastic Settingcited by 4
- 2022Linear convergence of a policy gradient method for some finite horizon continuous time control problemscited by 4
- 2025Solving Optimal Execution Problems via In-Context Operator Networkscited by 4
- 2026Discrete Adjoint Schr"odinger Bridge Samplercited by 4
- 2022Offline Supervised Learning V.S. Online Direct Policy Optimization: A Comparative Study and A Unified Training Paradigm for Neural Network-Based Optimal Feedback Controlcited by 3
- 2024Online Control-Informed Learningcited by 3
- 2025Neural Actor-Critic Methods for Hamilton-Jacobi-Bellman PDEs: Asymptotic Analysis and Numerical Studiescited by 3
- 2021Recurrent Neural Networks for Stochastic Control Problems with Delaycited by 2
- 2021Performance of a Markovian neural network versus dynamic programming on a fishing control problemcited by 2
- 2022A deep learning method for solving stochastic optimal control problems driven by fully-coupled FBSDEscited by 2
- 2022Neural Network Optimal Feedback Control with Guaranteed Local Stabilitycited by 2
- 2022Langevin algorithms for Markovian Neural Networks and Deep Stochastic controlcited by 2
- 2023Efficient Pricing and Hedging of High Dimensional American Options Using Recurrent Networkscited by 2
- 2023A Deep Learning Analysis of Climate Change, Innovation, and Uncertaintycited by 2
- 2021Data-informed Deep Optimizationcited by 1
- 2021A novel control method for solving high-dimensional Hamiltonian systems through deep neural networkscited by 1
- 2021Data-driven Hedging of Stock Index Options via Deep Learningcited by 1
- 2022The Parametric Cost Function Approximation: A new approach for multistage stochastic programmingcited by 1
- 2022On Parametric Optimal Execution and Machine Learning Surrogatescited by 1
- 2023Neural Partial Differential Equations with Functional Convolutioncited by 1
- 2023Policy Gradient Optimal Correlation Search for Variance Reduction in Monte Carlo simulation and Maximum Optimal Transportcited by 1
- 2024Solving a class of stochastic optimal control problems by physics-informed neural networkscited by 1
- 2024An Efficient On-Policy Deep Learning Framework for Stochastic Optimal Controlcited by 1
- 2025A deep solver for backward stochastic Volterra integral equationscited by 1
- 2025Finite-Agent Stochastic Differential Games on Large Graphs: II. Graph-Based Architecturescited by 1
- 2022Pandemic Control, Game Theory and Machine Learningcited by 0
- 2022Deep learning for gradient flows using the Brezis-Ekeland principlecited by 0
- 2023Stochastic Delay Differential Games: Financial Modeling and Machine Learning Algorithmscited by 0
- 2024Convergence analysis of controlled particle systems arising in deep learning: from finite to infinite sample sizecited by 0
- 2024Deep Learning Methods for S Shaped Utility Maximisation with a Random Reference Pointcited by 0
- 2024A Machine Learning Algorithm for Finite-Horizon Stochastic Control Problems in Economicscited by 0
- 2025Mean-Field Generalisation Bounds for Learning Controls in Stochastic Environmentscited by 0
- 2025Error Propagation in Dynamic Programming: From Stochastic Control to American Option Pricingcited by 0
- 2026Deep Neural networks for solving high-dimensional parabolic partial differential equationscited by 0
50 most cited of 51 All 51 (JSON)
- 2026Robust Control under Stationary Ambiguity5 Aug 2026
- 2026Discrete Adjoint Schr"odinger Bridge Sampler9 Feb 2026
- 2026Deep Neural networks for solving high-dimensional parabolic partial differential equations19 Jan 2026
- 2025Error Propagation in Dynamic Programming: From Stochastic Control to American Option Pricing24 Sep 2025
- 2025Finite-Agent Stochastic Differential Games on Large Graphs: II. Graph-Based Architectures15 Sep 2025
- 2025Mean-Field Generalisation Bounds for Learning Controls in Stochastic Environments21 Aug 2025
- 2025Generative Neural Operators of Log-Complexity Can Simultaneously Solve Infinitely Many Convex Programs20 Aug 2025
- 2025Neural Actor-Critic Methods for Hamilton-Jacobi-Bellman PDEs: Asymptotic Analysis and Numerical Studies8 Jul 2025
- 2025A deep solver for backward stochastic Volterra integral equations23 May 2025
- 2025Deep Learning for Continuous-Time Stochastic Control with Jumps21 May 2025
- 2025A brief review of the Deep BSDE method for solving high-dimensional partial differential equations7 May 2025
- 2025Solving Optimal Execution Problems via In-Context Operator Networks25 Jan 2025
38 more
- 2024A Machine Learning Algorithm for Finite-Horizon Stochastic Control Problems in Economics13 Nov 2024
- 2024Deep Learning Methods for S Shaped Utility Maximisation with a Random Reference Point7 Oct 2024
- 2024An Efficient On-Policy Deep Learning Framework for Stochastic Optimal Control7 Oct 2024
- 2024Online Control-Informed Learning4 Oct 2024
- 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control13 Sep 2024
- 2024Non-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning rates11 Jul 2024
- 2024Entropy annealing for policy mirror descent in continuous time and space30 May 2024
- 2024Convergence analysis of controlled particle systems arising in deep learning: from finite to infinite sample size8 Apr 2024
- 2024Solving a class of stochastic optimal control problems by physics-informed neural networks23 Feb 2024
- 2023Data-Driven Merton's Strategies via Policy Randomization19 Dec 2023
- 2023A Deep Learning Analysis of Climate Change, Innovation, and Uncertainty19 Oct 2023
- 2023Policy Gradient Optimal Correlation Search for Variance Reduction in Monte Carlo simulation and Maximum Optimal Transport24 Jul 2023
- 2023Stochastic Delay Differential Games: Financial Modeling and Machine Learning Algorithms12 Jul 2023
- 2023Recent Developments in Machine Learning Methods for Stochastic Control and Games17 Mar 2023
- 2023Neural Partial Differential Equations with Functional Convolution10 Mar 2023
- 2023Efficient Pricing and Hedging of High Dimensional American Options Using Recurrent Networks19 Jan 2023
- 2022Langevin algorithms for Markovian Neural Networks and Deep Stochastic control22 Dec 2022
- 2022Mean-field neural networks-based algorithms for McKean-Vlasov control problems *22 Dec 2022
- 2022Offline Supervised Learning V.S. Online Direct Policy Optimization: A Comparative Study and A Unified Training Paradigm for Neural Network-Based Optimal Feedback Control29 Nov 2022
- 2022Deep learning for gradient flows using the Brezis-Ekeland principle28 Sep 2022
- 2022Pandemic Control, Game Theory and Machine Learning18 Aug 2022
- 2022Finite Expression Method for Solving High-Dimensional Partial Differential Equations21 Jun 2022
- 2022Neural Network Optimal Feedback Control with Guaranteed Local Stability1 May 2022
- 2022On Parametric Optimal Execution and Machine Learning Surrogates18 Apr 2022
- 2022A deep learning method for solving stochastic optimal control problems driven by fully-coupled FBSDEs12 Apr 2022
- 2022Linear convergence of a policy gradient method for some finite horizon continuous time control problems22 Mar 2022
- 2022Temporal Difference Learning with Continuous Time and State in the Stochastic Setting16 Feb 2022
- 2022Convergence of a robust deep FBSDE method for stochastic control18 Jan 2022
- 2022An application of the splitting-up method for the computation of a neural network representation for the solution for the filtering equations10 Jan 2022
- 2022The Parametric Cost Function Approximation: A new approach for multistage stochastic programming1 Jan 2022
- 2021Data-Driven Computational Methods for the Domain of Attraction and Zubov's Equation29 Dec 2021
- 2021DeepHAM: A Global Solution Method for Heterogeneous Agent Models with Aggregate Shocks29 Dec 2021
- 2021Data-driven Hedging of Stock Index Options via Deep Learning5 Nov 2021
- 2021A novel control method for solving high-dimensional Hamiltonian systems through deep neural networks4 Nov 2021
- 2021Performance of a Markovian neural network versus dynamic programming on a fishing control problem14 Sep 2021
- 2021Data-informed Deep Optimization17 Jul 2021
- 2021Deep Learning for Mean Field Games and Mean Field Control with Applications to Finance9 Jul 2021
- 2021Signatured Deep Fictitious Play for Mean Field Games with Common Noise6 Jun 2021
50 newest of 51 All 51 (JSON)
- 2022Finite Expression Method for Solving High-Dimensional Partial Differential Equationscited by 21
- 2021Deep Learning for Mean Field Games and Mean Field Control with Applications to Financecited by 20
- 2023Recent Developments in Machine Learning Methods for Stochastic Control and Gamescited by 19
- 2024Non-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning ratescited by 14
- 2021Signatured Deep Fictitious Play for Mean Field Games with Common Noisecited by 12
- 2022Convergence of a robust deep FBSDE method for stochastic controlcited by 11
- 2021DeepHAM: A Global Solution Method for Heterogeneous Agent Models with Aggregate Shockscited by 10
- 2022Mean-field neural networks-based algorithms for McKean-Vlasov control problems *cited by 9
- 2024Entropy annealing for policy mirror descent in continuous time and spacecited by 9
- 2021Data-Driven Computational Methods for the Domain of Attraction and Zubov's Equationcited by 7
- 2023Data-Driven Merton's Strategies via Policy Randomizationcited by 6
- 2025Deep Learning for Continuous-Time Stochastic Control with Jumpscited by 6
12 most cited of 50 All 50 (JSON)
- 2026Robust Control under Stationary Ambiguity5 Aug 2026
- 2026Discrete Adjoint Schr"odinger Bridge Sampler9 Feb 2026
- 2026Deep Neural networks for solving high-dimensional parabolic partial differential equations19 Jan 2026
- 2025Error Propagation in Dynamic Programming: From Stochastic Control to American Option Pricing24 Sep 2025
- 2025Finite-Agent Stochastic Differential Games on Large Graphs: II. Graph-Based Architectures15 Sep 2025
- 2025Mean-Field Generalisation Bounds for Learning Controls in Stochastic Environments21 Aug 2025
- 2025Generative Neural Operators of Log-Complexity Can Simultaneously Solve Infinitely Many Convex Programs20 Aug 2025
- 2025Neural Actor-Critic Methods for Hamilton-Jacobi-Bellman PDEs: Asymptotic Analysis and Numerical Studies8 Jul 2025
- 2025A deep solver for backward stochastic Volterra integral equations23 May 2025
- 2025Deep Learning for Continuous-Time Stochastic Control with Jumps21 May 2025
- 2025A brief review of the Deep BSDE method for solving high-dimensional partial differential equations7 May 2025
- 2025Solving Optimal Execution Problems via In-Context Operator Networks25 Jan 2025
12 newest of 50 All 50 (JSON)