# Martingale deep neural network for very high-dimensional stochastic optimal controls

arXiv: https://arxiv.org/abs/2408.14395 · HTML: https://mlsanity.com/paper/2408.14395/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Aug 2024.

## Built on by (most cited first, 2 of 2)

- [Deep Neural networks for solving high-dimensional parabolic partial differential equations](https://mlsanity.com/paper/2601.13256/) (2026)
- [An Actor-Critic Framework for Continuous-Time Jump-Diffusion Controls with Normalizing Flows](https://mlsanity.com/paper/2604.05398/) (2026)

## Abstract (arXiv)

We propose a martingale deep learning method for very high-dimensional stochastic optimal control problems (SOCPs) via their associated Hamilton--Jacobi--Bellman equations and the verification theory for the optimal control. The method decomposes the problem into two coupled components: a martingale formulation for the value function and an integral optimality condition for the feedback control. For the value function, we extend DeepMartNet by introducing a pilot process for state-space exploration and system processes for martingale property enforcement.This yields a derivative-free formulation that avoids computing PDE solution's derivatives and online simulations of full trajectories, while enabling parallel loss evaluation in both time and space. Also, the martingale condition is imposed in a weak Galerkin form realized with adversarial learning, which avoids direct computation of conditional expectations. The control is learned by minimizing an integral residual of the optimality condition over the explored state space, thereby avoiding state-space point-wise optimization over the control set. Numerical results demonstrate accurate and efficient performance for SOCPs with complex patterns in value function and controls in dimensions up to 10,000.