mlsanityData to 14 Oct 2026

Monotone Neural Policy Iteration for High-Dimensional First-Order Hamilton--Jacobi--Bellman Equations

arXiv 2605.07116 ↗First posted 8 May 2026cs.LG cs.AI cs.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

We analyze a neural semi-discrete method for high-dimensional first-order Hamilton-Jacobi-Bellman (HJB) equations with known or learned dynamics. Centered differences and an artificial viscosity Nh=O(h) define a monotone operator evaluated through 2d+1 shifted network queries; policy iteration solves the resulting Bellman equation without a tensor grid. At fixed h, the sharp componentwise condition maxi|fi|≤2N turns every frozen-policy operator into a nearest-neighbor Markov-chain generator with a policy-independent total jump rate. Uniformization gives whole-space well-posedness for measurable feedbacks, an explicit Poisson-tail bound on the numerical domain of dependence, and boundary-free localization. The representation also yields a posteriori policy-evaluation bounds that account for residual and learned-model errors. A greedy-gap analysis controls inexact policy iteration at fixed h; a separate consistency estimate connects the semi-discrete equation to the continuous HJB equation. Experiments reproduce the extremal tail, show rates consistent with O(√ h) and nearly h-independent exact-policy-iteration decay, and assess empirical estimator effectivity. A nonsmooth example shows that the continuous residual can miss a non-viscosity solution, whereas the shifted residual detects the defect. Further tests provide a structured interval-verified certificate calibration, an early-budget benefit of policy freezing for bang-bang control, and learned-dynamics diagnostics. A structured nonlinear problem with active compact-control constraints is tested against a manufactured semi-discrete reference through d=1024.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 28 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

14 of 28 references.

References · 14

  1. 2017Solving high-dimensional partial differential equations using deep learningcited by 556
  2. 2019Adaptive Deep Learning for High-Dimensional Hamilton-Jacobi-Bellman Equationscited by 40
  3. 2016Algorithms for Overcoming the Curse of Dimensionality for Certain Hamilton-Jacobi Equations Arising in Control Theory and Elsewherecited by 24
  4. 2019Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architecturescited by 22
  5. 2024Physics-Informed Neural Network Policy Iteration: Algorithms, Convergence, and Verificationcited by 13
  6. 2024Policy Iteration for Exploratory Hamilton--Jacobi--Bellman Equationscited by 12
  7. 2017Algorithm for Overcoming the Curse of Dimensionality for State-dependent Hamilton-Jacobi equationscited by 7
  8. 2023Policy iteration for the deterministic control problems -- a viscosity approachcited by 7
  9. 2024Hamilton-Jacobi Based Policy-Iteration via Deep Operator Learningcited by 5
  10. 2024Finite-difference least square methods for solving Hamilton-Jacobi equations using neural networkscited by 4
  11. 2025Policy iteration for nonconvex viscous Hamilton--Jacobi equationscited by 2
  12. 2025Solving nonconvex Hamilton--Jacobi--Isaacs equations with PINN-based policy iterationcited by 1
2 more
  1. 2025Physics-Informed Policy Iteration for High-Dimensional Hamilton--Jacobi--Bellman Equations: Interior Error Bounds without Boundary Datacited by 1
  2. 2026Solving Hamilton-Jacobi equations by residual minimization of monotone finite-difference discretizationscited by 1

Built on by

Not cited yet.