A Schr"odinger Eigenfunction Method for Long-Horizon Stochastic Optimal Control
Not on the map. Why?
Abstract (arXiv)
High-dimensional stochastic optimal control (SOC) becomes harder with longer planning horizons: existing methods scale linearly in the horizon T, with performance often deteriorating exponentially. We overcome these limitations for a subclass of linearly-solvable SOC problems-those whose uncontrolled drift is the gradient of a potential. In this setting, the Hamilton-Jacobi-Bellman equation reduces to a linear PDE governed by an operator L. We prove that, under the gradient drift assumption, L is unitarily equivalent to a Schr"odinger operator S = -Delta + V with purely discrete spectrum, allowing the long-horizon control to be efficiently described via the eigensystem of L. This connection provides two key results: first, for a symmetric linear-quadratic regulator (LQR), S matches the Hamiltonian of a quantum harmonic oscillator, whose closed-form eigensystem yields an analytic solution to the symmetric LQR with arbitrary terminal cost. Second, in a more general setting, we learn the eigensystem of L using neural networks. We identify implicit reweighting issues with existing eigenfunction learning losses that degrade performance in control tasks, and propose a novel loss function to mitigate this. We evaluate our method on several long-horizon benchmarks, achieving an order-of-magnitude improvement in control accuracy compared to state-of-the-art methods, while reducing memory usage and runtime complexity from O(Td) to O(d).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 76 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
27 of 76 references.
References · 27
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 583
- 2017Solving high-dimensional partial differential equations using deep learningcited by 556
- 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 233
- 2018Breaking the Curse of Horizon: Infinite-Horizon Off-Policy Estimationcited by 227
- 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 191
- 2020Solving high-dimensional Hamilton-Jacobi-Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path spacecited by 82
- 2017Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equationscited by 65
- 2018Convergence of the Deep BSDE Method for Coupled FBSDEscited by 43
- 2023The SSL Interplay: Augmentations, Inductive Bias, and Generalizationcited by 40
- 2023Stochastic Optimal Control Matchingcited by 40
- 2022Stochastic Optimal Control for Collective Variable Free Sampling of Molecular Transition Pathscited by 38
15 more
- 2021Interpolating between BSDEs and PINNs: deep learning for elliptic and parabolic boundary value problemscited by 21
- 2022Physics-Informed Neural Networks for Quantum Eigenvalue Problemscited by 18
- 2016High-Dimensional Stochastic Optimal Control using Continuous Tensor Decompositionscited by 13
- 2021Solving eigenvalue PDEs of metastable diffusion processes using artificial neural networkscited by 13
- 2024A Taxonomy of Loss Functions for Stochastic Optimal Controlcited by 13
- 2022Convergence of a robust deep FBSDE method for stochastic controlcited by 12
- 2020Solving stochastic optimal control problem via stochastic maximum principle with deep learning methodcited by 6
- 2023The Galerkin method beats Graph-Based Approaches for Spectral Algorithmscited by 6
- 2016Mean field control hierarchycited by 3
- 2018Schr"odinger Approach to Optimal Control of Large-Size Populationscited by 3
- 2018A mean-field game model for homogeneous flockingcited by 2
- 2023Error Analysis of Option Pricing via Deep PDE Solvers: Empirical Studycited by 2
- 2019On a Mean Field Optimal Control Problemcited by 1
- 2019Space mapping-based Receding Horizon Control for Stochastic Interacting Particle Systems: dogs herding sheepcited by 1
- 2025A Spectral Approach to Optimal Control of the Fokker-Planck Equationcited by 1
Built on by
Not cited yet.