Turnpike in optimal control of PDEs, ResNets, and beyond
Not on the map. Why?
Abstract (arXiv)
The turnpike property in contemporary macroeconomics asserts that if an economic planner seeks to move an economy from one level of capital to another, then the most efficient path, as long as the planner has enough time, is to rapidly move stock to a level close to the optimal stationary or constant path, then allow for capital to develop along that path until the desired term is nearly reached, at which point the stock ought to be moved to the final target. Motivated in part by its nature as a resource allocation strategy, over the past decade, the turnpike property has also been shown to hold for several classes of partial differential equations arising in mechanics. When formalized mathematically, the turnpike theory corroborates the insights from economics: for an optimal control problem set in a finite-time horizon, optimal controls and corresponding states, are close (often exponentially), during most of the time, except near the initial and final time, to the optimal control and corresponding state for the associated stationary optimal control problem. In particular, the former are mostly constant over time. This fact provides a rigorous meaning to the asymptotic simplification that some optimal control problems appear to enjoy over long time intervals, allowing the consideration of the corresponding stationary problem for computing and applications. We review a slice of the theory developed over the past decade --the controllability of the underlying system is an important ingredient, and can even be used to devise simple turnpike-like strategies which are nearly optimal--, and present several novel applications, including, among many others, the characterization of Hamilton-Jacobi-Bellman asymptotics, and stability estimates in deep learning via residual neural networks.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 33 of its 104 references that are in the map. First posted on arXiv 8 Feb 2022.
Builds on
33 of 104 references.
References · 33
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2017Stable Architectures for Deep Neural Networkscited by 340
- 2017On the Sample Complexity of the Linear Quadratic Regulatorcited by 151
- 2018A Tour of Reinforcement Learning: The View from Continuous Controlcited by 129
- 2017Maximum Principle Based Algorithms for Deep Learningcited by 77
- 2019Deep learning as optimal control problems: models and numerical methodscited by 33
- 2019Selection dynamics for deep neural networkscited by 6
- 2019The mean field Schr"odinger problem: ergodic behavior, entropy estimates and functional inequalitiescited by 5
- 2014The turnpike property in finite-dimensional nonlinear optimal controlcited by 4
- 2021Interpolation and approximation via Momentum ResNets and Neural ODEscited by 4
- 2015On Turnpike and Dissipativity Properties of Continuous-Time Optimal Control Problemscited by 3
- 2018Feedback, Dynamics, and Optimal Control in Climate Economicscited by 3
21 more
- 2020Turnpike in Lipschitz-nonlinear optimal controlcited by 3
- 2016Ensemble controllability by Lie algebraic methodscited by 2
- 2017Integral and measure-turnpike properties for infinite-dimensional optimal control systemscited by 2
- 2020On the Nonuniqueness and Instability of Solutions of Tracking-Type Optimal Control Problemscited by 2
- 2020Abstract nonlinear sensitivity and turnpike analysis and an application to semilinear parabolic PDEscited by 2
- 2013H"older equivalence of the value function for control-affine systemscited by 1
- 2013Complexity of control-affine motion planningcited by 1
- 2014Optimal shape and location of sensors for parabolic equations with random initial datacited by 1
- 2016Greedy controllability of finite dimensional linear systemscited by 1
- 2016The Turnpike Property for Two-Dimensional Navier-Stokes Equationscited by 1
- 2017Optimal shape design for 2D heat equations in large timecited by 1
- 2017Long time behavior of the master equation in mean-field game theorycited by 1
- 2017Controllability under positivity constraints of semilinear heat equationscited by 1
- 2018Phase portrait control for 1D monostable and bistable reaction-diffusion equationscited by 1
- 2018Characterization by observability inequalities of controllability and stabilization propertiescited by 1
- 2019Towards Velocity Turnpikes in Optimal Control of Mechanical Systemscited by 1
- 2019Control under constraints for multi-dimensional reaction-diffusion monostable and bistable equationscited by 1
- 2020A Dissipativity Characterization of Velocity Turnpikes in Optimal Control Problems for Mechanical Systemscited by 1
- 2020The turnpike property in semilinear controlcited by 1
- 2020Pace and motor control optimization for a runnercited by 1
- 2020State-constrained controllability of linear reaction-diffusion systemscited by 1
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 2; 2026: 2.
10 papers.
- 2023A mathematical perspective on Transformerscited by 160
- 2024Data Selection via Optimal Control for Language Modelscited by 38
- 2024Clustering in pure-attention hardmax transformers and its role in sentiment analysiscited by 15
- 2023Cluster-based classification with neural ODEs via controlcited by 4
- 2023From NeurODEs to AutoencODEs: a mean-field control framework for width-varying Neural Networkscited by 3
- 2024Hamiltonian Mechanics of Feature Learning: Bottleneck Structure in Leaky ResNetscited by 1
- 2026Training-Induced Escape from Token Clustering in a Mean-Field Formulation of Transformerscited by 1
- 2025Machine Learning and Control: Foundations, Advances, and Perspectivescited by 0
- 2025Convergence, design and training of continuous-time dropout as a random batch methodcited by 0
- 2026Long-Time Trajectory Approximation via SA-NODEs: Model Predictive and Floquet Strategiescited by 0
- 2026Long-Time Trajectory Approximation via SA-NODEs: Model Predictive and Floquet Strategies11 Aug 2026
- 2026Training-Induced Escape from Token Clustering in a Mean-Field Formulation of Transformers8 May 2026
- 2025Convergence, design and training of continuous-time dropout as a random batch method15 Oct 2025
- 2025Machine Learning and Control: Foundations, Advances, and Perspectives30 Sep 2025
- 2024Data Selection via Optimal Control for Language Models9 Oct 2024
- 2024Clustering in pure-attention hardmax transformers and its role in sentiment analysis26 Jun 2024
- 2024Hamiltonian Mechanics of Feature Learning: Bottleneck Structure in Leaky ResNets27 May 2024
- 2023Cluster-based classification with neural ODEs via control21 Dec 2023
- 2023A mathematical perspective on Transformers17 Dec 2023
- 2023From NeurODEs to AutoencODEs: a mean-field control framework for width-varying Neural Networks5 Jul 2023