mlsanityData to 14 Oct 2026

Neural Operators of Backstepping Controller and Observer Gain Functions for Reaction-Diffusion PDEs

arXiv 2303.10506 ↗First posted 18 Mar 2023eess.SY cs.LG cs.SYcited by 18

Not on the map. Why?

Abstract (arXiv)

Unlike ODEs, whose models involve system matrices and whose controllers involve vector or matrix gains, PDE models involve functions in those roles functional coefficients, dependent on the spatial variables, and gain functions dependent on space as well. The designs of gains for controllers and observers for PDEs, such as PDE backstepping, are mappings of system model functions into gain functions. These infinite dimensional nonlinear operators are given in an implicit form through PDEs, in spatial variables, which need to be solved to determine the gain function for each new functional coefficient of the PDE. The need for solving such PDEs can be eliminated by learning and approximating the said design mapping in the form of a neural operator. Learning the neural operator requires a sufficient number of prior solutions for the design PDEs, offline, as well as the training of the operator. In recent work, we developed the neural operators for PDE backstepping designs for first order hyperbolic PDEs. Here we extend this framework to the more complex class of parabolic PDEs. The key theoretical question is whether the controllers are still stabilizing, and whether the observers are still convergent, if they employ the approximate functional gains generated by the neural operator. We provide affirmative answers to these questions, namely, we prove stability in closed loop under gains produced by neural operators. We illustrate the theoretical results with numerical tests and publish our code on github. The neural operators are three orders of magnitude faster in generating gain functions than PDE solvers for such gain functions. This opens up the opportunity for the use of this neural operator methodology in adaptive control and in gain scheduling control for nonlinear PDEs.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 54 of its 111 references that are in the map. First posted on arXiv 18 Mar 2023.

Builds on

54 of 111 references.

References · 54

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  3. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  4. 2017Solving high-dimensional partial differential equations using deep learningcited by 556
  5. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
  6. 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 366
  7. 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 297
  8. 2018Global Convergence of Policy Gradient Methods for the Linear Quadratic Regulatorcited by 250
  9. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  10. 2022Safe Control with Learned Certificates: A Survey of Neural Lyapunov, Barrier, and Contraction methodscited by 151
  11. 2020Neural Lyapunov Controlcited by 142
  12. 2020Model-Based Multi-Agent RL in Zero-Sum Markov Games with Near-Optimal Sample Complexitycited by 92
38 more
  1. 2020Information Theoretic Regret Bounds for Online Nonlinear Controlcited by 90
  2. 2022Learning Operators with Coupled Attentioncited by 90
  3. 2018Regret Bounds for Robust Adaptive Control of the Linear Quadratic Regulatorcited by 86
  4. 2022NOMAD: Nonlinear Manifold Decoders for Operator Learningcited by 83
  5. 2018On Gradient-Based Learning in Continuous Gamescited by 48
  6. 2019Convergence and sample complexity of gradient methods for the model-free linear quadratic regulator problemcited by 46
  7. 2020Learning Stability Certificates from Datacited by 45
  8. 2020Black-Box Control for Linear Dynamical Systemscited by 43
  9. 2019Policy Optimization Provably Converges to Nash Equilibria in Zero-Sum Linear Quadratic Gamescited by 42
  10. 2021Provably Efficient Reinforcement Learning in Decentralized General-Sum Markov Gamescited by 42
  11. 2016Learning Model Predictive Control for iterative tasks. A Data-Driven Control Frameworkcited by 39
  12. 2019Learning Stabilizable Nonlinear Dynamics with Contraction-Based Regularizationcited by 32
  13. 2023Neural Operators for Bypassing Gain and Control Computations in PDE Backsteppingcited by 29
  14. 2021Analysis of the Optimization Landscape of Linear Quadratic Gaussian (LQG) Controlcited by 28
  15. 2020Learning Lyapunov Functions for Hybrid Systemscited by 24
  16. 2022TaSIL: Taylor Series Imitation Learningcited by 21
  17. 2020Reinforcement Learning with Fast Stabilization in Linear Dynamical Systemscited by 20
  18. 2021Global Convergence of Policy Gradient Primal-dual Methods for Risk-constrained LQRscited by 16
  19. 2020Robust Policy Iteration for Continuous-time Linear Quadratic Regulationcited by 15
  20. 2021Stability Constrained Reinforcement Learning for Real-Time Voltage Controlcited by 15
  21. 2021Separation of Learning and Control for Cyber-Physical Systemscited by 10
  22. 2020Combining Prior Knowledge and Data for Robust Controller Designcited by 9
  23. 2020Learning Lyapunov Functions for Piecewise Affine Systems with Neural Network Controllerscited by 7
  24. 2022Machine Learning Accelerated PDE Backstepping Observerscited by 7
  25. 2022Towards a Theoretical Foundation of Policy Optimization for Learning Control Policiescited by 6
  26. 2022KCRL: Krasovskii-Constrained Reinforcement Learning with Guaranteed Stability in Nonlinear Dynamical Systemscited by 5
  27. 2022Meta-Learning Online Control for Linear Dynamical Systemscited by 5
  28. 2019A Control Lyapunov Perspective on Episodic Learning via Projection to State Stabilitycited by 4
  29. 2015Control of Homodirectional and General Heterodirectional Linear Coupled Hyperbolic PDEscited by 3
  30. 2016Boundary Control of Coupled Reaction-Advection-Diffusion Systems with Spatially-Varying Coefficientscited by 3
  31. 2017Control and State Estimation of the One-Phase Stefan Problem via Backstepping Designcited by 3
  32. 2018Adaptive Boundary Control of Constant-Parameter Reaction-Diffusion PDEs Using Regulation-Triggered Finite-Time Identificationcited by 3
  33. 2019Delay-Compensated Control of Sandwiched ODE-PDE-ODE Hyperbolic Systems for Oil Drilling and Disaster Reliefcited by 3
  34. 2022Learning Controllers from Data via Approximate Nonlinearity Cancellationcited by 3
  35. 2019Output-Feedback Boundary Control of a Heat PDE Sandwiched Between Two ODEscited by 2
  36. 2020Event-triggered gain scheduling of reaction-diffusion PDEscited by 2
  37. 2021Finite-dimensional output stabilization for a class of linear distributed parameter systems -- a small-gain approachcited by 2
  38. 2017Sampled-Data Boundary Feedback Control of 1-D Parabolic PDEscited by 1

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 6; 2025: 5; 2026: 3.

18 papers.

Sort:

By area:

  1. 2023Neural Operators for PDE Backstepping Control of First-Order Hyperbolic PIDE with Recycle and Delaycited by 13
  2. 2024PDE Control Gym: A Benchmark for Data-Driven Boundary Control of Partial Differential Equationscited by 10
  3. 2024Gain Scheduling with a Neural Operator for a Transport PDE with Nonlinear Recirculationcited by 9
  4. 2023Deep Learning of Delay-Compensated Backstepping for Reaction-Diffusion PDEscited by 8
  5. 2024Adaptive Neural-Operator Backstepping Control of a Benchmark Hyperbolic PDEcited by 8
  6. 2023Neural Operators for Boundary Stabilization of Stop-and-go Trafficcited by 7
  7. 2024Adaptive control of reaction-diffusion PDEs via neural operator-approximated gain kernelscited by 5
  8. 2023Backstepping Neural Operators for 2× 2 Hyperbolic PDEscited by 4
  9. 2025Deep Operator Neural Network Model Predictive Controlcited by 3
  10. 2025Delay compensation of multi-input distinct delay nonlinear systems via neural operatorscited by 2
  11. 2025Stabilization of nonlinear systems with unknown delays via delay-adaptive neural operator approximate predictorscited by 2
  12. 2026Topological DeepONets and a generalization of the Chen-Chen operator approximation theoremcited by 2
6 more
  1. 2024Safe PDE Boundary Control with Neural Operatorscited by 1
  2. 2025Delay-adaptive Control of Nonlinear Systems with Approximate Neural Operator Predictorscited by 1
  3. 2024Moving-Horizon Estimators for Hyperbolic and Parabolic PDEs in 1-Dcited by 0
  4. 2025Soft Actor-Critic with Backstepping-Pretrained DeepONet for control of PDEscited by 0
  5. 2026Lotka-Sharpe Neural Operators for Control of Population PDEscited by 0
  6. 2026Backstepping-Guided Reinforcement Learning for Wide-Range Saint-Venant Canal Regulationcited by 0