Fast PDE-constrained optimization via self-supervised operator learning
Not on the map. Why?
Abstract (arXiv)
Design and optimal control problems are among the fundamental, ubiquitous tasks we face in science and engineering. In both cases, we aim to represent and optimize an unknown (black-box) function that associates a performance/outcome to a set of controllable variables through an experiment. In cases where the experimental dynamics can be described by partial differential equations (PDEs), such problems can be mathematically translated into PDE-constrained optimization tasks, which quickly become intractable as the number of control variables and the cost of experiments increases. In this work we leverage physics-informed deep operator networks (DeepONets) -- a self-supervised framework for learning the solution operator of parametric PDEs -- to build fast and differentiable surrogates for rapidly solving PDE-constrained optimization problems, even in the absence of any paired input-output training data. The effectiveness of the proposed framework will be demonstrated across different applications involving continuous functions as control or design variables, including time-dependent optimal control of heat transfer, and drag minimization of obstacles in Stokes flow. In all cases, we observe that DeepONets can minimize high-dimensional cost functionals in a matter of seconds, yielding a significant speed up compared to traditional adjoint PDE solvers that are typically costly and limited to relatively low-dimensional control/design parametrizations.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 16 of its 70 references that are in the map. First posted on arXiv 25 Oct 2021.
Builds on
16 of 70 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2015Automatic differentiation in machine learning: a surveycited by 855
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 284
- 2021Physics-informed neural networks with hard constraints for inverse designcited by 280
- 2020DeepReach: A Deep Learning Approach to High-Dimensional Reachabilitycited by 91
- 2021Long-time integration of parametric evolution equations with physics-informed DeepONetscited by 89
- 2021Improved architectures and training algorithms for deep operator networkscited by 86
- 2019Multi-level Convolutional Autoencoder Networks for Parametric Prediction of Spatio-temporal Dynamicscited by 45
4 more
- 2019Neural reparameterization improves structural optimizationcited by 44
- 2018Deep Learning of Turbulent Scalar Mixingcited by 17
- 2020Learning Composable Energy Surrogates for PDE Order Reductioncited by 13
- 2020Automatic shape derivatives for transient PDEs in FEniCS and Firedrakecited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 6; 2024: 4; 2025: 5; 2026: 3.
25 papers.
Sort:
By area:
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 92
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2022Learning Operators with Coupled Attentioncited by 90
- 2022Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problemscited by 21
- 2022Physics-informed neural networks for PDE-constrained optimization and controlcited by 19
- 2023Efficient PDE-Constrained optimization under high-dimensional uncertainty using derivative-informed neural operatorscited by 19
- 2022Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradientscited by 17
- 2023A DeepONet multi-fidelity approach for residual learning in reduced order modelingcited by 14
- 2024Neural Network Approaches for Parameterized Optimal Controlcited by 8
- 2025Deep Operator Networks for Bayesian Parameter Estimation in PDEscited by 6
- 2025The Seismic Wavefield Common Task Frameworkcited by 6
- 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equationscited by 5
13 more
- 2021Quantum Model-Discoverycited by 4
- 2023VI-DGP: A variational inference method with deep generative prior for solving high-dimensional inverse problemscited by 4
- 2023Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problemscited by 4
- 2024Real-time optimal control of high-dimensional parametrized systems by deep learning-based reduced order modelscited by 4
- 2025Verification and Validation for Trustworthy Scientific Machine Learningcited by 4
- 2023Neural Born Series Operator for Biomedical Ultrasound Computed Tomographycited by 3
- 2025Deep Neural ODE Operator Networks for PDEscited by 3
- 2025Accelerating PDE-Constrained Optimization by the Derivative of Neural Operatorscited by 1
- 2026Harnessing AI for Inverse Partial Differential Equation Problems: Past, Present, and Prospectscited by 1
- 2023The ADMM-PINNs Algorithmic Framework for Nonsmooth PDE-Constrained Optimization: A Deep Learning Approachcited by 0
- 2024Latent feedback control of distributed systems in multiple scenarios through deep learning-based reduced order modelscited by 0
- 2026A Single-Loop Bilevel Deep Learning Method for Optimal Control of Obstacle Problemscited by 0
- 2026Real-time optimal control with shallow recurrent decoder networkscited by 0
- 2026Real-time optimal control with shallow recurrent decoder networks21 Jul 2026
- 2026Harnessing AI for Inverse Partial Differential Equation Problems: Past, Present, and Prospects16 May 2026
- 2026A Single-Loop Bilevel Deep Learning Method for Optimal Control of Obstacle Problems7 Jan 2026
- 2025The Seismic Wavefield Common Task Framework22 Dec 2025
- 2025Deep Neural ODE Operator Networks for PDEs17 Oct 2025
- 2025Accelerating PDE-Constrained Optimization by the Derivative of Neural Operators16 Jun 2025
- 2025Verification and Validation for Trustworthy Scientific Machine Learning21 Feb 2025
- 2025Deep Operator Networks for Bayesian Parameter Estimation in PDEs18 Jan 2025
- 2024Latent feedback control of distributed systems in multiple scenarios through deep learning-based reduced order models13 Dec 2024
- 2024Real-time optimal control of high-dimensional parametrized systems by deep learning-based reduced order models9 Sep 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024Neural Network Approaches for Parameterized Optimal Control15 Feb 2024
13 more
- 2023Neural Born Series Operator for Biomedical Ultrasound Computed Tomography25 Dec 2023
- 2023Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problems1 Jul 2023
- 2023Efficient PDE-Constrained optimization under high-dimensional uncertainty using derivative-informed neural operators31 May 2023
- 2023A DeepONet multi-fidelity approach for residual learning in reduced order modeling24 Feb 2023
- 2023VI-DGP: A variational inference method with deep generative prior for solving high-dimensional inverse problems22 Feb 2023
- 2023The ADMM-PINNs Algorithmic Framework for Nonsmooth PDE-Constrained Optimization: A Deep Learning Approach16 Feb 2023
- 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equations8 Dec 2022
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications15 Nov 2022
- 2022Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems6 Oct 2022
- 2022Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradients15 Sep 2022
- 2022Physics-informed neural networks for PDE-constrained optimization and control6 May 2022
- 2022Learning Operators with Coupled Attention4 Jan 2022
- 2021Quantum Model-Discovery11 Nov 2021
- 2024Neural Network Approaches for Parameterized Optimal Control15 Feb 2024
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 92
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2022Learning Operators with Coupled Attentioncited by 90
- 2022Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problemscited by 21
- 2022Physics-informed neural networks for PDE-constrained optimization and controlcited by 19
- 2023Efficient PDE-Constrained optimization under high-dimensional uncertainty using derivative-informed neural operatorscited by 19
- 2022Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradientscited by 17
- 2023A DeepONet multi-fidelity approach for residual learning in reduced order modelingcited by 14
- 2025Deep Operator Networks for Bayesian Parameter Estimation in PDEscited by 6
- 2025The Seismic Wavefield Common Task Frameworkcited by 6
- 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equationscited by 5
- 2021Quantum Model-Discoverycited by 4
12 most cited of 24 All 24 (JSON)
- 2026Real-time optimal control with shallow recurrent decoder networks21 Jul 2026
- 2026Harnessing AI for Inverse Partial Differential Equation Problems: Past, Present, and Prospects16 May 2026
- 2026A Single-Loop Bilevel Deep Learning Method for Optimal Control of Obstacle Problems7 Jan 2026
- 2025The Seismic Wavefield Common Task Framework22 Dec 2025
- 2025Deep Neural ODE Operator Networks for PDEs17 Oct 2025
- 2025Accelerating PDE-Constrained Optimization by the Derivative of Neural Operators16 Jun 2025
- 2025Verification and Validation for Trustworthy Scientific Machine Learning21 Feb 2025
- 2025Deep Operator Networks for Bayesian Parameter Estimation in PDEs18 Jan 2025
- 2024Latent feedback control of distributed systems in multiple scenarios through deep learning-based reduced order models13 Dec 2024
- 2024Real-time optimal control of high-dimensional parametrized systems by deep learning-based reduced order models9 Sep 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2023Neural Born Series Operator for Biomedical Ultrasound Computed Tomography25 Dec 2023
12 newest of 24 All 24 (JSON)