mlsanityData to 14 Oct 2026

Fast PDE-constrained optimization via self-supervised operator learning

arXiv 2110.13297 ↗First posted 25 Oct 2021cs.LG math.OCcited by 25

Not on the map. Why?

Abstract (arXiv)

Design and optimal control problems are among the fundamental, ubiquitous tasks we face in science and engineering. In both cases, we aim to represent and optimize an unknown (black-box) function that associates a performance/outcome to a set of controllable variables through an experiment. In cases where the experimental dynamics can be described by partial differential equations (PDEs), such problems can be mathematically translated into PDE-constrained optimization tasks, which quickly become intractable as the number of control variables and the cost of experiments increases. In this work we leverage physics-informed deep operator networks (DeepONets) -- a self-supervised framework for learning the solution operator of parametric PDEs -- to build fast and differentiable surrogates for rapidly solving PDE-constrained optimization problems, even in the absence of any paired input-output training data. The effectiveness of the proposed framework will be demonstrated across different applications involving continuous functions as control or design variables, including time-dependent optimal control of heat transfer, and drag minimization of obstacles in Stokes flow. In all cases, we observe that DeepONets can minimize high-dimensional cost functionals in a matter of seconds, yielding a significant speed up compared to traditional adjoint PDE solvers that are typically costly and limited to relatively low-dimensional control/design parametrizations.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 16 of its 70 references that are in the map. First posted on arXiv 25 Oct 2021.

Builds on

16 of 70 references.

References · 16

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  3. 2015Automatic differentiation in machine learning: a surveycited by 855
  4. 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
  5. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
  6. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  7. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 284
  8. 2021Physics-informed neural networks with hard constraints for inverse designcited by 280
  9. 2020DeepReach: A Deep Learning Approach to High-Dimensional Reachabilitycited by 91
  10. 2021Long-time integration of parametric evolution equations with physics-informed DeepONetscited by 89
  11. 2021Improved architectures and training algorithms for deep operator networkscited by 86
  12. 2019Multi-level Convolutional Autoencoder Networks for Parametric Prediction of Spatio-temporal Dynamicscited by 45
4 more
  1. 2019Neural reparameterization improves structural optimizationcited by 44
  2. 2018Deep Learning of Turbulent Scalar Mixingcited by 17
  3. 2020Learning Composable Energy Surrogates for PDE Order Reductioncited by 13
  4. 2020Automatic shape derivatives for transient PDEs in FEniCS and Firedrakecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 6; 2023: 6; 2024: 4; 2025: 5; 2026: 3.

25 papers.

Sort:

By area:

  1. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 92
  2. 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
  3. 2022Learning Operators with Coupled Attentioncited by 90
  4. 2022Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problemscited by 21
  5. 2022Physics-informed neural networks for PDE-constrained optimization and controlcited by 19
  6. 2023Efficient PDE-Constrained optimization under high-dimensional uncertainty using derivative-informed neural operatorscited by 19
  7. 2022Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradientscited by 17
  8. 2023A DeepONet multi-fidelity approach for residual learning in reduced order modelingcited by 14
  9. 2024Neural Network Approaches for Parameterized Optimal Controlcited by 8
  10. 2025Deep Operator Networks for Bayesian Parameter Estimation in PDEscited by 6
  11. 2025The Seismic Wavefield Common Task Frameworkcited by 6
  12. 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equationscited by 5
13 more
  1. 2021Quantum Model-Discoverycited by 4
  2. 2023VI-DGP: A variational inference method with deep generative prior for solving high-dimensional inverse problemscited by 4
  3. 2023Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problemscited by 4
  4. 2024Real-time optimal control of high-dimensional parametrized systems by deep learning-based reduced order modelscited by 4
  5. 2025Verification and Validation for Trustworthy Scientific Machine Learningcited by 4
  6. 2023Neural Born Series Operator for Biomedical Ultrasound Computed Tomographycited by 3
  7. 2025Deep Neural ODE Operator Networks for PDEscited by 3
  8. 2025Accelerating PDE-Constrained Optimization by the Derivative of Neural Operatorscited by 1
  9. 2026Harnessing AI for Inverse Partial Differential Equation Problems: Past, Present, and Prospectscited by 1
  10. 2023The ADMM-PINNs Algorithmic Framework for Nonsmooth PDE-Constrained Optimization: A Deep Learning Approachcited by 0
  11. 2024Latent feedback control of distributed systems in multiple scenarios through deep learning-based reduced order modelscited by 0
  12. 2026A Single-Loop Bilevel Deep Learning Method for Optimal Control of Obstacle Problemscited by 0
  13. 2026Real-time optimal control with shallow recurrent decoder networkscited by 0