mlsanityData to 7 Oct 2026

Learning the solution operator of parametric partial differential equations with physics-informed DeepOnets

arXiv 2103.10974 ↗First posted 19 Mar 2021cs.LG cs.NA math.NAcited by 537

Not on the map. Why?

Abstract (arXiv)

Deep operator networks (DeepONets) are receiving increased attention thanks to their demonstrated capability to approximate nonlinear operators between infinite-dimensional Banach spaces. However, despite their remarkable early promise, they typically require large training data-sets consisting of paired input-output observations which may be expensive to obtain, while their predictions may not be consistent with the underlying physical principles that generated the observed data. In this work, we propose a novel model class coined as physics-informed DeepONets, which introduces an effective regularization mechanism for biasing the outputs of DeepOnet models towards ensuring physical consistency. This is accomplished by leveraging automatic differentiation to impose the underlying physical laws via soft penalty constraints during model training. We demonstrate that this simple, yet remarkably effective extension can not only yield a significant improvement in the predictive accuracy of DeepOnets, but also greatly reduce the need for large training data-sets. To this end, a remarkable observation is that physics-informed DeepONets are capable of solving parametric partial differential equations (PDEs) without any paired input-output observations, except for a set of given initial or boundary conditions. We illustrate the effectiveness of the proposed framework through a series of comprehensive numerical studies across various types of PDEs. Strikingly, a trained physics informed DeepOnet model can predict the solution of O(103) time-dependent PDEs in a fraction of a second -- up to three orders of magnitude faster compared a conventional PDE solver. The data and code accompanying this manuscript are publicly available at urlhttps://github.com/PredictiveIntelligenceLab/Physics-informed-DeepONets.

Key facts. Cited by 537 papers in the map (data through 7 Oct 2026). Builds on 26 of its 78 references that are in the map. First posted on arXiv 19 Mar 2021.

Builds on

26 of 78 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  5. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  6. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  7. 2015Automatic differentiation in machine learning: a surveycited by 846
  8. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  9. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  10. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  11. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  12. 2021Machine learning accelerated computational fluid dynamicscited by 461
14 more
  1. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  2. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
  3. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  4. 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
  5. 2016Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Reviewcited by 155
  6. 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
  7. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  8. 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
  9. 2020The Random Feature Model for Input-Output Maps between Banach Spacescited by 90
  10. 2019Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networkscited by 76
  11. 2015Operator-valued Kernels for Learning from Functional Response Datacited by 59
  12. 2020NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation frameworkcited by 58
  13. 2020Can Shallow Neural Networks Beat the Curse of Dimensionality? A mean field training perspectivecited by 22
  14. 2018Deep Learning of Turbulent Scalar Mixingcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 23; 2022: 74; 2023: 84; 2024: 119; 2025: 137; 2026: 100.

537 papers.

Sort:

By area:

  1. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  2. 2021Neural Operator: Learning Maps Between Function Spacescited by 413
  3. 2021Choose a Transformer: Fourier or Galerkincited by 333
  4. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  5. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  6. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
  7. 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
  8. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  9. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
  10. 2022MIONet: Learning multiple-input operators via tensor productcited by 180
  11. 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
  12. 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
38 more
  1. 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
  2. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  3. 2022Physics-Informed Deep Neural Operator Networkscited by 110
  4. 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 109
  5. 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
  6. 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
  7. 2022Multifidelity deep neural operators for efficient learning of partial differential equations with application to fast inverse design of nanoscale heat transportcited by 92
  8. 2022Clifford Neural Layers for PDE Modelingcited by 91
  9. 2022Learning Operators with Coupled Attentioncited by 88
  10. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  11. 2021Long-time integration of parametric evolution equations with physics-informed DeepONetscited by 87
  12. 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
  13. 2021Improved architectures and training algorithms for deep operator networkscited by 85
  14. 2023A Mathematical Guide to Operator Learningcited by 74
  15. 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
  16. 2021Closed-form Continuous-time Neural Modelscited by 65
  17. 2022Generic bounds on the approximation error for physics-informed (and) operator learningcited by 65
  18. 2024Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networkscited by 64
  19. 2022Reliable extrapolation of deep neural operators informed by physics or sparse observationscited by 62
  20. 2021Encoding physics to learn reaction-diffusion processescited by 61
  21. 2021Learning in Sinusoidal Spaces with Physics-Informed Neural Networkscited by 61
  22. 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
  23. 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
  24. 2024On conditional diffusion models for PDE simulationscited by 56
  25. 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 53
  26. 2023Kernel Methods are Competitive for Operator Learningcited by 50
  27. 2022Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problemscited by 47
  28. 2024CViT: Continuous Vision Transformer for Operator Learningcited by 47
  29. 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
  30. 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
  31. 2023Group Equivariant Fourier Neural Operators for Partial Differential Equationscited by 42
  32. 2023CFDBench: A Large-Scale Benchmark for Machine Learning Methods in Fluid Dynamicscited by 40
  33. 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37
  34. 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networkscited by 37
  35. 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
  36. 2021Simulating progressive intramural damage leading to aortic dissection using an operator-regression neural networkcited by 35
  37. 2022SVD Perspectives for Augmenting DeepONet Flexibility and Interpretabilitycited by 35
  38. 2022Implicit Neural Spatial Representations for Time-dependent PDEscited by 35

50 most cited of 537 All 537 (JSON)