Learning the solution operator of parametric partial differential equations with physics-informed DeepOnets
Not on the map. Why?
Abstract (arXiv)
Deep operator networks (DeepONets) are receiving increased attention thanks to their demonstrated capability to approximate nonlinear operators between infinite-dimensional Banach spaces. However, despite their remarkable early promise, they typically require large training data-sets consisting of paired input-output observations which may be expensive to obtain, while their predictions may not be consistent with the underlying physical principles that generated the observed data. In this work, we propose a novel model class coined as physics-informed DeepONets, which introduces an effective regularization mechanism for biasing the outputs of DeepOnet models towards ensuring physical consistency. This is accomplished by leveraging automatic differentiation to impose the underlying physical laws via soft penalty constraints during model training. We demonstrate that this simple, yet remarkably effective extension can not only yield a significant improvement in the predictive accuracy of DeepOnets, but also greatly reduce the need for large training data-sets. To this end, a remarkable observation is that physics-informed DeepONets are capable of solving parametric partial differential equations (PDEs) without any paired input-output observations, except for a set of given initial or boundary conditions. We illustrate the effectiveness of the proposed framework through a series of comprehensive numerical studies across various types of PDEs. Strikingly, a trained physics informed DeepOnet model can predict the solution of O(103) time-dependent PDEs in a fraction of a second -- up to three orders of magnitude faster compared a conventional PDE solver. The data and code accompanying this manuscript are publicly available at urlhttps://github.com/PredictiveIntelligenceLab/Physics-informed-DeepONets.
Key facts. Cited by 537 papers in the map (data through 7 Oct 2026). Builds on 26 of its 78 references that are in the map. First posted on arXiv 19 Mar 2021.
Builds on
26 of 78 references.
References · 26
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2021Machine learning accelerated computational fluid dynamicscited by 461
14 more
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
- 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
- 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
- 2016Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Reviewcited by 155
- 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
- 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
- 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
- 2020The Random Feature Model for Input-Output Maps between Banach Spacescited by 90
- 2019Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networkscited by 76
- 2015Operator-valued Kernels for Learning from Functional Response Datacited by 59
- 2020NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation frameworkcited by 58
- 2020Can Shallow Neural Networks Beat the Curse of Dimensionality? A mean field training perspectivecited by 22
- 2018Deep Learning of Turbulent Scalar Mixingcited by 17
Built on by
Citing papers per year: 2021: 23; 2022: 74; 2023: 84; 2024: 119; 2025: 137; 2026: 100.
537 papers.
Sort:
By area:
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2022MIONet: Learning multiple-input operators via tensor productcited by 180
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
38 more
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
- 2022Physics-Informed Deep Neural Operator Networkscited by 110
- 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 109
- 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
- 2022Multifidelity deep neural operators for efficient learning of partial differential equations with application to fast inverse design of nanoscale heat transportcited by 92
- 2022Clifford Neural Layers for PDE Modelingcited by 91
- 2022Learning Operators with Coupled Attentioncited by 88
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2021Long-time integration of parametric evolution equations with physics-informed DeepONetscited by 87
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2021Improved architectures and training algorithms for deep operator networkscited by 85
- 2023A Mathematical Guide to Operator Learningcited by 74
- 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
- 2021Closed-form Continuous-time Neural Modelscited by 65
- 2022Generic bounds on the approximation error for physics-informed (and) operator learningcited by 65
- 2024Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networkscited by 64
- 2022Reliable extrapolation of deep neural operators informed by physics or sparse observationscited by 62
- 2021Encoding physics to learn reaction-diffusion processescited by 61
- 2021Learning in Sinusoidal Spaces with Physics-Informed Neural Networkscited by 61
- 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
- 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
- 2024On conditional diffusion models for PDE simulationscited by 56
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 53
- 2023Kernel Methods are Competitive for Operator Learningcited by 50
- 2022Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problemscited by 47
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 47
- 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2023Group Equivariant Fourier Neural Operators for Partial Differential Equationscited by 42
- 2023CFDBench: A Large-Scale Benchmark for Machine Learning Methods in Fluid Dynamicscited by 40
- 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37
- 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networkscited by 37
- 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
- 2021Simulating progressive intramural damage leading to aortic dissection using an operator-regression neural networkcited by 35
- 2022SVD Perspectives for Augmenting DeepONet Flexibility and Interpretabilitycited by 35
- 2022Implicit Neural Spatial Representations for Time-dependent PDEscited by 35
50 most cited of 537 All 537 (JSON)
- 2026Transferability of Learned States in Neural PDE Solvers7 Oct 2026
- 2026Cluster Attention Neural Operators for Solving Parametric Partial Differential Equations30 Sep 2026
- 2026Preconditioned Physics-Informed Neural Operator Training28 Sep 2026
- 2026KernelOnet: An Interpretable Neural Operator Based on Kernel Functions28 Sep 2026
- 2026The limits of exactness: On the failure of automatic differentiation in physics-informed machine learning27 Sep 2026
- 2026Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency26 Sep 2026
- 2026MENO: Memory-Efficient Neural Operator23 Sep 2026
- 2026Learning Physics from an Imperfect Ancestor21 Sep 2026
- 2026SDC-GON: Singular Decomposition and Consistency-Regularized Green's Operator Networks for Solving Partial Differential Equations19 Sep 2026
- 2026Periodic Neural Mapping for Unsteady Rotor-Blade Pressure and Aeroelastic Load Prediction18 Sep 2026
- 2026Linearized PINN with pretrained nonlinear layers14 Sep 2026
- 2026Learning Metamaterial Eigenmodes with Wavelet-Encoded Fourier Neural Operators8 Sep 2026
38 more
- 2026Latent-MoE: Domain-Aware Mixture-of-Experts for PDEs with Multi-Regime Physics7 Sep 2026
- 2026Disentangling Attention in Deep Operator Learning: A Controlled Study of Data-Driven and Physics-Informed Architectures3 Sep 2026
- 2026Equation Recast for Canonical Operator Learning Across Parametric PDEs2 Sep 2026
- 2026Spectral-Embedded Operator Learning for Three-Phase Interfacial Flow: A Ternary Cahn-Hilliard-Navier-Stokes Benchmark29 Aug 2026
- 2026Quantum SEDONet: Spectrally-Embedded Quantum Deep Operator Networks for Partial Differential Equations27 Aug 2026
- 2026Physics-Integrated Operator Learning via Gaussian Splatting Representations25 Aug 2026
- 2026Helix-FNO: Spectral-Domain Operator Learning Coupled with a High-Fidelity Mechanistic Model for Fast Surrogate Simulation23 Aug 2026
- 2026Rationally Enriched Chebyshev Trunk Bases for DeepONet Surrogates of High P'eclet Entrance Transport20 Aug 2026
- 2026Multi-stage neural operator learning with application for convolutions19 Aug 2026
- 2026MiNO: Cotangent-bundle propagator learning for PDEs15 Aug 2026
- 2026Real-Time State-of-Health Estimation and Online Degradation Prognosis from Partial Battery Discharge Using Physics-Informed Neural Networks14 Aug 2026
- 2026Learning Unsteady Aneurysm Hemodynamics with Physics-Informed DeepONets13 Aug 2026
- 2026Unsupervised Adaptation of PDE Foundation Models7 Aug 2026
- 2026Convex Neural Energy Elements: Monolithic Finite-Element Assembly of Geometry-Parameterized Neural Operators with Stability and Error Guarantees3 Aug 2026
- 2026Hypernetwork-Parameterized Spatially Adaptive Neural Operators for PDE Learning31 Jul 2026
- 2026Neural Operator Learning for Collision-Aware Trajectory Planning of Spacecraft Swarms31 Jul 2026
- 2026Learning features from Newton's algorithm: a way to accelerate nonlinear parametrized PDE solvers30 Jul 2026
- 2026Event-Structured Physics-Informed Neural Networks for Differentiable Critical Clearing Boundaries30 Jul 2026
- 2026SpectONet: A Physics-Guided Spectral Deep Operator Network for Euler-Bernoulli Beam Dynamics28 Jul 2026
- 2026Latent PDE mapping for efficient physics-informed learning across geometries with limited data24 Jul 2026
- 2026PIKFNO: An Interpretable Neural Operator Based on Physics Informed Kernel Function11 Jul 2026
- 2026Physics-Audited Agentic Discovery in Scientific Machine Learning8 Jul 2026
- 2026Kernel-based Operator Learning: Error Analysis, Budget Allocation, and a Physics-Informed Extension7 Jul 2026
- 2026Randomized neural operator for parametric PDEs with fast training and conformal uncertainty quantification28 Jun 2026
- 2026Fourier Neural Operators with Least-Squares Readout Refit for Learning Random Obstacle-to-Solution Maps28 Jun 2026
- 2026Neural network surrogates with uncertainty quantification for inverse problems in partial differential equations18 Jun 2026
- 2026GA-VINO: A Geometry-Aware Variational Physics-informed Neural Operator for Mindlin-Reissner Plates15 Jun 2026
- 2026Chain of Operators: An Inference-Time Harness for In-Context Operator Learning10 Jun 2026
- 2026Structure-Preserving Neural Surrogates with Tractable Uncertainty Quantification10 Jun 2026
- 2026Architecture Shapes Transfer Specificity in Implicit Neural Representations5 Jun 2026
- 2026Effective Dimensionality as an Operator Invariant for Physics-Preserving Constraint Adaptation in Physics-Informed Neural Networks4 Jun 2026
- 2026On the training of physics-informed neural operators for solving parametric partial differential equations4 Jun 2026
- 2026Loss-Conditional PINNs for Parametric PDE Families3 Jun 2026
- 2026Oscillatory State-Space Models as Inductive Biases for Physics-Informed Neural PDE Solvers29 May 2026
- 2026Deep Adaptive Dimension Reduction for Bayesian Inference in Inverse Problems28 May 2026
- 2026Accelerating Bayesian inverse design in computational fluid dynamics using neural operators25 May 2026
- 2026NPSolver: Neural Poisson Solver with Iterative Physics Supervision25 May 2026
- 2026WINO: A Weak-Form Physics Informed Neural Operator for Hyperelasticity on Variable Domains23 May 2026
50 newest of 537 All 537 (JSON)
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2024On conditional diffusion models for PDE simulationscited by 56
- 2024Gradient-Free Generation for Hard-Constrained Systemscited by 35
- 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
- 2025FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modelingcited by 19
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observationscited by 16
- 2025CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operatorscited by 10
- 2026UniFluids: Unified Neural Operator Learning with Conditional Flow-matchingcited by 0
- 2026UniFluids: Unified Neural Operator Learning with Conditional Flow-matching19 Mar 2026
- 2025CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operators4 Dec 2025
- 2025FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modeling9 Jun 2025
- 2025Generative Latent Neural PDE Solver using Flow Matching28 Mar 2025
- 2024Gradient-Free Generation for Hard-Constrained Systems2 Dec 2024
- 2024On conditional diffusion models for PDE simulations21 Oct 2024
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observations31 Jul 2024
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug 2023
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
- 2022MIONet: Learning multiple-input operators via tensor productcited by 180
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
12 most cited of 524 All 524 (JSON)
- 2026Transferability of Learned States in Neural PDE Solvers7 Oct 2026
- 2026Cluster Attention Neural Operators for Solving Parametric Partial Differential Equations30 Sep 2026
- 2026Preconditioned Physics-Informed Neural Operator Training28 Sep 2026
- 2026KernelOnet: An Interpretable Neural Operator Based on Kernel Functions28 Sep 2026
- 2026The limits of exactness: On the failure of automatic differentiation in physics-informed machine learning27 Sep 2026
- 2026Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency26 Sep 2026
- 2026MENO: Memory-Efficient Neural Operator23 Sep 2026
- 2026Learning Physics from an Imperfect Ancestor21 Sep 2026
- 2026SDC-GON: Singular Decomposition and Consistency-Regularized Green's Operator Networks for Solving Partial Differential Equations19 Sep 2026
- 2026Periodic Neural Mapping for Unsteady Rotor-Blade Pressure and Aeroelastic Load Prediction18 Sep 2026
- 2026Linearized PINN with pretrained nonlinear layers14 Sep 2026
- 2026Learning Metamaterial Eigenmodes with Wavelet-Encoded Fourier Neural Operators8 Sep 2026
12 newest of 524 All 524 (JSON)