MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEs
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a a machine learning approach via model-operator-data network (MOD-Net) for solving PDEs. A MOD-Net is driven by a model to solve PDEs based on operator representation with regularization from data. For linear PDEs, we use a DNN to parameterize the Green's function and obtain the neural operator to approximate the solution according to the Green's method. To train the DNN, the empirical risk consists of the mean squared loss with the least square formulation or the variational formulation of the governing equation and boundary conditions. For complicated problems, the empirical risk also includes a few labels, which are computed on coarse grid points with cheap computation cost and significantly improves the model accuracy. Intuitively, the labeled dataset works as a regularization in addition to the model constraints. The MOD-Net solves a family of PDEs rather than a specific one and is much more efficient than original neural operator because few expensive labels are required. We numerically show MOD-Net is very efficient in solving Poisson equation and one-dimensional radiative transfer equation. For nonlinear PDEs, the nonlinear MOD-Net can be similarly used as an ansatz for solving nonlinear PDEs, exemplified by solving several nonlinear PDE problems, such as the Burgers equation.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 8 Jul 2021.
Builds on
13 of 26 references.
References · 13
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
- 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 188
- 2018Training behavior of deep neural network in frequency domaincited by 174
- 2020Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domainscited by 78
- 2020Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learningcited by 77
- 2019A Phase Shift Deep Neural Network for High Frequency Approximation and Wave Problemscited by 34
1 more
- 2020Machine Learning and Computational Mathematicscited by 22
Built on by
Citing papers per year: 2021: 1; 2022: 7; 2023: 5; 2024: 8; 2025: 2; 2026: 1.
24 papers.
Sort:
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2022Overview frequency principle/spectral bias in deep learningcited by 68
- 2024FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation Modelcited by 18
- 2023Learning Specialized Activation Functions for Physics-informed Neural Networkscited by 14
- 2022BI-GreenNet: Learning Green's functions by boundary integral networkcited by 13
- 2024Generating synthetic data for neural operatorscited by 11
- 2022Neural Q-learning for solving PDEscited by 8
- 2022Approximation of Functionals by Neural Network without Curse of Dimensionalitycited by 8
- 2023Capturing the Diffusive Behavior of the Multiscale Linear Transport Equations by Asymptotic-Preserving Convolutional DeepONetscited by 3
- 2024Green Multigrid Networkcited by 3
- 2025Orthogonal greedy algorithm for linear operator learning with shallow neural networkcited by 3
12 more
- 2025Learning Singularity-Encoded Green's Functions with Application to Iterative Methodscited by 3
- 2022A model-data asymptotic-preserving neural network method based on micro-macro decomposition for gray radiative transfer equationscited by 2
- 2022Bayesian Inversion with Neural Operator (BINO) for Modeling Subdiffusion: Forward and Inverse Problemscited by 1
- 2023Laplace-fPINNs: Laplace-based fractional physics-informed neural networks for solving forward and inverse problems of subdiffusioncited by 1
- 2023Learning Green's Function Efficiently Using Low-Rank Approximationscited by 1
- 2024Stabilizing and Solving Unique Continuation Problems by Parameterizing Data and Learning Finite Element Solution Operatorscited by 1
- 2024Learning Nonlinear Finite Element Solution Operators using Multilayer Perceptrons and Energy Minimizationcited by 1
- 2023Energy stable neural network for gradient flow equationscited by 0
- 2024Macroscopic auxiliary asymptotic preserving neural networks for the linear radiative transfer equationscited by 0
- 2024A Hybrid Kernel-Free Boundary Integral Method with Operator Learning for Solving Parametric Partial Differential Equations In Complex Domainscited by 0
- 2024STAResNet: a Network in Spacetime Algebra to solve Maxwell's PDEscited by 0
- 2026Learning PDE Dynamics between Submanifolds Using Green's Observation Operatorscited by 0
- 2026Learning PDE Dynamics between Submanifolds Using Green's Observation Operators1 Oct 2026
- 2025Learning Singularity-Encoded Green's Functions with Application to Iterative Methods15 Sep 2025
- 2025Orthogonal greedy algorithm for linear operator learning with shallow neural network6 Jan 2025
- 2024Learning Nonlinear Finite Element Solution Operators using Multilayer Perceptrons and Energy Minimization5 Dec 2024
- 2024Stabilizing and Solving Unique Continuation Problems by Parameterizing Data and Learning Finite Element Solution Operators5 Dec 2024
- 2024STAResNet: a Network in Spacetime Algebra to solve Maxwell's PDEs24 Aug 2024
- 2024Green Multigrid Network4 Jul 2024
- 2024A Hybrid Kernel-Free Boundary Integral Method with Operator Learning for Solving Parametric Partial Differential Equations In Complex Domains23 Apr 2024
- 2024FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation Model23 Apr 2024
- 2024Macroscopic auxiliary asymptotic preserving neural networks for the linear radiative transfer equations4 Mar 2024
- 2024Generating synthetic data for neural operators4 Jan 2024
- 2023Energy stable neural network for gradient flow equations17 Sep 2023
12 more
- 2023Learning Specialized Activation Functions for Physics-informed Neural Networks8 Aug 2023
- 2023Learning Green's Function Efficiently Using Low-Rank Approximations1 Aug 2023
- 2023Capturing the Diffusive Behavior of the Multiscale Linear Transport Equations by Asymptotic-Preserving Convolutional DeepONets28 Jun 2023
- 2023Laplace-fPINNs: Laplace-based fractional physics-informed neural networks for solving forward and inverse problems of subdiffusion3 Apr 2023
- 2022A model-data asymptotic-preserving neural network method based on micro-macro decomposition for gray radiative transfer equations11 Dec 2022
- 2022Bayesian Inversion with Neural Operator (BINO) for Modeling Subdiffusion: Forward and Inverse Problems22 Nov 2022
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications15 Nov 2022
- 2022Approximation of Functionals by Neural Network without Curse of Dimensionality28 May 2022
- 2022BI-GreenNet: Learning Green's functions by boundary integral network28 Apr 2022
- 2022Neural Q-learning for solving PDEs31 Mar 2022
- 2022Overview frequency principle/spectral bias in deep learning19 Jan 2022
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equations6 Nov 2021
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2022Overview frequency principle/spectral bias in deep learningcited by 68
- 2024FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation Modelcited by 18
- 2023Learning Specialized Activation Functions for Physics-informed Neural Networkscited by 14
- 2022BI-GreenNet: Learning Green's functions by boundary integral networkcited by 13
- 2024Generating synthetic data for neural operatorscited by 11
- 2022Neural Q-learning for solving PDEscited by 8
- 2022Approximation of Functionals by Neural Network without Curse of Dimensionalitycited by 8
- 2023Capturing the Diffusive Behavior of the Multiscale Linear Transport Equations by Asymptotic-Preserving Convolutional DeepONetscited by 3
- 2024Green Multigrid Networkcited by 3
- 2025Orthogonal greedy algorithm for linear operator learning with shallow neural networkcited by 3
12 most cited of 24 All 24 (JSON)
- 2026Learning PDE Dynamics between Submanifolds Using Green's Observation Operators1 Oct 2026
- 2025Learning Singularity-Encoded Green's Functions with Application to Iterative Methods15 Sep 2025
- 2025Orthogonal greedy algorithm for linear operator learning with shallow neural network6 Jan 2025
- 2024Learning Nonlinear Finite Element Solution Operators using Multilayer Perceptrons and Energy Minimization5 Dec 2024
- 2024Stabilizing and Solving Unique Continuation Problems by Parameterizing Data and Learning Finite Element Solution Operators5 Dec 2024
- 2024STAResNet: a Network in Spacetime Algebra to solve Maxwell's PDEs24 Aug 2024
- 2024Green Multigrid Network4 Jul 2024
- 2024A Hybrid Kernel-Free Boundary Integral Method with Operator Learning for Solving Parametric Partial Differential Equations In Complex Domains23 Apr 2024
- 2024FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation Model23 Apr 2024
- 2024Macroscopic auxiliary asymptotic preserving neural networks for the linear radiative transfer equations4 Mar 2024
- 2024Generating synthetic data for neural operators4 Jan 2024
- 2023Energy stable neural network for gradient flow equations17 Sep 2023
12 newest of 24 All 24 (JSON)