PMNO: A novel physics guided multi-step neural operator predictor for partial differential equations
Not on the map. Why?
Abstract (arXiv)
Neural operators, which aim to approximate mappings between infinite-dimensional function spaces, have been widely applied in the simulation and prediction of physical systems. However, the limited representational capacity of network architectures, combined with their heavy reliance on large-scale data, often hinder effective training and result in poor extrapolation performance. In this paper, inspired by traditional numerical methods, we propose a novel physics guided multi-step neural operator (PMNO) architecture to address these challenges in long-horizon prediction of complex physical systems. Distinct from general operator learning methods, the PMNO framework replaces the single-step input with multi-step historical data in the forward pass and introduces an implicit time-stepping scheme based on the Backward Differentiation Formula (BDF) during backpropagation. This design not only strengthens the model's extrapolation capacity but also facilitates more efficient and stable training with fewer data samples, especially for long-term predictions. Meanwhile, a causal training strategy is employed to circumvent the need for multi-stage training and to ensure efficient end-to-end optimization. The neural operator architecture possesses resolution-invariant properties, enabling the trained model to perform fast extrapolation on arbitrary spatial resolutions. We demonstrate the superior predictive performance of PMNO predictor across a diverse range of physical systems, including 2D linear system, modeling over irregular domain, complex-valued wave dynamics, and reaction-diffusion processes. Depending on the specific problem setting, various neural operator architectures, including FNO, DeepONet, and their variants, can be seamlessly integrated into the PMNO framework.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
30 of 67 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2017Solving high-dimensional partial differential equations using deep learningcited by 556
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
- 2017PDE-Net: Learning PDEs from Datacited by 311
18 more
- 2021Physics-informed neural networks with hard constraints for inverse designcited by 280
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 234
- 2016FractalNet: Ultra-Deep Neural Networks without Residualscited by 216
- 2017Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equationscited by 203
- 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 171
- 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
- 2017Machine Learning of Linear Differential Equations using Gaussian Processescited by 140
- 2020Transformers for Modeling Physical Systemscited by 106
- 2020A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networkscited by 87
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 78
- 2021Encoding physics to learn reaction-diffusion processescited by 61
- 2017Multi-level Residual Networks from Dynamical Systems Viewcited by 59
- 2022Neural Galerkin Schemes with Active Learning for High-Dimensional Evolution Equationscited by 56
- 2021Evolutional Deep Neural Networkcited by 50
- 2016PolyNet: A Pursuit of Structural Diversity in Very Deep Networkscited by 39
- 2023Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networkscited by 32
- 2024Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operatorscited by 20
- 2024A MgNO Method for Multiphase Flow in Porous Mediacited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.