DOSnet as a Non-Black-Box PDE Solver: When Deep Learning Meets Operator Splitting
Not on the map. Why?
Abstract (arXiv)
Deep neural networks (DNNs) recently emerged as a promising tool for analyzing and solving complex differential equations arising in science and engineering applications. Alternative to traditional numerical schemes, learning-based solvers utilize the representation power of DNNs to approximate the input-output relations in an automated manner. However, the lack of physics-in-the-loop often makes it difficult to construct a neural network solver that simultaneously achieves high accuracy, low computational burden, and interpretability. In this work, focusing on a class of evolutionary PDEs characterized by having decomposable operators, we show that the classical ``operator splitting'' numerical scheme of solving these equations can be exploited to design neural network architectures. This gives rise to a learning-based PDE solver, which we name Deep Operator-Splitting Network (DOSnet). Such non-black-box network design is constructed from the physical rules and operators governing the underlying dynamics contains learnable parameters, and is thus more flexible than the standard operator splitting scheme. Once trained, it enables the fast solution of the same type of PDEs. To validate the special structure inside DOSnet, we take the linear PDEs as the benchmark and give the mathematical explanation for the weight behavior. Furthermore, to demonstrate the advantages of our new AI-enhanced PDE solver, we train and validate it on several types of operator-decomposable differential equations. We also apply DOSnet to nonlinear Schr"odinger equations (NLSE) which have important applications in the signal processing for modern optical fiber transmission systems, and experimental results show that our model has better accuracy and lower computational complexity than numerical schemes and the baseline DNNs.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 11 of its 43 references that are in the map. First posted on arXiv 11 Dec 2022.
Builds on
11 of 43 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2013Exact solutions to the nonlinear dynamics of learning in deep linear neural networkscited by 748
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2020An overview on deep learning-based approximation methods for partial differential equationscited by 65
- 2016Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNscited by 62
- 2022projUNN: efficient method for training deep networks with unitary matricescited by 27
- 2017Nonlinear Interference Mitigation via Deep Neural Networkscited by 13
- 2018Deep Learning of the Nonlinear Schr"odinger Equation in Fiber-Optic Communicationscited by 1
Built on by
Citing papers per year: 2023: 4; 2024: 4; 2025: 2; 2026: 1.
11 papers.
- 2023PottsMGNet: A Mathematical Explanation of Encoder-Decoder Based Neural Networkscited by 17
- 2024Automatic Differentiation is Essential in Training Neural Networks for Solving Differential Equationscited by 9
- 2023Double-well Net for Image Segmentationcited by 7
- 2024Euler's Elastica Based Cartoon-Smooth-Texture Image Decompositioncited by 4
- 2024A Mathematical Explanation of UNetcited by 4
- 2023Connections between Operator-splitting Methods and Deep Neural Networks with Applications in Image Segmentationcited by 3
- 2024Quantifying Training Difficulty and Accelerating Convergence in Neural Network-Based PDE Solverscited by 3
- 2025Learn Singularly Perturbed Solutions via Homotopy Dynamicscited by 2
- 2025A Mathematical Explanation of Transformerscited by 2
- 2023Energy stable neural network for gradient flow equationscited by 0
- 2026LSR-Net: Learning the Forward Evolution Operator for Nonlinear Fluid Dynamicscited by 0
- 2026LSR-Net: Learning the Forward Evolution Operator for Nonlinear Fluid Dynamics20 Jul 2026
- 2025A Mathematical Explanation of Transformers5 Oct 2025
- 2025Learn Singularly Perturbed Solutions via Homotopy Dynamics1 Feb 2025
- 2024Quantifying Training Difficulty and Accelerating Convergence in Neural Network-Based PDE Solvers8 Oct 2024
- 2024A Mathematical Explanation of UNet6 Oct 2024
- 2024Euler's Elastica Based Cartoon-Smooth-Texture Image Decomposition3 Jul 2024
- 2024Automatic Differentiation is Essential in Training Neural Networks for Solving Differential Equations23 May 2024
- 2023Double-well Net for Image Segmentation31 Dec 2023
- 2023Energy stable neural network for gradient flow equations17 Sep 2023
- 2023Connections between Operator-splitting Methods and Deep Neural Networks with Applications in Image Segmentation18 Jul 2023
- 2023PottsMGNet: A Mathematical Explanation of Encoder-Decoder Based Neural Networks18 Jul 2023