mlsanityData to 7 Oct 2026

Multiwavelet-based Operator Learning for Differential Equations

arXiv 2109.13459 ↗First posted 28 Sep 2021cs.LG math.APcited by 229

Not on the map. Why?

Abstract (arXiv)

The solution of a partial differential equation can be obtained by computing the inverse operator map between the input and the solution space. Towards this end, we introduce a textitmultiwavelet-based neural operator learning scheme that compresses the associated operator's kernel using fine-grained wavelets. By explicitly embedding the inverse multiwavelet filters, we learn the projection of the kernel onto fixed multiwavelet polynomial bases. The projected kernel is trained at multiple scales derived from using repeated computation of multiwavelet transform. This allows learning the complex dependencies at various scales and results in a resolution-independent scheme. Compare to the prior works, we exploit the fundamental properties of the operator's kernel which enable numerically efficient representation. We perform experiments on the Korteweg-de Vries (KdV) equation, Burgers' equation, Darcy Flow, and Navier-Stokes equation. Compared with the existing neural operator approaches, our model shows significantly higher accuracy and achieves state-of-the-art in a range of datasets. For the time-varying equations, the proposed method exhibits a (2X-10X) improvement (0.0018 (0.0033) relative L2 error for Burgers' (KdV) equation). By learning the mappings between function spaces, the proposed method has the ability to find the solution of a high-resolution input after learning from lower-resolution data.

Key facts. Cited by 229 papers in the map (data through 7 Oct 2026). Builds on 20 of its 88 references that are in the map. First posted on arXiv 28 Sep 2021.

Builds on

20 of 88 references.

References · 20

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  3. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  4. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  5. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  6. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  7. 2021Machine learning accelerated computational fluid dynamicscited by 461
  8. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  9. 2020Model Reduction and Neural Networks for Parametric PDEscited by 257
  10. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  11. 2019Symplectic Recurrent Neural Networkscited by 148
  12. 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
8 more
  1. 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
  2. 2019Learning to Optimize Multigrid PDE Solverscited by 79
  3. 2020A physics-informed operator regression framework for extracting data-driven continuum modelscited by 60
  4. 2021Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functionscited by 49
  5. 2019Meta-learning Pseudo-differential Operators with Deep Neural Networkscited by 17
  6. 2020Neural Vortex Method: from Finite Lagrangian Particles to Infinite Dimensional Eulerian Dynamicscited by 6
  7. 2019Design of a Simple Orthogonal Multiwavelet Filter by Matrix Spectral Factorizationcited by 2
  8. 2020Algebraically-Informed Deep Networks (AIDN): A Deep Learning Approach to Represent Algebraic Structurescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 29; 2023: 46; 2024: 58; 2025: 48; 2026: 47.

229 papers.

Sort:

By area:

  1. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  2. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  3. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  4. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  5. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  6. 2022U-NO: U-shaped Neural Operatorscited by 219
  7. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  8. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  9. 2022Physics-Informed Deep Neural Operator Networkscited by 110
  10. 2022Learning Operators with Coupled Attentioncited by 88
  11. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  12. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
38 more
  1. 2022NOMAD: Nonlinear Manifold Decoders for Operator Learningcited by 81
  2. 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
  3. 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 77
  4. 2023A Mathematical Guide to Operator Learningcited by 74
  5. 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 66
  6. 2022Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modelingcited by 65
  7. 2023Learning Physical Models that Can Respect Conservation Lawscited by 58
  8. 2023Improved Operator Learning by Orthogonal Attentioncited by 58
  9. 2023Super-Resolution Neural Operatorcited by 48
  10. 2024CViT: Continuous Vision Transformer for Operator Learningcited by 47
  11. 2023Operator learning with PCA-Net: upper and lower complexity boundscited by 44
  12. 2022Mitigating spectral bias for the multiscale operator learningcited by 43
  13. 2023Nonlocality and Nonlinearity Implies Universality in Operator Learningcited by 43
  14. 2023MgNO: Efficient Parameterization of Linear Operators via Multigridcited by 40
  15. 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
  16. 2023Domain Agnostic Fourier Neural Operatorscited by 36
  17. 2024Parameterized Physics-informed Neural Networks for Parameterized PDEscited by 35
  18. 2022Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problemscited by 34
  19. 2022INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservationcited by 28
  20. 2024Wavelet Diffusion Neural Operatorcited by 28
  21. 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
  22. 2022Learning Green's functions associated with time-dependent partial differential equationscited by 25
  23. 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
  24. 2022Approximate Bayesian Neural Operators: Uncertainty Quantification for Parametric PDEscited by 24
  25. 2024HAMLET: Graph Transformer Neural Operator for Partial Differential Equationscited by 24
  26. 2022Transformer Meets Boundary Value Inverse Problemscited by 22
  27. 2023A Neural PDE Solver with Temporal Stencil Modelingcited by 22
  28. 2023Multi-Resolution Active Learning of Fourier Neural Operatorscited by 22
  29. 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
  30. 2024BENO: Boundary-embedded Neural Operators for Elliptic PDEscited by 22
  31. 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
  32. 2022Transform Once: Efficient Operator Learning in Frequency Domaincited by 20
  33. 2022First De-Trend then Attend: Rethinking Attention for Time-Series Forecastingcited by 19
  34. 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
  35. 2024Invertible Fourier Neural Operators for Tackling Both Forward and Inverse Problemscited by 18
  36. 2024Spectral Invariant Learning for Dynamic Graphs under Distribution Shiftscited by 18
  37. 2024Nonlocal Attention Operator: Materializing Hidden Knowledge Towards Interpretable Physics Discoverycited by 18
  38. 2022NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulationcited by 17

50 most cited of 229 All 229 (JSON)