Multiwavelet-based Operator Learning for Differential Equations
Not on the map. Why?
Abstract (arXiv)
The solution of a partial differential equation can be obtained by computing the inverse operator map between the input and the solution space. Towards this end, we introduce a textitmultiwavelet-based neural operator learning scheme that compresses the associated operator's kernel using fine-grained wavelets. By explicitly embedding the inverse multiwavelet filters, we learn the projection of the kernel onto fixed multiwavelet polynomial bases. The projected kernel is trained at multiple scales derived from using repeated computation of multiwavelet transform. This allows learning the complex dependencies at various scales and results in a resolution-independent scheme. Compare to the prior works, we exploit the fundamental properties of the operator's kernel which enable numerically efficient representation. We perform experiments on the Korteweg-de Vries (KdV) equation, Burgers' equation, Darcy Flow, and Navier-Stokes equation. Compared with the existing neural operator approaches, our model shows significantly higher accuracy and achieves state-of-the-art in a range of datasets. For the time-varying equations, the proposed method exhibits a (2X-10X) improvement (0.0018 (0.0033) relative L2 error for Burgers' (KdV) equation). By learning the mappings between function spaces, the proposed method has the ability to find the solution of a high-resolution input after learning from lower-resolution data.
Key facts. Cited by 229 papers in the map (data through 7 Oct 2026). Builds on 20 of its 88 references that are in the map. First posted on arXiv 28 Sep 2021.
Builds on
20 of 88 references.
References · 20
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
- 2021Machine learning accelerated computational fluid dynamicscited by 461
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
- 2020Model Reduction and Neural Networks for Parametric PDEscited by 257
- 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
- 2019Symplectic Recurrent Neural Networkscited by 148
- 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
8 more
- 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
- 2019Learning to Optimize Multigrid PDE Solverscited by 79
- 2020A physics-informed operator regression framework for extracting data-driven continuum modelscited by 60
- 2021Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functionscited by 49
- 2019Meta-learning Pseudo-differential Operators with Deep Neural Networkscited by 17
- 2020Neural Vortex Method: from Finite Lagrangian Particles to Infinite Dimensional Eulerian Dynamicscited by 6
- 2019Design of a Simple Orthogonal Multiwavelet Filter by Matrix Spectral Factorizationcited by 2
- 2020Algebraically-Informed Deep Networks (AIDN): A Deep Learning Approach to Represent Algebraic Structurescited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 29; 2023: 46; 2024: 58; 2025: 48; 2026: 47.
229 papers.
Sort:
By area:
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
- 2022Physics-Informed Deep Neural Operator Networkscited by 110
- 2022Learning Operators with Coupled Attentioncited by 88
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
38 more
- 2022NOMAD: Nonlinear Manifold Decoders for Operator Learningcited by 81
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 77
- 2023A Mathematical Guide to Operator Learningcited by 74
- 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 66
- 2022Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modelingcited by 65
- 2023Learning Physical Models that Can Respect Conservation Lawscited by 58
- 2023Improved Operator Learning by Orthogonal Attentioncited by 58
- 2023Super-Resolution Neural Operatorcited by 48
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 47
- 2023Operator learning with PCA-Net: upper and lower complexity boundscited by 44
- 2022Mitigating spectral bias for the multiscale operator learningcited by 43
- 2023Nonlocality and Nonlinearity Implies Universality in Operator Learningcited by 43
- 2023MgNO: Efficient Parameterization of Linear Operators via Multigridcited by 40
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
- 2023Domain Agnostic Fourier Neural Operatorscited by 36
- 2024Parameterized Physics-informed Neural Networks for Parameterized PDEscited by 35
- 2022Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problemscited by 34
- 2022INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservationcited by 28
- 2024Wavelet Diffusion Neural Operatorcited by 28
- 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
- 2022Learning Green's functions associated with time-dependent partial differential equationscited by 25
- 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
- 2022Approximate Bayesian Neural Operators: Uncertainty Quantification for Parametric PDEscited by 24
- 2024HAMLET: Graph Transformer Neural Operator for Partial Differential Equationscited by 24
- 2022Transformer Meets Boundary Value Inverse Problemscited by 22
- 2023A Neural PDE Solver with Temporal Stencil Modelingcited by 22
- 2023Multi-Resolution Active Learning of Fourier Neural Operatorscited by 22
- 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
- 2024BENO: Boundary-embedded Neural Operators for Elliptic PDEscited by 22
- 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
- 2022Transform Once: Efficient Operator Learning in Frequency Domaincited by 20
- 2022First De-Trend then Attend: Rethinking Attention for Time-Series Forecastingcited by 19
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
- 2024Invertible Fourier Neural Operators for Tackling Both Forward and Inverse Problemscited by 18
- 2024Spectral Invariant Learning for Dynamic Graphs under Distribution Shiftscited by 18
- 2024Nonlocal Attention Operator: Materializing Hidden Knowledge Towards Interpretable Physics Discoverycited by 18
- 2022NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulationcited by 17
50 most cited of 229 All 229 (JSON)
- 2026Scale-Split Neural Operator for Memory- and Data-Efficient 3D Turbulence Prediction30 Sep 2026
- 2026GeoWind2Plan: Mission-Time 3D Urban Wind Prediction for Energy-Efficient UAV Planning28 Sep 2026
- 2026Theory Guided and Interpretable Neural Operator Design for Partial Differential Equation Learning27 Sep 2026
- 2026Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency26 Sep 2026
- 2026Neuralized Multi-Wavelet Decomposition for Time Series Classification and Forecasting24 Sep 2026
- 2026MENO: Memory-Efficient Neural Operator23 Sep 2026
- 2026Cost-Accuracy Trade-offs: Neural Operator vs Classical Numerical Solver21 Sep 2026
- 2026DU-NO: A Parameter-Efficient Double U-Shaped Neural Operator for Phase-Resolving Wave Modeling10 Sep 2026
- 2026RINS: Residual-Image Neural Subspace Solvers for Large Sparse Linear Systems9 Sep 2026
- 2026Beyond Arbitrary Geometry: Topology Generalization In neural PDE Operators5 Sep 2026
- 2026Conformal Uncertainty Quantification Guarantees for Neural Operators28 Aug 2026
- 2026The Frame Kernel Method for Multiscale Operator Learning25 Aug 2026
38 more
- 2026From Points to Edges: Edge-Conditioned Spectral Operators for Physics-Sensitive PDE Learning7 Aug 2026
- 2026Geometry-aware Incremental Neural Operator for Long-Horizon PDE prediction31 Jul 2026
- 2026HERO: History-Enriched Rollout Training for Long-Horizon Autoregressive Neural Operators31 Jul 2026
- 2026Extending Fourier Neural Operators for Modeling Parameterized and Coupled PDEs26 Jul 2026
- 2026Adaptive Mamba Neural Operators20 Jul 2026
- 2026Hybrid Least Squares/Gradient Descent Methods for MIONets8 Jul 2026
- 2026Temperature Field Reconstruction of Tungsten Monoblock Divertor on EAST using Physics-aware Neural Operator Transformer30 Jun 2026
- 2026Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs26 Jun 2026
- 2026OperatorSHAP: Fast and Accurate Shapley Value Estimation for Neural Operators26 Jun 2026
- 2026Real vs. Complex Spectral Bases for Neural Operators: The Role of Green's Function Alignment23 Jun 2026
- 2026Physics-Preserving Latent Compression for Zero-Shot Resolution Transfer in 3D Turbulence19 Jun 2026
- 2026HAMNO: A Hierarchical Adaptive Multi-scale Neural Operator with Physics-Informed Learning for Dynamical Systems10 Jun 2026
- 2026Variation Spaces for Encoder--Decoder Neural Operators: Approximation and Generalization31 May 2026
- 2026Functional Attention: From Pairwise Affinities to Functional Correspondences29 May 2026
- 2026Striding Across Reynolds Numbers: Representation Geometry in Neural PDE Generalisation28 May 2026
- 2026IV-Net: A neural network for elliptic PDEs with random and highly varying coefficients24 May 2026
- 2026WLNO: Wavelet-Laplace Neural Operator for Solving Partial Differential Equations23 May 2026
- 2026ARC-STAR: Auditable Post-Hoc Correction for PDE Foundation Models21 May 2026
- 2026Discovering Physical Directions in Weight Space: Composing Neural PDE Experts14 May 2026
- 2026Neural Quantum Spectral Operator Learning for Solving Partial Differential Equations12 May 2026
- 2026Approximation Theory of Laplacian-Based Neural Operators for Reaction-Diffusion System12 May 2026
- 2026Generalization Error Bounds for Picard-Type Operator Learning in Nonlinear Parabolic PDEs11 May 2026
- 2026Bridging Spectral Operator Learning and U-Net Hierarchies: SpectraNet for Stable Autoregressive PDE Surrogates9 May 2026
- 2026CATO: Charted Attention for Neural PDE Operators9 May 2026
- 2026Mesh Field Theory: Port-Hamiltonian Formulation of Mesh-Based Physics1 May 2026
- 2026Derived Fields Preserve Fine-Scale Detail in Budgeted Neural Simulators31 Mar 2026
- 2026Tau-BNO: Brain Neural Operator for Tau Transport Model9 Mar 2026
- 2026From Complex Dynamics to DynFormer: Rethinking Transformers for PDEs3 Mar 2026
- 2026Physics-Consistent Diffusion for Efficient Fluid Super-Resolution via Multiscale Residual Correction25 Feb 2026
- 2026From Basis to Basis: Gaussian Particle Representation for Interpretable PDE Operators25 Feb 2026
- 2026SpectraKAN: Conditioning Spectral Operators5 Feb 2026
- 2026Multi-Scale Wavelet Transformers for Operator Learning of Dynamical Systems1 Feb 2026
- 2026Efficient Dilated Squeeze and Excitation Neural Operator for Differential Equations24 Jan 2026
- 2026Discontinuous Galerkin finite element operator network for solving non-smooth PDEs7 Jan 2026
- 2026RealPDEBench: A Benchmark for Complex Physical Systems with Real-World Data5 Jan 2026
- 2025PGOT: A Physics-Geometry Operator Transformer for Complex PDEs29 Dec 2025
- 2025An Inverse Scattering Inspired Fourier Neural Operator for Time-Dependent PDE Learning22 Dec 2025
- 2025Efficient Generative Transformer Operators For Million-Point PDEs4 Dec 2025
50 newest of 229 All 229 (JSON)
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
- 2024Wavelet Diffusion Neural Operatorcited by 28
- 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
- 2024DiffFluid: Plain Diffusion Models are Effective Predictors of Flow Dynamicscited by 4
- 2024Arbitrarily-Conditioned Multi-Functional Diffusion for Multi-Physics Emulationcited by 4
- 2025NeurOp-Diff:Continuous Remote Sensing Image Super-Resolution via Neural Operator Diffusioncited by 3
- 2024Multi-scale Conditional Generative Modeling for Microscopic Image Restorationcited by 2
- 2023DFU: scale-robust diffusion model for zero-shot super-resolution image generationcited by 1
- 2026Physics-Consistent Diffusion for Efficient Fluid Super-Resolution via Multiscale Residual Correctioncited by 0
- 2026Physics-Consistent Diffusion for Efficient Fluid Super-Resolution via Multiscale Residual Correction25 Feb 2026
- 2025Generative Latent Neural PDE Solver using Flow Matching28 Mar 2025
- 2025NeurOp-Diff:Continuous Remote Sensing Image Super-Resolution via Neural Operator Diffusion15 Jan 2025
- 2024Wavelet Diffusion Neural Operator6 Dec 2024
- 2024Arbitrarily-Conditioned Multi-Functional Diffusion for Multi-Physics Emulation17 Oct 2024
- 2024DiffFluid: Plain Diffusion Models are Effective Predictors of Flow Dynamics20 Sep 2024
- 2024Multi-scale Conditional Generative Modeling for Microscopic Image Restoration7 Jul 2024
- 2023DFU: scale-robust diffusion model for zero-shot super-resolution image generation30 Nov 2023
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation8 Mar 2023
- 2025Latent Mamba Operator for Partial Differential Equationscited by 8
- 2025GeoMaNO: Geometric Mamba Neural Operator for Partial Differential Equationscited by 2
- 2026Adaptive Mamba Neural Operatorscited by 0
- 2026Adaptive Mamba Neural Operators20 Jul 2026
- 2025Latent Mamba Operator for Partial Differential Equations25 May 2025
- 2025GeoMaNO: Geometric Mamba Neural Operator for Partial Differential Equations17 May 2025
- 2025Resolution-Aware Retrieval Augmented Zero-Shot Forecasting19 Oct 2025
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
- 2022Physics-Informed Deep Neural Operator Networkscited by 110
- 2022Learning Operators with Coupled Attentioncited by 88
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
12 most cited of 216 All 216 (JSON)
- 2026Scale-Split Neural Operator for Memory- and Data-Efficient 3D Turbulence Prediction30 Sep 2026
- 2026GeoWind2Plan: Mission-Time 3D Urban Wind Prediction for Energy-Efficient UAV Planning28 Sep 2026
- 2026Theory Guided and Interpretable Neural Operator Design for Partial Differential Equation Learning27 Sep 2026
- 2026Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency26 Sep 2026
- 2026Neuralized Multi-Wavelet Decomposition for Time Series Classification and Forecasting24 Sep 2026
- 2026MENO: Memory-Efficient Neural Operator23 Sep 2026
- 2026Cost-Accuracy Trade-offs: Neural Operator vs Classical Numerical Solver21 Sep 2026
- 2026DU-NO: A Parameter-Efficient Double U-Shaped Neural Operator for Phase-Resolving Wave Modeling10 Sep 2026
- 2026RINS: Residual-Image Neural Subspace Solvers for Large Sparse Linear Systems9 Sep 2026
- 2026Beyond Arbitrary Geometry: Topology Generalization In neural PDE Operators5 Sep 2026
- 2026Conformal Uncertainty Quantification Guarantees for Neural Operators28 Aug 2026
- 2026The Frame Kernel Method for Multiscale Operator Learning25 Aug 2026
12 newest of 216 All 216 (JSON)