mlsanityData to 7 Oct 2026

Non-equispaced Fourier Neural Solvers for PDEs

arXiv 2212.04689 ↗First posted 9 Dec 2022cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Solving partial differential equations is difficult. Recently proposed neural resolution-invariant models, despite their effectiveness and efficiency, usually require equispaced spatial points of data. However, sampling in spatial domain is sometimes inevitably non-equispaced in real-world systems, limiting their applicability. In this paper, we propose a Non-equispaced Fourier PDE Solver (textscNFS) with adaptive interpolation on resampled equispaced points and a variant of Fourier Neural Operators as its components. Experimental results on complex PDEs demonstrate its advantages in accuracy and efficiency. Compared with the spatially-equispaced benchmark methods, it achieves superior performance with 42.85% improvements on MAE, and is able to handle non-equispaced data with a tiny loss of accuracy. Besides, to our best knowledge, textscNFS is the first ML-based method with mesh invariant inference ability to successfully model turbulent flows in non-equispaced scenarios, with a minor deviation of the error on unseen spatial points.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 9 Dec 2022.

Builds on

38 of 52 references.

References · 38

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2016Layer Normalizationcited by 5,579
  4. 2018Neural Ordinary Differential Equationscited by 3,733
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  7. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  8. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  9. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  10. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  11. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  12. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
26 more
  1. 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
  2. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  3. 2021Intriguing Properties of Vision Transformerscited by 446
  4. 2021Neural Operator: Learning Maps Between Function Spacescited by 413
  5. 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 411
  6. 2022Message Passing Neural PDE Solverscited by 368
  7. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  8. 2022How Do Vision Transformers Work?cited by 305
  9. 2016Structured Sequence Modeling with Graph Convolutional Recurrent Networkscited by 273
  10. 2015Diffusion-Convolutional Neural Networkscited by 268
  11. 2020Model Reduction and Neural Networks for Parametric PDEscited by 257
  12. 2021Global Filter Networks for Image Classificationcited by 257
  13. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  14. 2019Latent ODEs for Irregularly-Sampled Time Seriescited by 182
  15. 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
  16. 2021Towards Robust Vision Transformercited by 137
  17. 2021Are Convolutional Neural Networks or Transformers more like human vision?cited by 109
  18. 2019Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stabilitycited by 53
  19. 2020Learning continuous-time PDEs from sparse data with graph neural networkscited by 53
  20. 2020EikoNet: Solving the Eikonal equation with Deep Neural Networkscited by 50
  21. 2019ODE2VAE: Deep generative second order ODEs with Bayesian neural networkscited by 36
  22. 2019Convolutional Self-Attention Networkscited by 32
  23. 2019Unsupervised Deep Learning Algorithm for PDE-based Forward and Inverse Problemscited by 31
  24. 2021Conditional Local Convolution for Spatio-temporal Meteorological Forecastingcited by 30
  25. 2021Transformers are Deep Infinite-Dimensional Non-Mercer Binary Kernel Machinescited by 22
  26. 2022STONet: A Neural-Operator-Driven Spatio-temporal Networkcited by 1

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 5; 2025: 1.

8 papers.