mlsanityData to 14 Oct 2026

Frequency Bias and OOD Generalization in Neural Operators under a Variable-Coefficient Wave Equation

arXiv 2605.12997 ↗First posted 13 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural operators learn to map initial conditions to the terminal solution of partial differential equations (PDEs), providing a surrogate for the full operator mapping. This enables rapid prediction across different input configurations. While recent neural operator architectures have demonstrated strong performance on diverse PDE tasks, their behavior under structured distribution shifts remains insufficiently understood. To investigate this, we study operator learning in a wave propagation setting governed by a one-dimensional variable-coefficient wave equation, using two representative architectures, the Fourier Neural Operator (FNO) and the Deep Operator Network (DeepONet). To examine their generalization under distribution shifts, we consider structured out-of-distribution (OOD) settings that independently vary input frequency and coefficient smoothness. The results show that under smoothness shifts, both models maintain stable performance, with FNO achieving lower error. In contrast, under frequency shifts, FNO exhibits a sharp increase in error under unseen high-frequency inputs, whereas DeepONet shows milder degradation despite higher overall error. Our analysis reveals that these differences arise from how each architecture represents and responds to variations in frequency structure. Together, these findings highlight a fundamental gap between strong in-distribution performance and generalization under distribution shifts in operator learning, underscoring the role of architectural representation bias in developing more reliable neural operators for physics-based PDE simulations beyond the training distribution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 35 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

15 of 35 references.

References · 15

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  3. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  4. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  5. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  6. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
  7. 2022Message Passing Neural PDE Solverscited by 386
  8. 2021Choose a Transformer: Fourier or Galerkincited by 343
  9. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  10. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
  11. 2020Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systemscited by 164
  12. 2022Deep transfer operator learning for partial differential equations under conditional shiftcited by 83
3 more
  1. 2022Overview frequency principle/spectral bias in deep learningcited by 69
  2. 2018Stochastic seismic waveform inversion using generative adversarial networks as a geological priorcited by 48
  3. 2021Learning Dissipative Dynamics in Chaotic Systemscited by 42

Built on by

Not cited yet.