mlsanityData to 14 Oct 2026

DRIFT-Net: A Spectral--Coupled Neural Operator for PDEs Learning

arXiv 2509.24868 ↗First posted 29 Sep 2025cs.LG physics.comp-phcited by 2

Not on the map. Why?

Abstract (arXiv)

Learning PDE dynamics with neural solvers can significantly improve wall-clock efficiency and accuracy compared with classical numerical solvers. In recent years, foundation models for PDEs have largely adopted multi-scale windowed self-attention, with the scOT backbone in Poseidon serving as a representative example. However, because of their locality, truly globally consistent spectral coupling can only be propagated gradually through deep stacking and window shifting. This weakens global coupling and leads to error accumulation and drift during closed-loop rollouts. To address this, we propose DRIFT-Net. It employs a dual-branch design comprising a spectral branch and an image branch. The spectral branch is responsible for capturing global, large-scale low-frequency information, whereas the image branch focuses on local details and nonstationary structures. Specifically, we first perform controlled, lightweight mixing within the low-frequency range. Then we fuse the spectral and image paths at each layer via bandwise weighting, which avoids the width inflation and training instability caused by naive concatenation. The fused result is transformed back into the spatial domain and added to the image branch, thereby preserving both global structure and high-frequency details across scales. Compared with strong attention-based baselines, DRIFT-Net achieves lower error and higher throughput with fewer parameters under identical training settings and budget. On Navier--Stokes benchmarks, the relative L1 error is reduced by 7%--54%, the parameter count decreases by about 15%, and the throughput remains higher than scOT. Ablation studies and theoretical analyses further demonstrate the stability and effectiveness of this design. The code is available at https://github.com/cruiseresearchgroup/DRIFT-Net.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 31 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

25 of 31 references.

References · 25

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  5. 2018On the Spectral Bias of Neural Networkscited by 1,341
  6. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  7. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
  8. 2021Neural Operator: Learning Maps Between Function Spacescited by 414
  9. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
  10. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
  11. 2021Global Filter Networks for Image Classificationcited by 260
  12. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
13 more
  1. 2022U-NO: U-shaped Neural Operatorscited by 230
  2. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
  3. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
  4. 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
  5. 2024Poseidon: Efficient Foundation Models for PDEscited by 200
  6. 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 151
  7. 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 131
  8. 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 101
  9. 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 98
  10. 2021Fourier Space Losses for Efficient Perceptual Image Super-Resolutioncited by 73
  11. 2024Neural Operators with Localized Integral and Differential Kernelscited by 62
  12. 2024APEBench: A Benchmark for Autoregressive Neural Emulators of PDEscited by 60
  13. 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEscited by 59

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.