mlsanityData to 14 Oct 2026

Factorized Neural Operators Decompose Dynamic and Persistent Responses

arXiv 2606.16900 ↗First posted 15 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Physical systems often exhibit heterogeneous mechanisms, where rapidly evolving dynamics coexist with persistent structures. Capturing such multiscale physical behavior remains challenging for existing neural operators, which typically rely on single dominant inductive bias and therefore couple distinct physical responses into a shared representation. We introduce the Unified Green's Function Framework across domains and propose the Factorized Neural Operators (FaNO), which decompose spectral representations into equivariant-inspired dynamic responses and invariant-inspired persistent responses, leading to better interpretability and generalization. Mechanistically, we show that the two operator branches spontaneously specialize into distinct physical roles that remain consistent across scales and domains: the equivariant-inspired branch captures rapidly varying transient dynamics, whereas the invariant-inspired branch extracts coherent persistent structures. This factorized mechanism of FaNO consistently improves prediction accuracy, parameter efficiency and cross-scale generalization across physical systems and domains. In particular, it maintains consistent predictions under long-horizon autoregressive rollout, cross-resolution extrapolation and physical-regime shifts. These findings suggest that scalable physical modeling may benefit from moving beyond single-inductive-bias formulations toward factorized operator representations that better reflect the heterogeneous organization of physical systems, accelerating the reliable deployment of machine learning for scientific computing and discovery.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 72 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

48 of 72 references.

References · 48

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  5. 2016Group Equivariant Convolutional Networkscited by 1,165
  6. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  7. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  8. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  9. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  10. 2018Spherical CNNscited by 456
  11. 2019General E(2)-Equivariant Steerable CNNscited by 446
  12. 2021Neural Operator: Learning Maps Between Function Spacescited by 414
36 more
  1. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
  2. 2021Choose a Transformer: Fourier or Galerkincited by 343
  3. 2023ClimaX: A foundation model for weather and climatecited by 337
  4. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
  5. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  6. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
  7. 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 295
  8. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
  9. 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 267
  10. 2021Factorized Fourier Neural Operatorscited by 249
  11. 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
  12. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
  13. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
  14. 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 164
  15. 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 131
  16. 2019Deep Scale-spaces: Equivariance Over Scalecited by 114
  17. 2022Physics-Informed Deep Neural Operator Networkscited by 113
  18. 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 97
  19. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 89
  20. 2021Residual Pathway Priors for Soft Equivariance Constraintscited by 75
  21. 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
  22. 2019Effective Rotation-invariant Point CNN with Spherical Harmonics kernelscited by 57
  23. 2022Geometrically Equivariant Graph Neural Networks: A Surveycited by 56
  24. 2024Geom-DeepONet: A Point-cloud-based Deep Operator Network for Field Predictions on 3D Parameterized Geometriescited by 47
  25. 2023Domain Agnostic Fourier Neural Operatorscited by 38
  26. 2023Novel DeepONet architecture to predict stresses in elastoplastic structures with variable complex geometries and loadscited by 33
  27. 2020Machine learning in spectral domaincited by 20
  28. 2024Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operatorscited by 18
  29. 2024Harnessing Scale and Physics: A Multi-Graph Neural Operator Framework for PDEs on Arbitrary Geometriescited by 16
  30. 2025Fourier Neural Operators Explained: A Practical Perspectivecited by 16
  31. 2022Equivariance and Invariance Inductive Bias for Learning from Insufficient Datacited by 14
  32. 2022Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solverscited by 12
  33. 2024R2Det: Exploring Relaxed Rotation Equivariance in 2D object detectioncited by 4
  34. 2024Relaxed Rotational Equivariance via G-Biases in Visioncited by 4
  35. 2025Generalized Spherical Neural Operators: Green's Function Formulationcited by 3
  36. 2025Geometric Laplace Neural Operatorcited by 2

Built on by

Not cited yet.