mlsanityData to 7 Oct 2026

Structure-Preserving Operator Learning

arXiv 2410.01065 ↗First posted 1 Oct 2024cs.LG cs.CE cs.NAcited by 3

Not on the map. Why?

Abstract (arXiv)

Learning complex dynamics driven by partial differential equations directly from data holds great promise for fast and accurate simulations of complex physical systems. In most cases, this problem can be formulated as an operator learning task, where one aims to learn the operator representing the physics of interest, which entails discretization of the continuous system. However, preserving key continuous properties at the discrete level, such as boundary conditions, and addressing physical systems with complex geometries is challenging for most existing approaches. We introduce a family of operator learning architectures, structure-preserving operator networks (SPONs), that allows to preserve key mathematical and physical properties of the continuous system by leveraging finite element (FE) discretizations of the input-output spaces. SPONs are encode-process-decode architectures that are end-to-end differentiable, where the encoder and decoder follows from the discretizations of the input-output spaces. SPONs can operate on complex geometries, enforce certain boundary conditions exactly, and offer theoretical guarantees. Our framework provides a flexible way of devising structure-preserving architectures tailored to specific applications, and offers an explicit trade-off between performance and efficiency, all thanks to the FE discretization of the input-output spaces. Additionally, we introduce a multigrid-inspired SPON architecture that yields improved performance at higher efficiency. Finally, we release a software to automate the design and training of SPON architectures.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 32 of its 60 references that are in the map. First posted on arXiv 1 Oct 2024.

Builds on

32 of 60 references.

References · 32

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2017Inductive Representation Learning on Large Graphscited by 6,284
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  5. 2017Decoupled Weight Decay Regularizationcited by 1,722
  6. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  7. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  8. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  9. 2016Error bounds for approximations with deep ReLU networkscited by 567
  10. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  11. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  12. 2022Message Passing Neural PDE Solverscited by 368
20 more
  1. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  2. 2021Choose a Transformer: Fourier or Galerkincited by 333
  3. 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
  4. 2022MultiScale MeshGraphNetscited by 94
  5. 2024Operator Learning: Algorithms and Analysiscited by 84
  6. 2023A Mathematical Guide to Operator Learningcited by 74
  7. 2022Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modelingcited by 65
  8. 2023Representation Equivalent Neural Operators: a Framework for Alias-free Operator Learningcited by 57
  9. 2021Convergence Rates for Learning Linear Operators from Noisy Datacited by 55
  10. 2020Structure-preserving neural networkscited by 54
  11. 2021Data-driven discovery of Green's functions with human-understandable deep learningcited by 43
  12. 2023MgNO: Efficient Parameterization of Linear Operators via Multigridcited by 40
  13. 2021Learning elliptic partial differential equations with randomized linear algebracited by 29
  14. 2023Elliptic PDE learning is provably data-efficientcited by 26
  15. 2022Learning Green's functions associated with time-dependent partial differential equationscited by 25
  16. 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
  17. 2024Operator learning without the adjointcited by 8
  18. 2023Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equationscited by 6
  19. 2024Differentiable programming across the PDE and Machine Learning barriercited by 4
  20. 2023Physics-driven machine learning models coupling PyTorch and Firedrakecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.