mlsanityData to 14 Oct 2026

Reference Neural Operators: Learning the Smooth Dependence of Solutions of PDEs on Geometric Deformations

arXiv 2405.17509 ↗First posted 27 May 2024cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a sufficiently accurate neural operator. However, for many industrial applications, e.g., engineering design optimization, it can be prohibitive to satisfy the requirement since even a single simulation may take hours or days of computation. To address this issue, we propose reference neural operators (RNO), a novel way of implementing neural operators, i.e., to learn the smooth dependence of solutions on geometric deformations. Specifically, given a reference solution, RNO can predict solutions corresponding to arbitrary deformations of the referred geometry. This approach turns out to be much more data efficient. Through extensive experiments, we show that RNO can learn the dependence across various types and different numbers of geometry objects with relatively small datasets. RNO outperforms baseline models in accuracy by a large lead and achieves up to 80% error reduction.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 31 of its 42 references that are in the map. First posted on arXiv 27 May 2024.

Builds on

31 of 42 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  5. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  6. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  7. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  8. 2015Cyclical Learning Rates for Training Neural Networkscited by 629
  9. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  10. 2021Machine learning accelerated computational fluid dynamicscited by 471
  11. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
  12. 2021Random Feature Attentioncited by 354
19 more
  1. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
  2. 2021Do Transformers Really Perform Bad for Graph Representation?cited by 320
  3. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
  4. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
  5. 2020Model Reduction and Neural Networks for Parametric PDEscited by 258
  6. 2022MIONet: Learning multiple-input operators via tensor productcited by 181
  7. 2016Accelerating Eulerian Fluid Simulation With Convolutional Networkscited by 130
  8. 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
  9. 2023Rethinking the Expressive Power of GNNs via Graph Biconnectivitycited by 119
  10. 2021Position Information in Transformers: An Overviewcited by 103
  11. 2021Improved architectures and training algorithms for deep operator networkscited by 86
  12. 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 84
  13. 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
  14. 2023Neural Inverse Operators for Solving PDE Inverse Problemscited by 65
  15. 2020A physics-informed operator regression framework for extracting data-driven continuum modelscited by 60
  16. 2020CFDNet: a deep learning-based accelerator for fluid simulationscited by 40
  17. 2020DA-Transformer: Distance-aware Transformercited by 23
  18. 2023Deep neural operators can serve as accurate surrogates for shape optimization: A case study for airfoilscited by 19
  19. 2023NUNO: A General Framework for Learning Parametric PDEs with Non-Uniform Datacited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 1.

5 papers.