Reference Neural Operators: Learning the Smooth Dependence of Solutions of PDEs on Geometric Deformations
Not on the map. Why?
Abstract (arXiv)
For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a sufficiently accurate neural operator. However, for many industrial applications, e.g., engineering design optimization, it can be prohibitive to satisfy the requirement since even a single simulation may take hours or days of computation. To address this issue, we propose reference neural operators (RNO), a novel way of implementing neural operators, i.e., to learn the smooth dependence of solutions on geometric deformations. Specifically, given a reference solution, RNO can predict solutions corresponding to arbitrary deformations of the referred geometry. This approach turns out to be much more data efficient. Through extensive experiments, we show that RNO can learn the dependence across various types and different numbers of geometry objects with relatively small datasets. RNO outperforms baseline models in accuracy by a large lead and achieves up to 80% error reduction.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 31 of its 42 references that are in the map. First posted on arXiv 27 May 2024.
Builds on
31 of 42 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2015Cyclical Learning Rates for Training Neural Networkscited by 629
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
- 2021Machine learning accelerated computational fluid dynamicscited by 471
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
- 2021Random Feature Attentioncited by 354
19 more
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
- 2021Do Transformers Really Perform Bad for Graph Representation?cited by 320
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
- 2020Model Reduction and Neural Networks for Parametric PDEscited by 258
- 2022MIONet: Learning multiple-input operators via tensor productcited by 181
- 2016Accelerating Eulerian Fluid Simulation With Convolutional Networkscited by 130
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
- 2023Rethinking the Expressive Power of GNNs via Graph Biconnectivitycited by 119
- 2021Position Information in Transformers: An Overviewcited by 103
- 2021Improved architectures and training algorithms for deep operator networkscited by 86
- 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 84
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
- 2023Neural Inverse Operators for Solving PDE Inverse Problemscited by 65
- 2020A physics-informed operator regression framework for extracting data-driven continuum modelscited by 60
- 2020CFDNet: a deep learning-based accelerator for fluid simulationscited by 40
- 2020DA-Transformer: Distance-aware Transformercited by 23
- 2023Deep neural operators can serve as accurate surrogates for shape optimization: A case study for airfoilscited by 19
- 2023NUNO: A General Framework for Learning Parametric PDEs with Non-Uniform Datacited by 15
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 1.
5 papers.
- 2024Strategies for Pretraining Neural Operatorscited by 14
- 2024MelissaDL x Breed: Towards Data-Efficient On-line Supervised Training of Multi-parametric Surrogates with Active Learningcited by 1
- 2025Accelerating PDE-Constrained Optimization by the Derivative of Neural Operatorscited by 1
- 2025From Cheap Geometry to Expensive Physics: Elevating Neural Operators via Latent Shape Pretrainingcited by 1
- 2026Neural Shape Operator Surrogates -- Expression Rate Boundscited by 1
- 2026Neural Shape Operator Surrogates -- Expression Rate Bounds20 Apr 2026
- 2025From Cheap Geometry to Expensive Physics: Elevating Neural Operators via Latent Shape Pretraining30 Sep 2025
- 2025Accelerating PDE-Constrained Optimization by the Derivative of Neural Operators16 Jun 2025
- 2024MelissaDL x Breed: Towards Data-Efficient On-line Supervised Training of Multi-parametric Surrogates with Active Learning8 Oct 2024
- 2024Strategies for Pretraining Neural Operators12 Jun 2024