SetONet: A Set-Based Operator Network for Solving PDEs with Variable-Input Sampling
Not on the map. Why?
Abstract (arXiv)
Most neural-operator surrogates for PDEs inherit from DeepONet-style formulations the requirement that the input function be sampled at a fixed, ordered set of sensors. This assumption limits applicability to problems with variable sensor layouts, missing data, point sources, and sample-based representations of densities. We propose SetONet, which addresses this gap by recasting the operator input as an unordered set of coordinate-value observations and encoding it with permutation-invariant aggregation inside a standard branch-trunk operator network while preserving the DeepONet synthesis mechanism and lightweight end-to-end training. A structured variant, SetONet-Key, aggregates sensor information through learnable query tokens and a position-only key pathway, thereby decoupling sampling geometry from sensor values. The method is assessed on four classical operator-learning benchmarks under fixed layouts, variable layouts, and evaluation-time sensor drop-off, and on four problems with inherently unstructured point-cloud inputs, including heat conduction with multiple point sources, advection-diffusion, phase-screen diffraction, and optimal transport problems. In parameter-matched studies, SetONet-Key achieves lower error than the DeepONet baseline on fixed-sensor benchmarks and remains reliable when layouts vary or sensors are dropped at evaluation. Comparisons across pooling rules show that attention-based aggregation is typically more robust than mean or sum pooling. On the point-cloud problems, SetONet operates directly on the native input representation, without rasterization or multi-stage preprocessing, and outperforms the larger VIDON baseline.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 51 references that are in the map. First posted on arXiv 7 May 2025.
Builds on
32 of 51 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2017Deep Setscited by 1,394
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
20 more
- 2023Stabilizing Transformer Training by Preventing Attention Entropy Collapsecited by 154
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
- 2022Learning Operators with Coupled Attentioncited by 88
- 2022Deep transfer operator learning for partial differential equations under conditional shiftcited by 83
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
- 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 76
- 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
- 2023Improved Operator Learning by Orthogonal Attentioncited by 58
- 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEscited by 58
- 2023Super-Resolution Neural Operatorcited by 48
- 2023Multi-stage Neural Networks: Function Approximator of Machine Precisioncited by 48
- 2022Mitigating spectral bias for the multiscale operator learningcited by 43
- 2024Transformers as Neural Operators for Solutions of Differential Equations with Finite Regularitycited by 33
- 2022Variable-Input Deep Operator Networkscited by 24
- 2024Basis-to-Basis Operator Learning Using Function Encoderscited by 17
- 2021Using neural networks to solve the 2D Poisson equation for electric field computation in plasma fluid simulationscited by 10
- 2024Gaussian Plane-Wave Neural Operator for Electron Density Estimationcited by 8
- 2024Learning time-dependent PDE via graph neural networks and deep operator network for robust accuracy on irregular gridscited by 7
- 2024Efficient Training of Deep Neural Operator Networks via Randomized Samplingcited by 6
- 2024Score Neural Operator: A Generative Model for Learning and Generalizing Across Multiple Probability Distributionscited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Learning Generalizable Neural Operators for Inverse Problems19 Dec 2025