mlsanityData to 7 Oct 2026

SetONet: A Set-Based Operator Network for Solving PDEs with Variable-Input Sampling

arXiv 2505.04738 ↗First posted 7 May 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Most neural-operator surrogates for PDEs inherit from DeepONet-style formulations the requirement that the input function be sampled at a fixed, ordered set of sensors. This assumption limits applicability to problems with variable sensor layouts, missing data, point sources, and sample-based representations of densities. We propose SetONet, which addresses this gap by recasting the operator input as an unordered set of coordinate-value observations and encoding it with permutation-invariant aggregation inside a standard branch-trunk operator network while preserving the DeepONet synthesis mechanism and lightweight end-to-end training. A structured variant, SetONet-Key, aggregates sensor information through learnable query tokens and a position-only key pathway, thereby decoupling sampling geometry from sensor values. The method is assessed on four classical operator-learning benchmarks under fixed layouts, variable layouts, and evaluation-time sensor drop-off, and on four problems with inherently unstructured point-cloud inputs, including heat conduction with multiple point sources, advection-diffusion, phase-screen diffraction, and optimal transport problems. In parameter-matched studies, SetONet-Key achieves lower error than the DeepONet baseline on fixed-sensor benchmarks and remains reliable when layouts vary or sensors are dropped at evaluation. Comparisons across pooling rules show that attention-based aggregation is typically more robust than mean or sum pooling. On the point-cloud problems, SetONet operates directly on the native input representation, without rasterization or multi-stage preprocessing, and outperforms the larger VIDON baseline.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 51 references that are in the map. First posted on arXiv 7 May 2025.

Builds on

32 of 51 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  5. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  6. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  7. 2017Deep Setscited by 1,394
  8. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  9. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  10. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  11. 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
  12. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
20 more
  1. 2023Stabilizing Transformer Training by Preventing Attention Entropy Collapsecited by 154
  2. 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
  3. 2022Learning Operators with Coupled Attentioncited by 88
  4. 2022Deep transfer operator learning for partial differential equations under conditional shiftcited by 83
  5. 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
  6. 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 76
  7. 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
  8. 2023Improved Operator Learning by Orthogonal Attentioncited by 58
  9. 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEscited by 58
  10. 2023Super-Resolution Neural Operatorcited by 48
  11. 2023Multi-stage Neural Networks: Function Approximator of Machine Precisioncited by 48
  12. 2022Mitigating spectral bias for the multiscale operator learningcited by 43
  13. 2024Transformers as Neural Operators for Solutions of Differential Equations with Finite Regularitycited by 33
  14. 2022Variable-Input Deep Operator Networkscited by 24
  15. 2024Basis-to-Basis Operator Learning Using Function Encoderscited by 17
  16. 2021Using neural networks to solve the 2D Poisson equation for electric field computation in plasma fluid simulationscited by 10
  17. 2024Gaussian Plane-Wave Neural Operator for Electron Density Estimationcited by 8
  18. 2024Learning time-dependent PDE via graph neural networks and deep operator network for robust accuracy on irregular gridscited by 7
  19. 2024Efficient Training of Deep Neural Operator Networks via Randomized Samplingcited by 6
  20. 2024Score Neural Operator: A Generative Model for Learning and Generalizing Across Multiple Probability Distributionscited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.