mlsanityData to 7 Oct 2026

A Resolution Independent Neural Operator

arXiv 2407.13010 ↗First posted 17 Jul 2024cs.LG cs.CE physics.comp-phcited by 0

Not on the map. Why?

Abstract (arXiv)

The Deep Operator Network (DeepONet) is a powerful neural operator architecture that uses two neural networks to map between infinite-dimensional function spaces. This architecture allows for the evaluation of the solution field at any location within the domain but requires input functions to be discretized at identical locations, limiting practical applications. We introduce a general framework for operator learning from input-output data with arbitrary sensor locations and counts. This begins by introducing a resolution-independent DeepONet (RI-DeepONet), which handles input functions discretized arbitrarily but sufficiently finely. To achieve this, we propose two dictionary learning algorithms that adaptively learn continuous basis functions, parameterized as implicit neural representations (INRs), from correlated signals on arbitrary point clouds. These basis functions project input function data onto a finite-dimensional embedding space, making it compatible with DeepONet without architectural changes. We specifically use sinusoidal representation networks (SIRENs) as trainable INR basis functions. Similarly, the dictionary learning algorithms identify basis functions for output data, defining a new neural operator architecture: the Resolution Independent Neural Operator (RINO). In RINO, the operator learning task reduces to mapping coefficients of input basis functions to output basis functions. We demonstrate RINO's robustness and applicability in handling arbitrarily sampled input and output functions during both training and inference through several numerical examples.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 112 references that are in the map. First posted on arXiv 17 Jul 2024.

Builds on

43 of 112 references.

References · 43

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Layer Normalizationcited by 5,579
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  6. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  8. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  9. 2019Root Mean Square Layer Normalizationcited by 1,425
  10. 2018On the Spectral Bias of Neural Networkscited by 1,321
  11. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  12. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
31 more
  1. 2021Neural Fields in Visual Computing and Beyondcited by 539
  2. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  3. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  4. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  5. 2020Model Reduction and Neural Networks for Parametric PDEscited by 257
  6. 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 240
  7. 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
  8. 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
  9. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  10. 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
  11. 2022NOMAD: Nonlinear Manifold Decoders for Operator Learningcited by 81
  12. 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 80
  13. 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
  14. 2023Representation Equivalent Neural Operators: a Framework for Alias-free Operator Learningcited by 57
  15. 2020Sparse Polynomial Chaos Expansions: Literature Survey and Benchmarkcited by 44
  16. 2022On the influence of over-parameterization in manifold based surrogates and deep neural operatorscited by 29
  17. 2018Data-driven polynomial chaos expansion for machine learning regressioncited by 25
  18. 2022A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problemscited by 20
  19. 2020LOCA: LOcal Conformal Autoencoder for standardized data coordinatescited by 19
  20. 2024Zero-Shot Reinforcement Learning via Function Encoderscited by 17
  21. 2024Physics-constrained polynomial chaos expansion for scientific machine learning and uncertainty quantificationcited by 17
  22. 2021Manifold learning-based polynomial chaos expansions for high-dimensional surrogate modelscited by 16
  23. 2023Physics-Informed Polynomial Chaos Expansionscited by 15
  24. 2023Sound propagation in realistic interactive 3D scenes with parameterized sources using deep neural operatorscited by 12
  25. 2023UQpy v4.1: Uncertainty Quantification with Pythoncited by 10
  26. 2024GFN: A graph feedforward network for resolution-invariant reduced operator learning in multifidelity applicationscited by 10
  27. 2018Compressive sensing adaptation for polynomial chaos expansionscited by 9
  28. 2023Developing a cost-effective emulator for groundwater flow modeling using deep neural operatorscited by 8
  29. 2024Polynomial Chaos Expansions on Principal Geodesic Grassmannian Submanifolds for Surrogate Modeling and Uncertainty Quantificationcited by 6
  30. 2024Resolution invariant deep operator network for PDEs with complex geometriescited by 4
  31. 2024On Fractional Moment Estimation from Polynomial Chaos Expansioncited by 4

Built on by

Not cited yet.