DimINO: Dimension-Informed Neural Operator Learning
Not on the map. Why?
Abstract (arXiv)
In computational physics, a longstanding challenge lies in finding numerical solutions to partial differential equations (PDEs). Recently, research attention has increasingly focused on Neural Operator methods, which are notable for their ability to approximate operators-mappings between functions. Although neural operators benefit from a universal approximation theorem, achieving reliable error bounds often necessitates large model architectures, such as deep stacks of Fourier layers. This raises a natural question: Can we design lightweight models without sacrificing generalization? To address this, we introduce DimINO (Dimension-Informed Neural Operators), a framework inspired by dimensional analysis. DimINO incorporates two key components, DimNorm and a redimensionalization operation, which can be seamlessly integrated into existing neural operator architectures. These components enhance the model's ability to generalize across datasets with varying physical parameters. Theoretically, we establish a universal approximation theorem for DimINO and prove that it satisfies a critical property we term Similar Transformation Invariance (STI). Empirically, DimINO achieves up to 76.3% performance gain on PDE datasets while exhibiting clear evidence of the STI property.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 25 references that are in the map. First posted on arXiv 8 Oct 2024.
Builds on
13 of 25 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Layer Normalizationcited by 5,669
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 583
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2021Choose a Transformer: Fourier or Galerkincited by 343
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 89
1 more
Built on by
Not cited yet.