HiLNO: A Hierarchical Latent Neural Operator with Multi-Scale Supervision for PDEs on General Geometries
Not on the map. Why?
Abstract (arXiv)
Latent neural operators improve the efficiency of operator learning for partial differential equations (PDEs) by performing the main computation on compact latent representations. However, directly compressing the input representation to obtain such compact representations may discard solution-relevant spatial information, especially for PDE solutions with multiscale structures. To address this problem, we propose HiLNO, a hierarchical latent neural operator that constructs a fine-to-coarse-to-fine latent space and further introduces multi-scale supervision (MSS) and anisotropic Gaussian attention. The hierarchy mitigates potential information loss during compression, while MSS aligns intermediate predictions with downsampled target fields, encouraging solution-relevant structures to be captured across multiple spatial scales. Anisotropic Gaussian attention enables feature transfer across the hierarchy, making HiLNO applicable to general geometries. Experiments on representative PDE benchmarks and a large-scale automotive aerodynamics task show that HiLNO achieves competitive predictive accuracy, while reducing the parameter count by an average of 84.4% and FLOPs by an average of 69.2% compared with LinearNO. Additional experiments demonstrate effective generalization to unseen spatial resolutions. Code is available at https://github.com/JcLimath/HiLNO.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
31 of 45 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2019Graph U-Netscited by 492
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
19 more
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
- 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 97
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 89
- 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 80
- 2023Improved Operator Learning by Orthogonal Attentioncited by 61
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 51
- 2022Mitigating spectral bias for the multiscale operator learningcited by 44
- 2023MgNO: Efficient Parameterization of Linear Operators via Multigridcited by 40
- 2024AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fieldscited by 39
- 2022Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEscited by 25
- 2023Inducing Point Operator Transformer: A Flexible and Scalable Architecture for Solving PDEscited by 18
- 2024Positional Knowledge is All You Need: Position-induced Transformer (PiT) for Operator Learningcited by 17
- 2025Transolver is a Linear Transformer: Revisiting Physics-Attention through the Lens of Linear Attentioncited by 13
- 2025Physics-Informed Latent Neural Operator for Real-time Predictions of time-dependent parametric PDEscited by 9
- 2025GPSToken: Gaussian Parameterized Spatially-adaptive Tokenization for Image Representation and Generationcited by 9
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
- 2025CALM-PDE: Continuous and Adaptive Convolutions for Latent Space Modeling of Time-dependent PDEscited by 8
- 2025SAOT: An Enhanced Locality-Aware Spectral Transformer for Solving PDEscited by 6
Built on by
Not cited yet.