U-HNO: A U-shaped Hybrid Neural Operator with Sparse-Point Adaptive Routing for Non-stationary PDE Dynamics
Not on the map. Why?
Abstract (arXiv)
Solutions to many partial differential equations (PDEs) display coexisting smooth global transport and localized sharp features within a single trajectory: shock fronts, thin interfaces, and concentrated high-frequency content sit on top of slowly varying backgrounds. This poses a challenge for neural operators: Fourier-based architectures mix nonlocal interactions efficiently but tend to under-resolve localized non-smooth features, whereas spatially local architectures recover fine detail at the cost of long-range propagation and rollout stability. Existing hybrid operators paper over this tension with a fixed, spatially uniform fusion that forces the same trade-off everywhere. We propose U-HNO, a U-shaped hybrid neural operator whose central design is Sparse-Point Adaptive Routing (SPAR): at every spatial location, a per-pixel hard mask selects whether the global Fourier branch or the local multi-scale Gaussian branch should dominate, and the sparsity ratio is a function of the local contrast of the routing signal, so smooth and shock-aligned regions receive different mixtures of global and local computation. SPAR is embedded in a hierarchical encoder-bottleneck-decoder backbone with skip connections so that the dual branches and the gate operate at every resolution. Training combines pointwise supervision with a finite-difference H^1 gradient term and a band-wise spectral consistency regularizer. Across benchmarks spanning 1D Burgers, Kuramoto-Sivashinsky, KdV, 2D advection, Allen-Cahn, Navier-Stokes, Darcy flow, and 3D transonic compressible Navier-Stokes from PDEBench, U-HNO achieves state-of-the-art rollout accuracy on the majority of tasks in both relative L^2 and H^1 metrics, with the largest gains on problems dominated by sharp localized features. Ablations show that removing any single component substantially degrades rollout error.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 29 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
13 of 29 references.
References · 13
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2022Message Passing Neural PDE Solverscited by 386
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2021Factorized Fourier Neural Operatorscited by 249
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
- 2022U-NO: U-shaped Neural Operatorscited by 230
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 78
- 2025Enhancing Fourier Neural Operators with Local Spatial Featurescited by 10
Built on by
Not cited yet.