mlsanityData to 7 Oct 2026

Localized Operator Learning with Adaptive Partition-of-Unity Mixture-of-Expert Networks

arXiv 2610.04708 ↗First posted 3 Oct 2026cs.LGcited by 0

On the map: Mixture-of-experts → MoE theory and gating functions also fits: Vision mixture-of-experts

Abstract (arXiv)

Operator learning methods such as DeepONets and FNOs often struggle with PDE families featuring sharp interfaces, heterogeneous coefficients, and localized multiscale structures. We introduce a partition-of-unity (POU) mixture-of-experts framework for localized operator learning, in which geometry-aware gating networks produce smooth spatial partitions which blend the contributions of local expert networks. Our main contribution is HiRefPOU, a residual-style hierarchical POU architecture for DeepONets that organizes localized representations through nested parent-child partitions while preserving global continuity. We also show that the same POU principle can be incorporated into Fourier Neural Operators to introduce spatial adaptivity without modifying the underlying spectral layers. On heterogeneous Darcy and reaction-diffusion benchmarks, HiRefPOU achieves substantially lower error than global DeepONet and static POU-MoE baselines, while the broader operator-learning experiments show that the benefits of localization depend on the PDE structure and the chosen neural-operator backbone. The learned partitions are interpretable and align with interfaces and regions of rapid solution variation. These results show that explicit geometric localization can improve both accuracy and interpretability in neural operator learning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE theory and gating functions, one of 12 directions in Mixture-of-experts. First posted on arXiv 3 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Ensemble and Mixture-of-Experts DeepONets For Operator Learning
  2. 2026NESTOR: A Nested MOE-based Neural Operator for Large-Scale PDE Pre-Training
  3. 2025Mixture-of-Experts Operator Transformer for Large-Scale PDE Pre-Training
  4. 2023Operator Learning Meets Numerical Analysis: Improving Neural Networks through Iterative Methods
  5. 2026Spectral Manifold Regularization for Stable and Modular Routing in Deep MoE Architectures
  6. 2026Latent-MoE: Domain-Aware Mixture-of-Experts for PDEs with Multi-Regime Physics
  7. 2024Neural Experts: Mixture of Experts for Implicit Neural Representations
  8. 2026The Ups and Downs of Backprop Weights