mlsanityData to 14 Oct 2026

Multi-Head Residual-Gated DeepONet for Coherent Nonlinear Wave Dynamics

arXiv 2604.11972 ↗First posted 13 Apr 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Coherent nonlinear wave dynamics are often strongly shaped by a compact set of physically meaningful descriptors of the initial state. Traditional neural operators typically treat the input-output mapping as a largely black-box high-dimensional regression problem, without explicitly exploiting this structured physical context. Common feature-integration strategies usually rely on direct concatenation or FiLM-style affine modulation in hidden latent spaces. Here we introduce a different paradigm, loosely inspired by the complementary roles of state evolution and physically meaningful observables in quantum mechanics: the wave field is learned through a standard DeepONet state pathway, while compact physical descriptors follow a parallel conditioning pathway and act as residual modulation factors on the state prediction. Based on this idea, we develop a Multi-Head Residual-Gated DeepONet (MH-RG), which combines a pre-branch residual modulator, a branch residual gate, and a trunk residual gate with a low-rank multi-head mechanism to capture multiple complementary conditioned response patterns without prohibitive parameter growth. We evaluate the framework on representative benchmarks including highly nonlinear conservative wave dynamics and dissipative trapped dynamics and further perform detailed mechanistic analyses of the learned multi-head gating behavior. Compared with feature-augmented baselines, MH-RG DeepONet achieves consistently lower error while better preserving phase coherence and the fidelity of physically relevant dynamical quantities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

12 of 33 references.

References · 12

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  4. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
  5. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
  6. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
  7. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
  8. 2022Nonlinear Reconstruction for Operator Learning of PDEs with Discontinuitiescited by 30
  9. 2022INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservationcited by 28
  10. 2023Deciphering and integrating invariants for neural operator learning with various physical mechanismscited by 15
  11. 2025Probabilistic Predictions of Process-Induced Deformation in Carbon/Epoxy Composites Using a Deep Operator Networkcited by 3
  12. 2024Long-time Integration of Nonlinear Wave Equations with Neural Operatorscited by 1

Built on by

Not cited yet.