mlsanityData to 14 Oct 2026

From Diffusion to Reaction-Diffusion: A Dynamical-Systems View of Oversmoothing in Hypergraph Neural Networks

arXiv 2607.15773 ↗First posted 17 Jul 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Higher-order couplings enhance the expressive power of hypergraph neural networks (HGNNs), but they also intensify representation collapse in deep propagation due to strong multi-way feature mixing. This work investigates hypergraph oversmoothing from a dynamical-systems perspective and develops a reaction--diffusion framework for depth-resistant hypergraph learning. By defining hypergraph gradient and divergence operators, we interpret message passing as an incidence-level diffusion process. The analysis of pure diffusion shows that its continuous semiflow exponentially contracts the null-mode-free component of node representations and drives the Dirichlet energy to zero, revealing hypergraph oversmoothing as an intrinsic transverse-energy dissipation phenomenon. Motivated by this analysis, we propose Hypergraph Neural Reaction--Diffusion (HNRD), which introduces a reaction mechanism acting on the transverse component to compensate diffusion-induced dissipation and stabilize discriminative variations. We establish global well-posedness of the proposed dynamics and prove that the null-mode-free Dirichlet energy remains bounded away from zero. A forward-Euler discretization provides a practical HNRD layer with a stability condition for deep propagation. Experiments on benchmark and synthetic heterophilic hypergraphs demonstrate that HNRD consistently improves over representative hypergraph baselines. Depth, robustness, and efficiency analyses further show that HNRD preserves stable performance and nonzero Dirichlet energy under deep propagation and perturbations. These results provide a principled dynamical framework for designing deep hypergraph architectures that maintain higher-order expressiveness without representation collapse.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 48 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

32 of 48 references.

References · 32

  1. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  2. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
  3. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
  4. 2020Simple and Deep Graph Convolutional Networkscited by 860
  5. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
  6. 2018Hypergraph Neural Networkscited by 488
  7. 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
  8. 2020Towards Deeper Graph Neural Networkscited by 296
  9. 2021GRAND: Graph Neural Diffusioncited by 258
  10. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
  11. 2019Hypergraph Convolution and Hypergraph Attentioncited by 228
  12. 2018Contextual Stochastic Block Modelscited by 134
20 more
  1. 2021UniGNN: a Unified Framework for Graph and Hypergraph Neural Networkscited by 130
  2. 2021You are AllSet: A Multiset Function Framework for Hypergraph Neural Networkscited by 127
  3. 2020HNHN: Hypergraph Networks with Hyperedge Neuronscited by 109
  4. 2019Hyper-SAGNN: a self-attention based graph neural network for hypergraphscited by 69
  5. 2020Tackling Over-Smoothing for General Graph Convolutional Networkscited by 66
  6. 2022GREAD: Graph Neural Reaction-Diffusion Networkscited by 54
  7. 2021Generative hypergraph clustering: from blockmodels to modularitycited by 49
  8. 2022Equivariant Hypergraph Diffusion Neural Operatorscited by 47
  9. 2023Sheaf Hypergraph Networkscited by 34
  10. 2019Clustering in graphs and hypergraphs with categorical edge labelscited by 31
  11. 2022Preventing Over-Smoothing for Hypergraph Neural Networkscited by 20
  12. 2023From Hypergraph Energy Functions to Hypergraph Neural Networkscited by 18
  13. 2022Message Passing Neural Networks for Hypergraphscited by 13
  14. 2024Understanding Oversmoothing in Diffusion-Based GNNs From the Perspective of Operator Semigroup Theorycited by 8
  15. 2024Graph Neural Reaction Diffusion Modelscited by 6
  16. 2022Comprehensive Analysis of Over-smoothing in Graph Neural Networks from Markov Chains Perspectivecited by 3
  17. 2025Hypergraph Neural Sheaf Diffusion: A Symmetric Simplicial Set Framework for Higher-Order Learningcited by 3
  18. 2025Implicit Hypergraph Neural Networks: A Stable Framework for Higher-Order Relational Learning with Provable Guaranteescited by 3
  19. 2026Tackling Over-smoothing on Hypergraphs: A Ricci Flow-guided Neural Diffusion Approachcited by 3
  20. 2026Hypergraph Neural Diffusion: A PDE-Inspired Framework for Hypergraph Message Passingcited by 3

Built on by

Not cited yet.