Hypergraph Neural Diffusion: A PDE-Inspired Framework for Hypergraph Message Passing
Not on the map. Why?
Abstract (arXiv)
Hypergraph neural networks (HGNNs) have shown remarkable potential in modeling high-order relationships that naturally arise in many real-world data domains. However, existing HGNNs often suffer from shallow propagation, oversmoothing, and limited adaptability to complex hypergraph structures. In this paper, we propose Hypergraph Neural Diffusion (HND), a novel framework that unifies nonlinear diffusion equations with neural message passing on hypergraphs. HND is grounded in a continuous-time hypergraph diffusion equation, formulated via hypergraph gradient and divergence operators, and modulated by a learnable, structure-aware coefficient matrix over hyperedge-node pairs. This partial differential equation (PDE) based formulation provides a physically interpretable view of hypergraph learning, where feature propagation is understood as an anisotropic diffusion process governed by local inconsistency and adaptive diffusion coefficient. From this perspective, neural message passing becomes a discretized gradient flow that progressively minimizes a diffusion energy functional. We derive rigorous theoretical guarantees, including energy dissipation, solution boundedness via a discrete maximum principle, and stability under explicit and implicit numerical schemes. The HND framework supports a variety of integration strategies such as non-adaptive-step (like Runge-Kutta) and adaptive-step solvers, enabling the construction of deep, stable, and interpretable architectures. Extensive experiments on benchmark datasets demonstrate that HND achieves competitive performance. Our results highlight the power of PDE-inspired design in enhancing the stability, expressivity, and interpretability of hypergraph learning.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 27 of its 58 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
27 of 58 references.
References · 27
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2019Heterogeneous Graph Attention Networkcited by 734
- 2018Hypergraph Neural Networkscited by 488
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2019Hypergraph Convolution and Hypergraph Attentioncited by 228
- 2018Contextual Stochastic Block Modelscited by 134
- 2021UniGNN: a Unified Framework for Graph and Hypergraph Neural Networkscited by 130
- 2020HNHN: Hypergraph Networks with Hyperedge Neuronscited by 109
- 2022Anti-Symmetric DGN: a stable architecture for Deep Graph Networkscited by 60
- 2020HyperSAGE: Generalizing Inductive Representation Learning on Hypergraphscited by 54
- 2021Generative hypergraph clustering: from blockmodels to modularitycited by 49
- 2022Equivariant Hypergraph Diffusion Neural Operatorscited by 47
15 more
- 2013The Total Variation on Hypergraphs - Learning on Hypergraphs Revisitedcited by 35
- 2023Sheaf Hypergraph Networkscited by 34
- 2018Submodular Hypergraphs: p-Laplacians, Cheeger Inequalities and Spectral Clusteringcited by 25
- 2020Nonlinear Higher-Order Label Spreadingcited by 20
- 2022Preventing Over-Smoothing for Hypergraph Neural Networkscited by 20
- 2023From Hypergraph Energy Functions to Hypergraph Neural Networkscited by 18
- 2023Classification of Edge-dependent Labels of Nodes in Hypergraphscited by 14
- 2021A nonlinear diffusion method for semi-supervised learning on hypergraphscited by 11
- 2021DecGAN: Decoupling Generative Adversarial Network detecting abnormal neural circuits for Alzheimer's diseasecited by 11
- 2021Adaptive Neural Message Passing for Inductive Learning on Hypergraphscited by 10
- 2024HYGENE: A Diffusion-based Hypergraph Generation Methodcited by 9
- 2021Local Hyper-Flow Diffusioncited by 8
- 2025Hypergraph Neural Sheaf Diffusion: A Symmetric Simplicial Set Framework for Higher-Order Learningcited by 3
- 2022A Simple Hypergraph Kernel Convolution based on Discounted Markov Diffusion Processcited by 2
- 2023Hy-DeFake: Hypergraph Neural Networks for Detecting Fake News in Online Social Networkscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.