Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing
Not on the map. Why?
Abstract (arXiv)
Most Graph Neural Networks (GNNs) propagate messages by treating node embeddings as holistic feature vectors, implicitly assuming uniform relevance across feature dimensions. This limits their ability to selectively transmit informative components, especially when graph structures exhibit distinct frequency characteristics. We propose MSH-GNN (Multi-Scale Harmonic Graph Neural Network), a frequency-aware message passing framework that performs feature-wise adaptive propagation. Each node projects incoming messages onto node-conditioned feature subspaces derived from its own representation, enabling selective extraction of frequency-relevant components. Learnable multi-scale harmonic modulations further allow the model to capture both smooth and oscillatory structural patterns. A frequency-aware attention pooling mechanism is introduced for graph-level readout. We show that MSH-GNN admits an interpretation as a learnable Fourier-feature approximation of kernelized message functions and matches the expressive power of the 1-Weisfeiler-Lehman (1-WL) test. Extensive experiments on node- and graph-level benchmarks demonstrate consistent improvements over state-of-the-art methods, particularly in joint structure-frequency analysis tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 21 May 2025.
Builds on
38 of 49 references.
References · 38
- 2017Attention Is All You Needcited by 60,361
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
26 more
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
- 2019Provably Powerful Graph Networkscited by 389
- 2018Invariant and Equivariant Graph Networkscited by 346
- 2020Improving Graph Neural Network Expressivity via Subgraph Isomorphism Countingcited by 313
- 2015Diffusion-Convolutional Neural Networkscited by 268
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
- 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
- 2022Representing Long-Range Context for Graph Neural Networks with Global Attentioncited by 195
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2023Exphormer: Sparse Transformers for Graphscited by 170
- 2018GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphscited by 165
- 2019Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernelscited by 161
- 2019A Survey on Graph Kernelscited by 148
- 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
- 2020Directional Graph Networkscited by 133
- 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
- 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
- 2019GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulationcited by 75
- 2022Structural Entropy Guided Graph Hierarchical Poolingcited by 62
- 2020Natural Graph Networkscited by 35
- 2023Weisfeiler and Lehman Go Paths: Learning Topological Features via Path Complexescited by 11
- 2024Towards Dynamic Message Passing on Graphscited by 11
- 2023Topological Pooling on Graphscited by 9
- 2018WaveletNet: Logarithmic Scale Efficient Convolutional Neural Networks for Edge Devicescited by 1
- 2025Rhomboid Tiling for Geometric Graph Deep Learningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.