mlsanityData to 14 Oct 2026

Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing

arXiv 2505.15015 ↗First posted 21 May 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Most Graph Neural Networks (GNNs) propagate messages by treating node embeddings as holistic feature vectors, implicitly assuming uniform relevance across feature dimensions. This limits their ability to selectively transmit informative components, especially when graph structures exhibit distinct frequency characteristics. We propose MSH-GNN (Multi-Scale Harmonic Graph Neural Network), a frequency-aware message passing framework that performs feature-wise adaptive propagation. Each node projects incoming messages onto node-conditioned feature subspaces derived from its own representation, enabling selective extraction of frequency-relevant components. Learnable multi-scale harmonic modulations further allow the model to capture both smooth and oscillatory structural patterns. A frequency-aware attention pooling mechanism is introduced for graph-level readout. We show that MSH-GNN admits an interpretation as a learnable Fourier-feature approximation of kernelized message functions and matches the expressive power of the 1-Weisfeiler-Lehman (1-WL) test. Extensive experiments on node- and graph-level benchmarks demonstrate consistent improvements over state-of-the-art methods, particularly in joint structure-frequency analysis tasks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

38 of 49 references.

References · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2018How Powerful are Graph Neural Networks?cited by 4,393
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  7. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  8. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
  9. 2021How Attentive are Graph Attention Networks?cited by 835
  10. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  11. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
  12. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
26 more
  1. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  2. 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
  3. 2019Provably Powerful Graph Networkscited by 389
  4. 2018Invariant and Equivariant Graph Networkscited by 346
  5. 2020Improving Graph Neural Network Expressivity via Subgraph Isomorphism Countingcited by 313
  6. 2015Diffusion-Convolutional Neural Networkscited by 268
  7. 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
  8. 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
  9. 2022Representing Long-Range Context for Graph Neural Networks with Global Attentioncited by 195
  10. 2022Pure Transformers are Powerful Graph Learnerscited by 188
  11. 2023Exphormer: Sparse Transformers for Graphscited by 170
  12. 2018GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphscited by 165
  13. 2019Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernelscited by 161
  14. 2019A Survey on Graph Kernelscited by 148
  15. 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
  16. 2020Directional Graph Networkscited by 133
  17. 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
  18. 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
  19. 2019GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulationcited by 75
  20. 2022Structural Entropy Guided Graph Hierarchical Poolingcited by 62
  21. 2020Natural Graph Networkscited by 35
  22. 2023Weisfeiler and Lehman Go Paths: Learning Topological Features via Path Complexescited by 11
  23. 2024Towards Dynamic Message Passing on Graphscited by 11
  24. 2023Topological Pooling on Graphscited by 9
  25. 2018WaveletNet: Logarithmic Scale Efficient Convolutional Neural Networks for Edge Devicescited by 1
  26. 2025Rhomboid Tiling for Geometric Graph Deep Learningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.