Hierarchical Multi-Scale Graph Neural Networks: Scalable Heterophilous Learning with Oversmoothing and Oversquashing Mitigation
Not on the map. Why?
Abstract (arXiv)
Graphs with heterophily, where adjacent nodes carry different labels, are prevalent in real-world applications, from social networks to molecular interactions. However, existing spectral Graph Neural Network (GNN) approaches tailored for heterophilous graph classification suffer from hub-dominated (node with large degree) aggregation and oversmoothing, as their suboptimal polynomial filters introduce approximation errors and blend distant signals. To address the degree-biased aggregation and suboptimal polynomial filtering, we introduce a Hierarchical Multi-view HAAR (HMH), a novel spectral graph-learning framework that scales in near-linear time . HMH first learns feature- and structure-aware signed affinities via a heterophily-aware encoder, then constructs a soft graph hierarchy guided by these embeddings. At each hierarchical level, HMH constructs a sparse, orthonormal, and locality-aware Haar basis to apply learnable spectral filters in the frequency domain. Finally, skip-connection unpooling layers combine outputs from all hierarchical levels back into the original graph, effectively preventing hub domination and long-range signal bottleneck (over-squashing). Experimentation shows that HMH outperforms state-of-the-art spectral baselines, achieving up to a 3% improvement on node classification and 7% points on graph classification datasets, all while maintaining linear scalability.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
26 of 39 references.
References · 26
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 787
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 473
- 2019Self-Attention Graph Poolingcited by 421
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 337
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2020SIGN: Scalable Inception Graph Neural Networkscited by 284
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2022Revisiting Heterophily For Graph Neural Networkscited by 169
- 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 165
- 2022Not too little, not too much: a theoretical analysis of graph (over)smoothingcited by 106
14 more
- 2019Graph Convolutional Networks with EigenPoolingcited by 94
- 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
- 2022On the Trade-off between Over-smoothing and Over-squashing in Deep Graph Neural Networkscited by 64
- 2022Structural Entropy Guided Graph Hierarchical Poolingcited by 62
- 2019Edge Contraction Pooling for Graph Neural Networkscited by 53
- 2023Graph Neural Networks with Learnable and Optimal Polynomial Basescited by 36
- 2022EvenNet: Ignoring Odd-Hop Neighbors Improves Robustness of Graph Neural Networkscited by 26
- 2024How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashingcited by 24
- 2019Spectral Clustering with Graph Neural Networks for Graph Poolingcited by 16
- 2024Understanding Heterophily for Graph Neural Networkscited by 15
- 2024PolyFormer: Scalable Node-wise Filters via Polynomial Graph Transformercited by 10
- 2024What Is Missing In Homophily? Disentangling Graph Homophily For Graph Neural Networkscited by 9
- 2024Sign is Not a Remedy: Multiset-to-Multiset Message Passing for Learning on Heterophilic Graphscited by 8
- 2024Graph Neural Networks Do Not Always Oversmoothcited by 7
Built on by
Not cited yet.