Making Classic GNNs Strong Baselines Across Varying Homophily: A Smoothness-Generalization Perspective
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have achieved great success but are often considered to be challenged by varying levels of homophily in graphs. Recent textitempirical studies have surprisingly shown that homophilic GNNs can perform well across datasets of different homophily levels with proper hyperparameter tuning, but the underlying theory and effective architectures remain unclear. To advance GNN universality across varying homophily, we theoretically revisit GNN message passing and uncover a novel textitsmoothness-generalization dilemma, where increasing hops inevitably enhances smoothness at the cost of generalization. This dilemma hinders learning in high-order homophilic neighborhoods and all heterophilic ones, where generalization is critical due to complex neighborhood class distributions that are sensitive to shifts induced by noise or sparsity. To address this, we introduce the Inceptive Graph Neural Network (IGNN) built on three simple yet effective design principles, which alleviate the dilemma by enabling distinct hop-wise generalization alongside improved overall generalization with adaptive smoothness. Benchmarking against 30 baselines demonstrates IGNN's superiority and reveals notable universality in certain homophilic GNN variants. Our code and datasets are available at hrefhttps://github.com/galogm/IGNNhttps://github.com/galogm/IGNN.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 55 of its 69 references that are in the map. First posted on arXiv 13 Dec 2024.
Builds on
55 of 69 references.
References · 55
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2014Going Deeper with Convolutionscited by 4,231
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
38 more
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 442
- 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
- 2020Towards Deeper Graph Neural Networkscited by 296
- 2020SIGN: Scalable Inception Graph Neural Networkscited by 283
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 208
- 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 207
- 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
- 2021Is Homophily a Necessity for Graph Neural Networks?cited by 182
- 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2022Revisiting Heterophily For Graph Neural Networkscited by 169
- 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
- 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 131
- 2020A Unified View on Graph Neural Networks as Graph Signal Denoisingcited by 110
- 2022Not too little, not too much: a theoretical analysis of graph (over)smoothingcited by 106
- 2023DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusioncited by 85
- 2021GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophilycited by 84
- 2024Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classificationcited by 83
- 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
- 2024Polynormer: Polynomial-Expressive Graph Transformer in Linear Timecited by 64
- 2021On Provable Benefits of Depth in Training Graph Convolutional Networkscited by 58
- 2023Demystifying Oversmoothing in Attention-Based Graph Neural Networkscited by 47
- 2022Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPscited by 42
- 2023Towards Understanding the Generalization of Graph Neural Networkscited by 41
- 2023Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?cited by 41
- 2023Cooperative Graph Neural Networkscited by 35
- 2024Rethinking Propagation for Unsupervised Graph Domain Adaptationcited by 31
- 2023Beyond Homophily: Reconstructing Structure for Graph-agnostic Clusteringcited by 29
- 2024The Heterophilic Graph Learning Handbook: Benchmarks, Models, Theoretical Analysis, Applications and Challengescited by 29
- 2023Some Fundamental Aspects about Lipschitz Continuity of Neural Networkscited by 25
- 2024How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashingcited by 24
- 2024How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspectivecited by 21
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 2.
2 papers.