mlsanityData to 7 Oct 2026

Making Classic GNNs Strong Baselines Across Varying Homophily: A Smoothness-Generalization Perspective

arXiv 2412.09805 ↗First posted 13 Dec 2024cs.LG cs.AI cs.SIcited by 2

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) have achieved great success but are often considered to be challenged by varying levels of homophily in graphs. Recent textitempirical studies have surprisingly shown that homophilic GNNs can perform well across datasets of different homophily levels with proper hyperparameter tuning, but the underlying theory and effective architectures remain unclear. To advance GNN universality across varying homophily, we theoretically revisit GNN message passing and uncover a novel textitsmoothness-generalization dilemma, where increasing hops inevitably enhances smoothness at the cost of generalization. This dilemma hinders learning in high-order homophilic neighborhoods and all heterophilic ones, where generalization is critical due to complex neighborhood class distributions that are sensitive to shifts induced by noise or sparsity. To address this, we introduce the Inceptive Graph Neural Network (IGNN) built on three simple yet effective design principles, which alleviate the dilemma by enabling distinct hop-wise generalization alongside improved overall generalization with adaptive smoothness. Benchmarking against 30 baselines demonstrates IGNN's superiority and reveals notable universality in certain homophilic GNN variants. Our code and datasets are available at hrefhttps://github.com/galogm/IGNNhttps://github.com/galogm/IGNN.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 55 of its 69 references that are in the map. First posted on arXiv 13 Dec 2024.

Builds on

55 of 69 references.

References · 55

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2014Going Deeper with Convolutionscited by 4,231
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  8. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  9. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  10. 2019Simplifying Graph Convolutional Networkscited by 1,470
  11. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  12. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
38 more
  1. 2020Simple and Deep Graph Convolutional Networkscited by 857
  2. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  3. 2019Graph Neural Networks for Social Recommendationcited by 711
  4. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
  5. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
  6. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 442
  7. 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
  8. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
  9. 2020Towards Deeper Graph Neural Networkscited by 296
  10. 2020SIGN: Scalable Inception Graph Neural Networkscited by 283
  11. 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 208
  12. 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 207
  13. 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
  14. 2021Is Homophily a Necessity for Graph Neural Networks?cited by 182
  15. 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
  16. 2022How Powerful are Spectral Graph Neural Networkscited by 169
  17. 2022Revisiting Heterophily For Graph Neural Networkscited by 169
  18. 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
  19. 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 131
  20. 2020A Unified View on Graph Neural Networks as Graph Signal Denoisingcited by 110
  21. 2022Not too little, not too much: a theoretical analysis of graph (over)smoothingcited by 106
  22. 2023DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusioncited by 85
  23. 2021GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophilycited by 84
  24. 2024Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classificationcited by 83
  25. 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
  26. 2024Polynormer: Polynomial-Expressive Graph Transformer in Linear Timecited by 64
  27. 2021On Provable Benefits of Depth in Training Graph Convolutional Networkscited by 58
  28. 2023Demystifying Oversmoothing in Attention-Based Graph Neural Networkscited by 47
  29. 2022Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPscited by 42
  30. 2023Towards Understanding the Generalization of Graph Neural Networkscited by 41
  31. 2023Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?cited by 41
  32. 2023Cooperative Graph Neural Networkscited by 35
  33. 2024Rethinking Propagation for Unsupervised Graph Domain Adaptationcited by 31
  34. 2023Beyond Homophily: Reconstructing Structure for Graph-agnostic Clusteringcited by 29
  35. 2024The Heterophilic Graph Learning Handbook: Benchmarks, Models, Theoretical Analysis, Applications and Challengescited by 29
  36. 2023Some Fundamental Aspects about Lipschitz Continuity of Neural Networkscited by 25
  37. 2024How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashingcited by 24
  38. 2024How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspectivecited by 21

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.