mlsanityData to 14 Oct 2026

SCNode: Spatial and Contextual Coordinates for Graph Representation Learning

arXiv 2410.02158 ↗First posted 3 Oct 2024cs.LG cs.CG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Effective node representation lies at the heart of Graph Neural Networks (GNNs), as it directly impacts their ability to perform downstream tasks such as node classification and link prediction. Most existing GNNs, particularly message passing graph neural networks, rely on neighborhood aggregation to iteratively compute node embeddings. While powerful, this paradigm suffers from well-known limitations of oversquashing, oversmoothing, and underreaching that degrade representation quality. More critically, MPGNNs often assume homophily, where connected nodes share similar features or labels, leading to poor generalization in heterophilic graphs where this assumption breaks down. To address these challenges, we propose textitSCNode, a textitSpatial-Contextual Node Embedding framework designed to perform consistently well in both homophilic and heterophilic settings. SCNode integrates spatial and contextual information, yielding node embeddings that are not only more discriminative but also structurally aware. Our approach introduces new homophily matrices for understanding class interactions and tendencies. Extensive experiments on benchmark datasets show that SCNode achieves superior performance over conventional GNN models, demonstrating its robustness and adaptability in diverse graph structures.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 53 of its 81 references that are in the map. First posted on arXiv 3 Oct 2024.

Builds on

53 of 81 references.

References · 53

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2018How Powerful are Graph Neural Networks?cited by 4,393
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  6. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  8. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  9. 2016Variational Graph Auto-Encoderscited by 1,382
  10. 2018Deep Graph Infomaxcited by 1,106
  11. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
  12. 2020Simple and Deep Graph Convolutional Networkscited by 860
38 more
  1. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  2. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  3. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
  4. 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 584
  5. 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
  6. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  7. 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
  8. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
  9. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
  10. 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
  11. 2020Towards Deeper Graph Neural Networkscited by 296
  12. 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
  13. 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 210
  14. 2020Graph Neural Networks with Heterophilycited by 202
  15. 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
  16. 2021Is Homophily a Necessity for Graph Neural Networks?cited by 182
  17. 2018Adaptive Sampling Towards Fast Graph Representation Learningcited by 180
  18. 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
  19. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  20. 2021Training Graph Neural Networks with 1000 Layerscited by 169
  21. 2022Revisiting Heterophily For Graph Neural Networkscited by 169
  22. 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 133
  23. 2018Graphite: Iterative Generative Modeling of Graphscited by 112
  24. 2021Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patternscited by 95
  25. 2020Non-Local Graph Neural Networkscited by 91
  26. 2024Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classificationcited by 85
  27. 2021New Benchmarks for Learning on Non-Homophilous Graphscited by 81
  28. 2021On Training Implicit Modelscited by 75
  29. 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
  30. 2024Polynormer: Polynomial-Expressive Graph Transformer in Linear Timecited by 65
  31. 2022Characterizing Graph Datasets for Node Classification: Homophily-Heterophily Dichotomy and Beyondcited by 60
  32. 2021Simplifying approach to Node Classification in Graph Neural Networkscited by 56
  33. 2021Heterogeneous Graph Representation Learning with Relation Awarenesscited by 31
  34. 2021Variational Graph Normalized Auto-Encoderscited by 29
  35. 2024The Heterophilic Graph Learning Handbook: Benchmarks, Models, Theoretical Analysis, Applications and Challengescited by 29
  36. 2022RAW-GNN: RAndom Walk Aggregation based Graph Neural Networkcited by 25
  37. 2022MGNNI: Multiscale Graph Neural Networks with Implicit Layerscited by 19
  38. 2021A Closer Look at Prototype Classifier for Few-shot Image Classificationcited by 15

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.