SCNode: Spatial and Contextual Coordinates for Graph Representation Learning
Not on the map. Why?
Abstract (arXiv)
Effective node representation lies at the heart of Graph Neural Networks (GNNs), as it directly impacts their ability to perform downstream tasks such as node classification and link prediction. Most existing GNNs, particularly message passing graph neural networks, rely on neighborhood aggregation to iteratively compute node embeddings. While powerful, this paradigm suffers from well-known limitations of oversquashing, oversmoothing, and underreaching that degrade representation quality. More critically, MPGNNs often assume homophily, where connected nodes share similar features or labels, leading to poor generalization in heterophilic graphs where this assumption breaks down. To address these challenges, we propose textitSCNode, a textitSpatial-Contextual Node Embedding framework designed to perform consistently well in both homophilic and heterophilic settings. SCNode integrates spatial and contextual information, yielding node embeddings that are not only more discriminative but also structurally aware. Our approach introduces new homophily matrices for understanding class interactions and tendencies. Extensive experiments on benchmark datasets show that SCNode achieves superior performance over conventional GNN models, demonstrating its robustness and adaptability in diverse graph structures.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 53 of its 81 references that are in the map. First posted on arXiv 3 Oct 2024.
Builds on
53 of 81 references.
References · 53
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2018Deep Graph Infomaxcited by 1,106
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
- 2020Simple and Deep Graph Convolutional Networkscited by 860
38 more
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 584
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2020Towards Deeper Graph Neural Networkscited by 296
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 210
- 2020Graph Neural Networks with Heterophilycited by 202
- 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
- 2021Is Homophily a Necessity for Graph Neural Networks?cited by 182
- 2018Adaptive Sampling Towards Fast Graph Representation Learningcited by 180
- 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2022Revisiting Heterophily For Graph Neural Networkscited by 169
- 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 133
- 2018Graphite: Iterative Generative Modeling of Graphscited by 112
- 2021Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patternscited by 95
- 2020Non-Local Graph Neural Networkscited by 91
- 2024Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classificationcited by 85
- 2021New Benchmarks for Learning on Non-Homophilous Graphscited by 81
- 2021On Training Implicit Modelscited by 75
- 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
- 2024Polynormer: Polynomial-Expressive Graph Transformer in Linear Timecited by 65
- 2022Characterizing Graph Datasets for Node Classification: Homophily-Heterophily Dichotomy and Beyondcited by 60
- 2021Simplifying approach to Node Classification in Graph Neural Networkscited by 56
- 2021Heterogeneous Graph Representation Learning with Relation Awarenesscited by 31
- 2021Variational Graph Normalized Auto-Encoderscited by 29
- 2024The Heterophilic Graph Learning Handbook: Benchmarks, Models, Theoretical Analysis, Applications and Challengescited by 29
- 2022RAW-GNN: RAndom Walk Aggregation based Graph Neural Networkcited by 25
- 2022MGNNI: Multiscale Graph Neural Networks with Implicit Layerscited by 19
- 2021A Closer Look at Prototype Classifier for Few-shot Image Classificationcited by 15
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.