Sampling Transferable Graph Neural Networks with Limited Graph Information
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) achieve strong performance on graph learning tasks, but training on large-scale networks remains computationally challenging. Transferability results show that GNNs with fixed weights can generalize from smaller graphs to larger ones drawn from the same family, motivating the use of sampled subgraphs to boost training efficiency. Yet most existing sampling strategies rely on reliable access to the target graph structure, which in practice may be noisy, incomplete, or unavailable prior to training. In lieu of precise connectivity information, we study feature-driven subgraph sampling for transferable GNNs, with the goal of preserving spectral properties of graph operators that control GNN expressivity. We adopt an alignment-based perspective linking node feature statistics to graph spectral structure and develop two complementary notions of feature-graph alignment. For coarse alignment, we formalize feature homophily through a Laplacian-based measure quantifying the alignment of feature principal components with graph eigenvectors, and establish a lower bound on the Laplacian trace in terms of feature statistics. This motivates a simple, non-sequential sampling algorithm that operates on the feature matrix and preserves a trace-based proxy for operator rank. For fine alignment, we assume a stationary model where the feature covariance and Laplacian share an eigenbasis, and establish that diagonal covariance entries reflect node-degree ordering under monotone filters. We empirically validate that filter monotonicity dictates the relationship between feature variance and spectral energy. On real-world benchmarks, selecting the retention rule that maximizes the Laplacian trace consistently yields GNNs with superior transferability and reduced generalization gaps.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 46 references that are in the map. First posted on arXiv 22 Oct 2024.
Builds on
25 of 46 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 409
- 2014Sketching as a Tool for Numerical Linear Algebracited by 285
- 2019On the equivalence between graph isomorphism testing and function approximation with GNNscited by 172
- 2016How to learn a graph from smooth signalscited by 146
- 2019Stability Properties of Graph Neural Networkscited by 125
- 2020Graphon Neural Networks and the Transferability of Graph Neural Networkscited by 117
13 more
- 2018Convolutional Neural Network Architectures for Signals Supported on Graphscited by 94
- 2020Graph Neural Networks: Architectures, Stability and Transferabilitycited by 79
- 2016Network Topology Inference from Spectral Templatescited by 58
- 2021Transferability Properties of Graph Neural Networkscited by 42
- 2020Graphon Signal Processingcited by 37
- 2016Stationary Graph Processes and Spectral Estimationcited by 35
- 2015Discrete Signal Processing on Graphs: Sampling Theorycited by 33
- 2016Stationary signal processing on graphscited by 28
- 2022coVariance Neural Networkscited by 18
- 2019Invariance-Preserving Localized Activation Functions for Graph Neural Networkscited by 14
- 2021Detecting Central Nodes from Low-rank Excited Graph Signals via Structured Factor Analysiscited by 9
- 2020Blind Inference of Eigenvector Centrality Rankingscited by 7
- 2022A Spectral Analysis of Graph Neural Networks on Dense and Sparse Graphscited by 5
Built on by
Not cited yet.