Transferability of Graph Neural Networks: an Extended Graphon Approach
Not on the map. Why?
Abstract (arXiv)
We study spectral graph convolutional neural networks (GCNNs), where filters are defined as continuous functions of the graph shift operator (GSO) through functional calculus. A spectral GCNN is not tailored to one specific graph and can be transferred between different graphs. It is hence important to study the GCNN transferability: the capacity of the network to have approximately the same repercussion on different graphs that represent the same phenomenon. Transferability ensures that GCNNs trained on certain graphs generalize if the graphs in the test set represent the same phenomena as the graphs in the training set. In this paper, we consider a model of transferability based on graphon analysis. Graphons are limit objects of graphs, and, in the graph paradigm, two graphs represent the same phenomenon if both approximate the same graphon. Our main contributions can be summarized as follows: 1) we prove that any fixed GCNN with continuous filters is transferable under graphs that approximate the same graphon, 2) we prove transferability for graphs that approximate unbounded graphon shift operators, which are defined in this paper, and, 3) we obtain non-asymptotic approximation results, proving linear stability of GCNNs. This extends current state-of-the-art results which show asymptotic transferability for polynomial filters under graphs that approximate bounded graphons.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). Builds on 18 of its 43 references that are in the map. First posted on arXiv 21 Sep 2021.
Builds on
18 of 43 references.
References · 18
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2017CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filterscited by 203
- 2019Graph Neural Networks with convolutional ARMA filterscited by 185
- 2019Stability Properties of Graph Neural Networkscited by 125
- 2019Transferability of Spectral Graph Convolutional Neural Networkscited by 90
- 2020Graph Neural Networks: Architectures, Stability and Transferabilitycited by 79
- 2020Convergence and Stability of Graph Convolutional Networks on Large Random Graphscited by 75
- 2019Certifiable Robustness to Graph Perturbationscited by 62
- 2020Efficient Robustness Certificates for Discrete Data: Sparsity-Aware Randomized Smoothing for Graphs, Images and Morecited by 56
6 more
- 2020Graphon Signal Processingcited by 37
- 2021Interpretable Stability Bounds for Spectral Graph Filterscited by 28
- 2019On the Transferability of Spectral Graph Filterscited by 27
- 2020On the Stability of Graph Convolutional Neural Networks under Edge Rewiringcited by 25
- 2020Graphon Filters: Graph Signal Processing in the Limitcited by 16
- 2020Graph and graphon neural network stabilitycited by 15
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 16; 2024: 11; 2025: 6; 2026: 12.
51 papers.
Sort:
By area:
- 2022Generalization Analysis of Message Passing Neural Networks on Large Random Graphscited by 58
- 2021Transferability Properties of Graph Neural Networkscited by 42
- 2022OOD Link Prediction Generalization Capabilities of Message-Passing GNNs in Larger Test Graphscited by 38
- 2023A graphon-signal analysis of graph neural networkscited by 29
- 2023Fine-grained Expressivity of Graph Neural Networkscited by 25
- 2023HoloNets: Spectral Convolutions do extend to Directed Graphscited by 20
- 2023Limits, approximation and size transferability for GNNs on sparse graphs via graphopscited by 17
- 2023Graph Neural Tangent Kernel: Convergence on Large Graphscited by 16
- 2024Generalization Bounds for Message Passing Networks on Mixture of Graphonscited by 16
- 2024A Manifold Perspective on the Statistical Generalization of Graph Neural Networkscited by 16
- 2023Convergence of Message Passing Graph Neural Networks with Generic Aggregation On Large Random Graphscited by 9
- 2023Geometric Graph Filters and Neural Networks: Limit Properties and Discriminability Trade-offscited by 9
38 more
- 2024Learning on Large Graphs using Intersecting Communitiescited by 8
- 2024Generalization of Geometric Graph Neural Networks with Lipschitz Loss Functionscited by 6
- 2024Sparse Covariance Neural Networkscited by 6
- 2022Space-Time Graph Neural Networks with Stochastic Graph Perturbationscited by 5
- 2024Graph neural networks and non-commuting operatorscited by 5
- 2023Transferability of coVariance Neural Networks and Application to Interpretable Brain Age Prediction using Anatomical Featurescited by 4
- 2024Generalization of Graph Neural Networks is Robust to Model Mismatchcited by 4
- 2025Covariance Density Neural Networkscited by 3
- 2026Graph Signal Diffusion Models for Wireless Resource Allocationcited by 3
- 2022Unveiling the Sampling Density in Non-Uniform Geometric Graphscited by 2
- 2022Stable and Transferable Hyper-Graph Neural Networkscited by 2
- 2023Limitless stability for Graph Convolutional Networkscited by 2
- 2023Manifold Filter-Combine Networkscited by 2
- 2023Transferability of Graph Neural Networks using Graphon and Sampling Theoriescited by 2
- 2023A Local Graph Limits Perspective on Sampling-Based GNNscited by 2
- 2023On the Trade-Off between Stability and Representational Capacity in Graph Neural Networkscited by 2
- 2025Efficient Learning on Large Graphs using a Densifying Regularity Lemmacited by 2
- 2025The Graphon Limit Hypothesis: Understanding Neural Network Pruning via Infinite Width Analysiscited by 2
- 2023ResolvNet: A Graph Convolutional Network with multi-scale Consistencycited by 1
- 2024Transferable Graphical MARL for Real-Time Estimation in Dynamic Wireless Networkscited by 1
- 2025Towards Coordinate- and Dimension-Agnostic Machine Learning for Partial Differential Equationscited by 1
- 2026Manifold limit for the training of shallow graph convolutional neural networkscited by 1
- 2026Any-Dimensional Invariant Universalitycited by 1
- 2026DiPhon: Diffusion on Graphons for Scalable Graph Generationcited by 1
- 2026Any-Dimensional Learning by Samplingcited by 1
- 2023Local transfer learning from one data space to anothercited by 0
- 2023Spectral Convergence of Complexon Shift Operatorscited by 0
- 2024Perfect Recovery for Random Geometric Graph Matching with Shallow Graph Neural Networkscited by 0
- 2024Distributed Training of Large Graph Neural Networks with Variable Communication Ratescited by 0
- 2024A Review of Graph-Powered Data Quality Applications for IoT Monitoring Sensor Networkscited by 0
- 2025Graph Variate Neural Networkscited by 0
- 2025On the Convergence and Size Transferability of Continuous-depth Graph Neural Networkscited by 0
- 2026Decentralized Learning Strategies for Estimation Error Minimization with Graph Neural Networkscited by 0
- 2026Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNscited by 0
- 2026Learning to Approximate Uniform Facility Location via Graph Neural Networkscited by 0
- 2026Size Transferability of Graph Transformers with Convolutional Positional Encodingscited by 0
- 2026When Do Graph Foundation Models Transfer? A Data-Centric Theorycited by 0
- 2026Limit Analysis of Graph Neural Networks with Wireless Conflict Graphscited by 0
50 most cited of 51 All 51 (JSON)
- 2026Warm-starting PDE solvers with any-dimensional machine learning30 Sep 2026
- 2026Any-Dimensional Learning by Sampling8 Jul 2026
- 2026DiPhon: Diffusion on Graphons for Scalable Graph Generation8 Jul 2026
- 2026Limit Analysis of Graph Neural Networks with Wireless Conflict Graphs2 Jun 2026
- 2026When Do Graph Foundation Models Transfer? A Data-Centric Theory28 May 2026
- 2026Any-Dimensional Invariant Universality22 May 2026
- 2026Graph Signal Diffusion Models for Wireless Resource Allocation6 Apr 2026
- 2026Size Transferability of Graph Transformers with Convolutional Positional Encodings16 Feb 2026
- 2026Learning to Approximate Uniform Facility Location via Graph Neural Networks13 Feb 2026
- 2026Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs10 Feb 2026
- 2026Decentralized Learning Strategies for Estimation Error Minimization with Graph Neural Networks19 Jan 2026
- 2026Manifold limit for the training of shallow graph convolutional neural networks9 Jan 2026
38 more
- 2025The Graphon Limit Hypothesis: Understanding Neural Network Pruning via Infinite Width Analysis20 Oct 2025
- 2025On the Convergence and Size Transferability of Continuous-depth Graph Neural Networks4 Oct 2025
- 2025Graph Variate Neural Networks24 Sep 2025
- 2025Towards Coordinate- and Dimension-Agnostic Machine Learning for Partial Differential Equations22 May 2025
- 2025Covariance Density Neural Networks16 May 2025
- 2025Efficient Learning on Large Graphs using a Densifying Regularity Lemma25 Apr 2025
- 2024Graph neural networks and non-commuting operators6 Nov 2024
- 2024A Review of Graph-Powered Data Quality Applications for IoT Monitoring Sensor Networks28 Oct 2024
- 2024Sparse Covariance Neural Networks2 Oct 2024
- 2024Generalization of Geometric Graph Neural Networks with Lipschitz Loss Functions8 Sep 2024
- 2024Generalization of Graph Neural Networks is Robust to Model Mismatch25 Aug 2024
- 2024Distributed Training of Large Graph Neural Networks with Variable Communication Rates25 Jun 2024
- 2024A Manifold Perspective on the Statistical Generalization of Graph Neural Networks7 Jun 2024
- 2024Learning on Large Graphs using Intersecting Communities31 May 2024
- 2024Generalization Bounds for Message Passing Networks on Mixture of Graphons4 Apr 2024
- 2024Transferable Graphical MARL for Real-Time Estimation in Dynamic Wireless Networks4 Apr 2024
- 2024Perfect Recovery for Random Geometric Graph Matching with Shallow Graph Neural Networks12 Feb 2024
- 2023On the Trade-Off between Stability and Representational Capacity in Graph Neural Networks4 Dec 2023
- 2023A Local Graph Limits Perspective on Sampling-Based GNNs17 Oct 2023
- 2023HoloNets: Spectral Convolutions do extend to Directed Graphs3 Oct 2023
- 2023ResolvNet: A Graph Convolutional Network with multi-scale Consistency30 Sep 2023
- 2023Spectral Convergence of Complexon Shift Operators12 Sep 2023
- 2023Transferability of Graph Neural Networks using Graphon and Sampling Theories25 Jul 2023
- 2023Manifold Filter-Combine Networks8 Jul 2023
- 2023Limits, approximation and size transferability for GNNs on sparse graphs via graphops7 Jun 2023
- 2023Fine-grained Expressivity of Graph Neural Networks6 Jun 2023
- 2023Geometric Graph Filters and Neural Networks: Limit Properties and Discriminability Trade-offs29 May 2023
- 2023A graphon-signal analysis of graph neural networks25 May 2023
- 2023Transferability of coVariance Neural Networks and Application to Interpretable Brain Age Prediction using Anatomical Features2 May 2023
- 2023Convergence of Message Passing Graph Neural Networks with Generic Aggregation On Large Random Graphs21 Apr 2023
- 2023Local transfer learning from one data space to another1 Feb 2023
- 2023Limitless stability for Graph Convolutional Networks26 Jan 2023
- 2023Graph Neural Tangent Kernel: Convergence on Large Graphs25 Jan 2023
- 2022Stable and Transferable Hyper-Graph Neural Networks11 Nov 2022
- 2022Space-Time Graph Neural Networks with Stochastic Graph Perturbations28 Oct 2022
- 2022Unveiling the Sampling Density in Non-Uniform Geometric Graphs15 Oct 2022
- 2022OOD Link Prediction Generalization Capabilities of Message-Passing GNNs in Larger Test Graphs30 May 2022
- 2022Generalization Analysis of Message Passing Neural Networks on Large Random Graphs1 Feb 2022
50 newest of 51 All 51 (JSON)
- 2022Generalization Analysis of Message Passing Neural Networks on Large Random Graphscited by 58
- 2021Transferability Properties of Graph Neural Networkscited by 42
- 2022OOD Link Prediction Generalization Capabilities of Message-Passing GNNs in Larger Test Graphscited by 38
- 2023A graphon-signal analysis of graph neural networkscited by 29
- 2023Fine-grained Expressivity of Graph Neural Networkscited by 25
- 2023HoloNets: Spectral Convolutions do extend to Directed Graphscited by 20
- 2023Limits, approximation and size transferability for GNNs on sparse graphs via graphopscited by 17
- 2023Graph Neural Tangent Kernel: Convergence on Large Graphscited by 16
- 2024Generalization Bounds for Message Passing Networks on Mixture of Graphonscited by 16
- 2024A Manifold Perspective on the Statistical Generalization of Graph Neural Networkscited by 16
- 2023Convergence of Message Passing Graph Neural Networks with Generic Aggregation On Large Random Graphscited by 9
- 2023Geometric Graph Filters and Neural Networks: Limit Properties and Discriminability Trade-offscited by 9
12 most cited of 49 All 49 (JSON)
- 2026Warm-starting PDE solvers with any-dimensional machine learning30 Sep 2026
- 2026Any-Dimensional Learning by Sampling8 Jul 2026
- 2026Limit Analysis of Graph Neural Networks with Wireless Conflict Graphs2 Jun 2026
- 2026When Do Graph Foundation Models Transfer? A Data-Centric Theory28 May 2026
- 2026Any-Dimensional Invariant Universality22 May 2026
- 2026Size Transferability of Graph Transformers with Convolutional Positional Encodings16 Feb 2026
- 2026Learning to Approximate Uniform Facility Location via Graph Neural Networks13 Feb 2026
- 2026Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs10 Feb 2026
- 2026Decentralized Learning Strategies for Estimation Error Minimization with Graph Neural Networks19 Jan 2026
- 2026Manifold limit for the training of shallow graph convolutional neural networks9 Jan 2026
- 2025The Graphon Limit Hypothesis: Understanding Neural Network Pruning via Infinite Width Analysis20 Oct 2025
- 2025On the Convergence and Size Transferability of Continuous-depth Graph Neural Networks4 Oct 2025
12 newest of 49 All 49 (JSON)