mlsanityData to 14 Oct 2026

Topology-Aware PAC-Bayesian Generalization Analysis for Graph Neural Networks

arXiv 2604.10553 ↗First posted 12 Apr 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Graph neural networks have demonstrated excellent applicability to a wide range of domains, including social networks, biological systems, recommendation systems, and wireless communications. Yet a principled theoretical understanding of their generalization behavior remains limited, particularly for graph classification tasks where complex interactions between model parameters and graph structure play a crucial role. Among existing theoretical tools, PAC-Bayesian norm-based generalization bounds provide a flexible and data-dependent framework; however, current results for GNNs often restrict the exploitation of graph structures. In this work, we propose a topology-aware PAC-Bayesian norm-based generalization framework for graph convolutional networks (GCNs) that extends a previously developed framework to graph-structured models. Our approach reformulates the derivation of generalization bounds as a stochastic optimization problem and introduces sensitivity matrices that measure the response of classification outputs with respect to structured weight perturbations. By imposing different structures on sensitivity matrices from both spatial and spectral perspectives, we derive a family of generalization error bounds with graph structures explicitly embedded. Such bounds could recover existing results as special cases, while yielding bounds that are tighter than state-of-the-art PAC-Bayesian bounds for GNNs. Notably, the proposed framework explicitly integrates graph structural properties into the generalization analysis, enabling a unified inspection of GNN generalization behavior from both spatial aggregation and spectral filtering viewpoints.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 12 Apr 2026.

Builds on

25 of 35 references.

References · 25

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Inductive Representation Learning on Large Graphscited by 6,320
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  4. 2019Simplifying Graph Convolutional Networkscited by 1,477
  5. 2017Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Datacited by 533
  6. 2017A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networkscited by 314
  7. 2015Norm-Based Capacity Control in Neural Networkscited by 299
  8. 2020Generalization and Representational Limits of Graph Neural Networkscited by 218
  9. 2019Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernelscited by 161
  10. 2018Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approachcited by 126
  11. 2020A PAC-Bayesian Approach to Generalization Bounds for Graph Neural Networkscited by 85
  12. 2019Stability and Generalization of Graph Convolutional Neural Networkscited by 81
13 more
  1. 2022PAC-Bayes Compression Bounds So Tight That They Can Explain Generalizationcited by 76
  2. 2022Generalization Analysis of Message Passing Neural Networks on Large Random Graphscited by 59
  3. 2021Learning Theory Can (Sometimes) Explain Generalisation in Graph Neural Networkscited by 51
  4. 2023Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusioncited by 40
  5. 2023A graphon-signal analysis of graph neural networkscited by 30
  6. 2021Generalization bounds for graph convolutional neural networks via Rademacher complexitycited by 17
  7. 2024Generalization Bounds for Message Passing Networks on Mixture of Graphonscited by 17
  8. 2025Survey on Generalization Theory for Graph Neural Networkscited by 16
  9. 2024Generalization, Expressivity, and Universality of Graph Neural Networks on Attributed Graphscited by 14
  10. 2024Covered Forest: Fine-grained generalization analysis of graph neural networkscited by 10
  11. 2024PAC-Bayesian Adversarially Robust Generalization Bounds for Graph Neural Networkcited by 4
  12. 2026Towards A Unified PAC-Bayesian Framework for Norm-based Generalization Boundscited by 4
  13. 2025Generalization Performance of Hypergraph Neural Networkscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.