State of the Art and Potentialities of Graph-level Learning
Not on the map. Why?
Abstract (arXiv)
Graphs have a superior ability to represent relational data, like chemical compounds, proteins, and social networks. Hence, graph-level learning, which takes a set of graphs as input, has been applied to many tasks including comparison, regression, classification, and more. Traditional approaches to learning a set of graphs heavily rely on hand-crafted features, such as substructures. But while these methods benefit from good interpretability, they often suffer from computational bottlenecks as they cannot skirt the graph isomorphism problem. Conversely, deep learning has helped graph-level learning adapt to the growing scale of graphs by extracting features automatically and encoding graphs into low-dimensional representations. As a result, these deep graph learning methods have been responsible for many successes. Yet, there is no comprehensive survey that reviews graph-level learning starting with traditional learning and moving through to the deep learning approaches. This article fills this gap and frames the representative algorithms into a systematic taxonomy covering traditional learning, graph-level deep neural networks, graph-level graph neural networks, and graph pooling. To ensure a thoroughly comprehensive survey, the evolutions, interactions, and communications between methods from four different branches of development are also examined. This is followed by a brief review of the benchmark data sets, evaluation metrics, and common downstream applications. The survey concludes with a broad overview of 12 current and future directions in this booming field.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 166 of its 303 references that are in the map. First posted on arXiv 14 Jan 2023.
Builds on
166 of 303 references.
References · 166
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
38 more
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2015Gated Graph Sequence Neural Networkscited by 796
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 787
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2020Benchmarking Graph Neural Networkscited by 680
- 2020A Generalization of Transformer Networks to Graphscited by 661
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
- 2020Contrastive Multi-View Representation Learning on Graphscited by 652
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2019Graph U-Netscited by 492
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 478
- 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2020Parameterized Explainer for Graph Neural Networkcited by 426
- 2019Self-Attention Graph Poolingcited by 421
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
- 2018Deep Learning on Graphs: A Surveycited by 393
- 2019Provably Powerful Graph Networkscited by 389
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 384
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 343
- 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 322
- 2016Learning Convolutional Neural Networks for Graphscited by 314
50 most cited of 166 All 166 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 4; 2026: 1.
6 papers.
- 2023Heterogeneous Social Event Detection via Hyperbolic Graph Representationscited by 3
- 2025Towards Faithful Class-level Self-explainability in Graph Neural Networks by Subgraph Dependenciescited by 1
- 2026GraPHFormer: A Multimodal Graph Persistent Homology Transformer for the Analysis of Neuroscience Morphologiescited by 1
- 2025ASD Classification on Dynamic Brain Connectome using Temporal Random Walk with Transformer-based Dynamic Network Embeddingcited by 0
- 2025Adaptive Substructure-Aware Expert Model for Molecular Property Predictioncited by 0
- 2025HSG-12M: A Large-Scale Benchmark of Spatial Multigraphs from the Energy Spectra of Non-Hermitian Crystalscited by 0
- 2026GraPHFormer: A Multimodal Graph Persistent Homology Transformer for the Analysis of Neuroscience Morphologies21 Mar 2026
- 2025Towards Faithful Class-level Self-explainability in Graph Neural Networks by Subgraph Dependencies15 Aug 2025
- 2025HSG-12M: A Large-Scale Benchmark of Spatial Multigraphs from the Energy Spectra of Non-Hermitian Crystals10 Jun 2025
- 2025Adaptive Substructure-Aware Expert Model for Molecular Property Prediction8 Apr 2025
- 2025ASD Classification on Dynamic Brain Connectome using Temporal Random Walk with Transformer-based Dynamic Network Embedding16 Mar 2025
- 2023Heterogeneous Social Event Detection via Hyperbolic Graph Representations20 Feb 2023