mlsanityData to 14 Oct 2026

State of the Art and Potentialities of Graph-level Learning

arXiv 2301.05860 ↗First posted 14 Jan 2023cs.LG cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Graphs have a superior ability to represent relational data, like chemical compounds, proteins, and social networks. Hence, graph-level learning, which takes a set of graphs as input, has been applied to many tasks including comparison, regression, classification, and more. Traditional approaches to learning a set of graphs heavily rely on hand-crafted features, such as substructures. But while these methods benefit from good interpretability, they often suffer from computational bottlenecks as they cannot skirt the graph isomorphism problem. Conversely, deep learning has helped graph-level learning adapt to the growing scale of graphs by extracting features automatically and encoding graphs into low-dimensional representations. As a result, these deep graph learning methods have been responsible for many successes. Yet, there is no comprehensive survey that reviews graph-level learning starting with traditional learning and moving through to the deep learning approaches. This article fills this gap and frames the representative algorithms into a systematic taxonomy covering traditional learning, graph-level deep neural networks, graph-level graph neural networks, and graph pooling. To ensure a thoroughly comprehensive survey, the evolutions, interactions, and communications between methods from four different branches of development are also examined. This is followed by a brief review of the benchmark data sets, evaluation metrics, and common downstream applications. The survey concludes with a broad overview of 12 current and future directions in this booming field.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 166 of its 303 references that are in the map. First posted on arXiv 14 Jan 2023.

Builds on

166 of 303 references.

References · 166

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  6. 2018How Powerful are Graph Neural Networks?cited by 4,393
  7. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  8. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  9. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  10. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
  11. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  12. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
38 more
  1. 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
  2. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  3. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  4. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  5. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
  6. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  7. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  8. 2021E(n) Equivariant Graph Neural Networkscited by 965
  9. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
  10. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  11. 2015Gated Graph Sequence Neural Networkscited by 796
  12. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 787
  13. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
  14. 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
  15. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
  16. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  17. 2020Benchmarking Graph Neural Networkscited by 680
  18. 2020A Generalization of Transformer Networks to Graphscited by 661
  19. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
  20. 2020Contrastive Multi-View Representation Learning on Graphscited by 652
  21. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
  22. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
  23. 2019Graph U-Netscited by 492
  24. 2020Principal Neighbourhood Aggregation for Graph Netscited by 478
  25. 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
  26. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
  27. 2017Scene Graph Generation by Iterative Message Passingcited by 462
  28. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  29. 2020Parameterized Explainer for Graph Neural Networkcited by 426
  30. 2019Self-Attention Graph Poolingcited by 421
  31. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
  32. 2018Deep Learning on Graphs: A Surveycited by 393
  33. 2019Provably Powerful Graph Networkscited by 389
  34. 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 384
  35. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
  36. 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 343
  37. 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 322
  38. 2016Learning Convolutional Neural Networks for Graphscited by 314

50 most cited of 166 All 166 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 0; 2025: 4; 2026: 1.

6 papers.