mlsanityData to 7 Oct 2026

Graph Neural Networks: Methods, Applications, and Opportunities

arXiv 2108.10733 ↗First posted 24 Aug 2021cs.LG cs.AIcited by 16

Not on the map. Why?

Abstract (arXiv)

In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks with state-of-the-art performance. The data is generally represented in the Euclidean space in these domains. Various other domains conform to non-Euclidean space, for which graph is an ideal representation. Graphs are suitable for representing the dependencies and interrelationships between various entities. Traditionally, handcrafted features for graphs are incapable of providing the necessary inference for various tasks from this complex data representation. Recently, there is an emergence of employing various advances in deep learning to graph data-based tasks. This article provides a comprehensive survey of graph neural networks (GNNs) in each learning setting: supervised, unsupervised, semi-supervised, and self-supervised learning. Taxonomy of each graph based learning setting is provided with logical divisions of methods falling in the given learning setting. The approaches for each learning task are analyzed from both theoretical as well as empirical standpoints. Further, we provide general architecture guidelines for building GNNs. Various applications and benchmark datasets are also provided, along with open challenges still plaguing the general applicability of GNNs.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 118 of its 202 references that are in the map. First posted on arXiv 24 Aug 2021.

Builds on

118 of 202 references.

References · 118

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2017Inductive Representation Learning on Large Graphscited by 6,284
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  8. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  9. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  10. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  11. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  12. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
38 more
  1. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  2. 2019Simplifying Graph Convolutional Networkscited by 1,470
  3. 2016Variational Graph Auto-Encoderscited by 1,373
  4. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  5. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
  6. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  7. 2018Deep Graph Infomaxcited by 1,101
  8. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  9. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
  10. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  11. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  12. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  13. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  14. 2018Link Prediction Based on Graph Neural Networkscited by 829
  15. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
  16. 2015Image-based Recommendations on Styles and Substitutescited by 702
  17. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  18. 2020Benchmarking Graph Neural Networkscited by 672
  19. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  20. 2015LINE: Large-scale Information Network Embeddingcited by 582
  21. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  22. 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
  23. 2020Deep Graph Contrastive Representation Learningcited by 535
  24. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  25. 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
  26. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  27. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  28. 2017Representation Learning on Graphs: Methods and Applicationscited by 456
  29. 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 443
  30. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  31. 2018Graph Convolutional Networks for Text Classificationcited by 345
  32. 2018Invariant and Equivariant Graph Networkscited by 339
  33. 2018Image Generation from Scene Graphscited by 324
  34. 2020Self-supervised Graph Learning for Recommendationcited by 305
  35. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 302
  36. 2021Graph Self-Supervised Learning: A Surveycited by 289
  37. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 260
  38. 2018Learning Deep Generative Models of Graphscited by 227

50 most cited of 118 All 118 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 3; 2024: 8; 2025: 1; 2026: 2.

16 papers.

Sort:

By area:

  1. 2022Graph Neural Networks in IoT: A Surveycited by 27
  2. 2023ADA-GAD: Anomaly-Denoised Autoencoders for Graph Anomaly Detectioncited by 23
  3. 2024Anomaly Detection in Dynamic Graphs: A Comprehensive Surveycited by 18
  4. 2024Disentangled Condensation for Large-scale Graphscited by 10
  5. 2024Task-Oriented GNNs Training on Large Knowledge Graphs for Accurate and Efficient Modelingcited by 5
  6. 2024Survey of Graph Neural Network for Internet of Things and NextG Networkscited by 4
  7. 2024xAI-Drop: Don't Use What You Cannot Explaincited by 3
  8. 2024HGOE: Hybrid External and Internal Graph Outlier Exposure for Graph Out-of-Distribution Detectioncited by 3
  9. 2022STCGAT: A Spatio-temporal Causal Graph Attention Network for traffic flow prediction in Intelligent Transportation Systemscited by 2
  10. 2023Explainable Identification of Hate Speech towards Islam using Graph Neural Networkscited by 2
  11. 2024Flexible ViG: Learning the Self-Saliency for Flexible Object Recognitioncited by 2
  12. 2023Convolutional neural network based on sparse graph attention mechanism for MRI super-resolutioncited by 1
4 more
  1. 2025DMol: A Highly Efficient and Chemical Motif-Preserving Molecule Generation Platformcited by 1
  2. 2024Multistage non-deterministic classification using secondary concept graphs and graph convolutional networks for high-level feature extractioncited by 0
  3. 2026Logical Grammar Induction via Graph Kolmogorov Complexity: A Neuro-Symbolic Framework for Self-Healing Clinical Data Integritycited by 0
  4. 2026An Efficient and Scalable Graph Condensation with Structure-Preservingcited by 0