Representation Learning on Graphs: Methods and Applications
Not on the map. Why?
Abstract (arXiv)
Machine learning on graphs is an important and ubiquitous task with applications ranging from drug design to friendship recommendation in social networks. The primary challenge in this domain is finding a way to represent, or encode, graph structure so that it can be easily exploited by machine learning models. Traditionally, machine learning approaches relied on user-defined heuristics to extract features encoding structural information about a graph (e.g., degree statistics or kernel functions). However, recent years have seen a surge in approaches that automatically learn to encode graph structure into low-dimensional embeddings, using techniques based on deep learning and nonlinear dimensionality reduction. Here we provide a conceptual review of key advancements in this area of representation learning on graphs, including matrix factorization-based methods, random-walk based algorithms, and graph neural networks. We review methods to embed individual nodes as well as approaches to embed entire (sub)graphs. In doing so, we develop a unified framework to describe these recent approaches, and we highlight a number of important applications and directions for future work.
Key facts. Cited by 457 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 146; 2022: 109; 2023: 69; 2024: 62; 2025: 50; 2026: 21.
457 papers.
Sort:
By area:
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2021A Comprehensive Survey on Graph Anomaly Detection with Deep Learningcited by 230
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2021Inductive Representation Learning in Temporal Networks via Causal Anonymous Walkscited by 193
- 2021GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graphcited by 143
- 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 114
- 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 108
- 2022Decoupling the Depth and Scope of Graph Neural Networkscited by 94
- 2021Signal Processing on Higher-Order Networks: Livin' on the Edge ... and Beyondcited by 82
- 2023Generative Diffusion Models on Graphs: Methods and Applicationscited by 81
38 more
- 2021Graph Representation Learning in Biomedicinecited by 80
- 2021Graph-based Semi-supervised Learning: A Comprehensive Reviewcited by 79
- 2021DIG: A Turnkey Library for Diving into Graph Deep Learning Researchcited by 76
- 2021ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learningcited by 72
- 2022A Survey on Deep Graph Generation: Methods and Applicationscited by 69
- 2021Codabench: Flexible, Easy-to-Use and Reproducible Benchmarking Platformcited by 66
- 2022A Survey on Graph Representation Learning Methodscited by 66
- 2024Position: Topological Deep Learning is the New Frontier for Relational Learningcited by 66
- 2022DGraph: A Large-Scale Financial Dataset for Graph Anomaly Detectioncited by 63
- 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
- 2022Understanding and Improving Graph Injection Attack by Promoting Unnoticeabilitycited by 62
- 2022Theory of Graph Neural Networks: Representation and Learningcited by 61
- 2021A Survey on Embedding Dynamic Graphscited by 60
- 2022Does GNN Pretraining Help Molecular Representation?cited by 60
- 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
- 2024GKAN: Graph Kolmogorov-Arnold Networkscited by 53
- 2022A Short Tutorial on The Weisfeiler-Lehman Test And Its Variantscited by 52
- 2021BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessingcited by 50
- 2021On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphscited by 49
- 2022GAP: Differentially Private Graph Neural Networks with Aggregation Perturbationcited by 46
- 2023Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusioncited by 40
- 2021Automated Machine Learning on Graphs: A Surveycited by 39
- 2021Lipschitz Normalization for Self-Attention Layers with Application to Graph Neural Networkscited by 39
- 2021A Review of Biomedical Datasets Relating to Drug Discovery: A Knowledge Graph Perspectivecited by 38
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Reviewcited by 38
- 2023Simple and Asymmetric Graph Contrastive Learning without Augmentationscited by 38
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Materialcited by 35
- 2023Graph Positional and Structural Encodercited by 33
- 2021ReGVD: Revisiting Graph Neural Networks for Vulnerability Detectioncited by 32
- 2022FP-GNN: a versatile deep learning architecture for enhanced molecular property predictioncited by 31
- 2022Metropolis-Hastings Data Augmentation for Graph Neural Networkscited by 30
- 2024A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challengescited by 30
- 2021Marius: Learning Massive Graph Embeddings on a Single Machinecited by 29
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysiscited by 29
- 2022Graph Neural Networks with Adaptive Readoutscited by 29
- 2021Fair Representation Learning for Heterogeneous Information Networkscited by 28
- 2022MGAE: Masked Autoencoders for Self-Supervised Learning on Graphscited by 28
- 2022Graph Auto-Encoder Via Neighborhood Wasserstein Reconstructioncited by 28
50 most cited of 457 All 457 (JSON)
- 2026GraphRectify: Graph-Based Transfer of Adversarial Example Detectors Across Neural Networks7 Oct 2026
- 2026Effective Graph and Rank-based Contextual Embeddings for Textual and Multimedia Data29 Aug 2026
- 2026Structured Learning on Mapper Representations22 Aug 2026
- 2026RecipeNet: A Hierarchical Transformer for Recipe Data14 Aug 2026
- 2026Unsupervised Graph Representation Learning with Complementary View Alignment27 Jul 2026
- 2026Practical advantage beyond the quadratic speedup limit with fully-quantum walks24 Jul 2026
- 2026Demographically-Informed Heat-Mortality Risk Curves via Risk Graph Neural Networks23 Jul 2026
- 2026Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification25 Jun 2026
- 2026Controlled Dynamics Attractor Transformer13 Jun 2026
- 2026Knowledge Graph-Driven Expert-Level Reasoning for Neuroscience24 May 2026
- 2026Uncovering and Shaping the Latent Representation of 3D Scene Topology in Vision-Language Models8 May 2026
- 2026Spectral Graph Sparsification Preserves Representation Geometry in Graph Neural Networks1 May 2026
38 more
- 2026NOMAD: Generating Embeddings for Massive Distributed Graphs10 Apr 2026
- 2026Soft Tournament Equilibrium: Differentiable Set-Valued Inference for Non-Transitive Pairwise Comparisons6 Apr 2026
- 2026TriTopic: Tri-Modal Graph-Based Topic Modeling with Iterative Refinement and Archetypes22 Feb 2026
- 2026GraphSeek: Next-Generation Graph Analytics with LLMs11 Feb 2026
- 2026PIMPC-GNN: Physics-Informed Multi-Phase Consensus Learning for Enhancing Imbalanced Node Classification in Graph Neural Networks2 Feb 2026
- 2026Learning to Recommend Multi-Agent Subgraphs from Calling Trees29 Jan 2026
- 2026engGNN: A Dual-Graph Neural Network for Omics-Based Disease Classification and Feature Selection20 Jan 2026
- 2026Latent Structural Similarity Networks for Unsupervised Discovery in Multivariate Time Series15 Jan 2026
- 2026Clinical Data Goes MEDS? Let's OWL make sense of it7 Jan 2026
- 2025Hyperbolic Graph Embeddings: a Survey and an Evaluation on Anomaly Detection21 Dec 2025
- 2025AutoSchA: Automatic Hierarchical Music Representations via Multi-Relational Node Isolation20 Dec 2025
- 2025PR-CapsNet: Pseudo-Riemannian Capsule Network with Adaptive Curvature Routing for Graph Learning9 Dec 2025
- 2025Embedding networks with the random walk first return time distribution2 Dec 2025
- 2025Polynomial Neural Sheaf Diffusion: A Spectral Filtering Approach on Cellular Sheaves28 Nov 2025
- 2025Self-Adaptive Graph Mixture of Models17 Nov 2025
- 2025Fighter: Unveiling the Graph Convolutional Nature of Transformers in Time Series Modeling20 Oct 2025
- 2025Analytical Survey of Learning with Low-Resource Data: From Analysis to Investigation10 Oct 2025
- 2025Inductive inference of gradient-boosted decision trees on graphs for insurance fraud detection7 Oct 2025
- 2025Fractional Heat Kernel for Semi-Supervised Graph Learning with Small Training Sample Size6 Oct 2025
- 2025Graph Variate Neural Networks24 Sep 2025
- 2025Exploring Heterophily in Graph-level Tasks23 Sep 2025
- 2025Anti-Money Laundering Systems Using Deep Learning18 Sep 2025
- 2025A Graph Talks, But Who's Listening? Rethinking Evaluations for Graph-Language Models28 Aug 2025
- 2025Intellectual Property in Graph-Based Machine Learning as a Service: Attacks and Defenses27 Aug 2025
- 2025An Efficient Hybridization of Graph Representation Learning and Metaheuristics for the Constrained Incremental Graph Drawing Problem21 Aug 2025
- 2025EvoFormer: Learning Dynamic Graph-Level Representations with Structural and Temporal Bias Correction21 Aug 2025
- 2025GRAVITY: A Controversial Graph Representation Learning for Vertex Classification12 Aug 2025
- 2025Anatomy of a Machine Learning Ecosystem: 2 Million Models on Hugging Face9 Aug 2025
- 2025GLIDR: Graph-Like Inductive Logic Programming with Differentiable Reasoning8 Aug 2025
- 2025Leveraging Personalized PageRank and Higher-Order Topological Structures for Heterophily Mitigation in Graph Neural Networks22 Jul 2025
- 2025Higher-Order Graph Databases24 Jun 2025
- 2025GBGC: Efficient and Adaptive Graph Coarsening via Granular-ball Computing24 Jun 2025
- 2025Logical Expressiveness of Graph Neural Networks with Hierarchical Node Individualization16 Jun 2025
- 2025Language Embedding Meets Dynamic Graph: A New Exploration for Neural Architecture Representation Learning9 Jun 2025
- 2025Are Graph Attention Networks Able to Model Structural Information?27 May 2025
- 2025Learn Beneficial Noise as Graph Augmentation25 May 2025
- 2025NeuBM: Mitigating Model Bias in Graph Neural Networks through Neutral Input Calibration21 May 2025
- 2025Nonparametric Teaching for Graph Property Learners20 May 2025
50 newest of 457 All 457 (JSON)
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Reviewcited by 38
- 2024Are Large-Language Models Graph Algorithmic Reasoners?cited by 5
- 2025A Graph Talks, But Who's Listening? Rethinking Evaluations for Graph-Language Modelscited by 2
- 2026Knowledge Graph-Driven Expert-Level Reasoning for Neurosciencecited by 1
- 2026Knowledge Graph-Driven Expert-Level Reasoning for Neuroscience24 May 2026
- 2025A Graph Talks, But Who's Listening? Rethinking Evaluations for Graph-Language Models28 Aug 2025
- 2024Are Large-Language Models Graph Algorithmic Reasoners?29 Oct 2024
- 2024Demystifying Chains, Trees, and Graphs of Thoughts25 Jan 2024
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Models18 Aug 2023
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Review24 Feb 2022
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2023Generative Diffusion Models on Graphs: Methods and Applicationscited by 81
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Materialcited by 35
- 2022Swinv2-Imagen: Hierarchical Vision Transformer Diffusion Models for Text-to-Image Generationcited by 7
- 2025Graph Representation Learning with Diffusion Generative Modelscited by 2
- 2025Graph Representation Learning with Diffusion Generative Models22 Jan 2025
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material4 Apr 2023
- 2023Generative Diffusion Models on Graphs: Methods and Applications6 Feb 2023
- 2022Swinv2-Imagen: Hierarchical Vision Transformer Diffusion Models for Text-to-Image Generation18 Oct 2022
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep 2022
- 2024Mixture of Experts for Node Classificationcited by 4
- 2024Mixture of Experts for Node Classification30 Nov 2024
- 2021A Comprehensive Survey on Graph Anomaly Detection with Deep Learningcited by 230
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2021Inductive Representation Learning in Temporal Networks via Causal Anonymous Walkscited by 193
- 2021GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graphcited by 143
- 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 114
- 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 108
- 2022Decoupling the Depth and Scope of Graph Neural Networkscited by 94
- 2021Signal Processing on Higher-Order Networks: Livin' on the Edge ... and Beyondcited by 82
- 2021Graph Representation Learning in Biomedicinecited by 80
- 2021Graph-based Semi-supervised Learning: A Comprehensive Reviewcited by 79
- 2021DIG: A Turnkey Library for Diving into Graph Deep Learning Researchcited by 76
12 most cited of 439 All 439 (JSON)
- 2026GraphRectify: Graph-Based Transfer of Adversarial Example Detectors Across Neural Networks7 Oct 2026
- 2026Effective Graph and Rank-based Contextual Embeddings for Textual and Multimedia Data29 Aug 2026
- 2026Structured Learning on Mapper Representations22 Aug 2026
- 2026RecipeNet: A Hierarchical Transformer for Recipe Data14 Aug 2026
- 2026Unsupervised Graph Representation Learning with Complementary View Alignment27 Jul 2026
- 2026Practical advantage beyond the quadratic speedup limit with fully-quantum walks24 Jul 2026
- 2026Demographically-Informed Heat-Mortality Risk Curves via Risk Graph Neural Networks23 Jul 2026
- 2026Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification25 Jun 2026
- 2026Controlled Dynamics Attractor Transformer13 Jun 2026
- 2026Spectral Graph Sparsification Preserves Representation Geometry in Graph Neural Networks1 May 2026
- 2026NOMAD: Generating Embeddings for Massive Distributed Graphs10 Apr 2026
- 2026Soft Tournament Equilibrium: Differentiable Set-Valued Inference for Non-Transitive Pairwise Comparisons6 Apr 2026
12 newest of 439 All 439 (JSON)