DeepWalk: Online Learning of Social Representations
Not on the map. Why?
Abstract (arXiv)
We present DeepWalk, a novel approach for learning latent representations of vertices in a network. These latent representations encode social relations in a continuous vector space, which is easily exploited by statistical models. DeepWalk generalizes recent advancements in language modeling and unsupervised feature learning (or deep learning) from sequences of words to graphs. DeepWalk uses local information obtained from truncated random walks to learn latent representations by treating walks as the equivalent of sentences. We demonstrate DeepWalk's latent representations on several multi-label network classification tasks for social networks such as BlogCatalog, Flickr, and YouTube. Our results show that DeepWalk outperforms challenging baselines which are allowed a global view of the network, especially in the presence of missing information. DeepWalk's representations can provide F1 scores up to 10% higher than competing methods when labeled data is sparse. In some experiments, DeepWalk's representations are able to outperform all baseline methods while using 60% less training data. DeepWalk is also scalable. It is an online learning algorithm which builds useful incremental results, and is trivially parallelizable. These qualities make it suitable for a broad class of real world applications such as network classification, and anomaly detection.
Key facts. Cited by 1,543 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 409; 2022: 340; 2023: 292; 2024: 237; 2025: 168; 2026: 97.
1,543 papers.
Sort:
By area:
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2021Ensemble deep learning: A reviewcited by 283
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2021A Comprehensive Survey on Graph Anomaly Detection with Deep Learningcited by 230
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2022Graph neural networks for materials science and chemistrycited by 181
- 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
38 more
- 2021GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networkscited by 147
- 2021Graph Learning: A Surveycited by 140
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
- 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
- 2021Nested Graph Neural Networkscited by 136
- 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
- 2022Towards Unsupervised Deep Graph Structure Learningcited by 112
- 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 112
- 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 108
- 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 107
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 101
- 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
- 2022Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networkscited by 94
- 2021Knowledge Graph Reasoning with Relational Digraphcited by 91
- 2022How Powerful are K-hop Message Passing Graph Neural Networkscited by 90
- 2021Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training Datacited by 86
- 2021Graph Barlow Twins: A self-supervised representation learning framework for graphscited by 85
- 2021Beltrami Flow and Neural Diffusion on Graphscited by 84
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 83
- 2021HDMI: High-order Deep Multiplex Infomaxcited by 82
- 2021Size-Invariant Graph Representations for Graph Classification Extrapolationscited by 82
- 2022What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoderscited by 82
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
- 2021Graph-based Semi-supervised Learning: A Comprehensive Reviewcited by 79
- 2021Graph Representation Learning in Biomedicinecited by 79
- 2022Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Predictioncited by 78
- 2022Fairness in Graph Mining: A Surveycited by 76
- 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
- 2022Expander Graph Propagationcited by 75
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
- 2021Graph-MLP: Node Classification without Message Passing in Graphcited by 73
- 2021ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learningcited by 72
- 2023A Comprehensive Survey on Deep Graph Representation Learningcited by 72
- 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
- 2021Learning from Counterfactual Links for Link Predictioncited by 69
- 2021FairDrop: Biased Edge Dropout for Enhancing Fairness in Graph Representation Learningcited by 68
- 2021Lorentzian Graph Convolutional Networkscited by 66
- 2022A Survey on Graph Representation Learning Methodscited by 66
50 most cited of 1,543 All 1,543 (JSON)
- 2026TopoEmbedX: A General Framework for Representation Learning on Topological Domains29 Sep 2026
- 2026Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Prediction28 Sep 2026
- 2026Extremely Fast and Compact Binary Graph Representations via Randomized Operator Sketching26 Sep 2026
- 2026Kernel-Complexity Edge Sanitization for Training-Free Defense against Structural Graph Attacks9 Sep 2026
- 2026SWORD: Wikidata-based Distortions Reveal Hidden Cross-Lingual Inconsistencies in LLM Factual Error Rejection8 Sep 2026
- 2026Topology-induced Operators Reveal Complementary Graph Representations without Training8 Sep 2026
- 2026ValueGraph: Value-Signal Guided Graph Pre-training for Contextualized User Representation30 Aug 2026
- 2026Context-Aware Interpretable Representations for Retrieval and Graph Convolutional Network Classification29 Aug 2026
- 2026Effective Graph and Rank-based Contextual Embeddings for Textual and Multimedia Data29 Aug 2026
- 2026A Computational Framework for Modelling Organisation-Level Semantic Identity from Longitudinal Textual Data27 Aug 2026
- 2026Structurally-bounded Agentic Graph Exploration for Evidence-Grounded Scholarly DeepSearch25 Aug 2026
- 2026Structured Learning on Mapper Representations22 Aug 2026
38 more
- 2026Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design20 Aug 2026
- 2026Fairness-Aware Network Embeddings: Methods, Applications, and Challenges19 Aug 2026
- 2026Enhancing Distance-Based Graph Autoencoders with Structural Penalties for Dynamic Graph Embedding19 Aug 2026
- 2026Neural Message Passing on Structural Interaction Graphs for Fully-Inductive Graph Neural Networks9 Aug 2026
- 2026IMMENSE: Inductive Multi-perspective User Classification in Social Networks5 Aug 2026
- 2026NodeJEPA: Structure-Conditioned Latent Prediction for Node-Level Graph Self-Supervised Learning5 Aug 2026
- 2026TRWH: A Text-Driven Random Walk Heterogeneous GNN for Semantic-Aware Sparse Recommendation28 Jul 2026
- 2026Unsupervised Graph Representation Learning with Complementary View Alignment27 Jul 2026
- 2026Plausibility-Driven Prioritization of Candidate Biomedical Annotations22 Jul 2026
- 2026Selectivity Matters: Source Node Influence Pruning for Unsupervised Graph Domain Adaptation20 Jul 2026
- 2026Node4All: Learning Node Representation Beyond Datasets19 Jul 2026
- 2026A Novel Graph Fraud Detector via Grouped Attribute Completion and Confidence-Aware Contrastive Learning13 Jul 2026
- 2026Multi-Label Node Classification with Label Influence Propagation1 Jul 2026
- 2026Generating Special Triangulations with Transformers25 Jun 2026
- 2026Learning Graphs through Continuous Information Entropy Fields22 Jun 2026
- 2026FeLoG: Scalable and Efficient Distributed Graph Embedding with Feedback Loop Mechanism20 Jun 2026
- 2026Timestamp-Aware Spatio-Temporal Graph Contrastive Learning for Network Intrusion Detection15 Jun 2026
- 2026The Confidence Trap: Calibration Attacks for Graph Neural Networks7 Jun 2026
- 2026SPR: Toward a Graph Foundation Model for Transferable Graph Cognition via Spectral Patterns and Relational Geometry2 Jun 2026
- 2026Modeling Spectral Energy Shifts in Spatio-Temporal Graph Anomaly Detection29 May 2026
- 2026GraphLit: Learning Text-Enriched Dynamic Character Network Representations for Literary Study27 May 2026
- 2026T-GINEE: A Tensor-Based Multilayer Graph Representation Learning27 May 2026
- 2026Temporal Hyperbolic Graph Representation Learning for Scale-Free Internet Routing and Delay Prediction27 May 2026
- 2026Advancing Graph Few-Shot Learning via In-Context Learning23 May 2026
- 2026Fast and Featureless Node Representation Learning with Partial Pairwise Supervision19 May 2026
- 2026Beyond Oversquashing: Understanding Signal Propagation in GNNs Via Observables13 May 2026
- 2026A Unified Perspective for Learning Graph Representations Across Multi-Level Abstractions12 May 2026
- 2026From Message-Passing to Linearized Graph Sequence Models12 May 2026
- 2026Rank Is Not Capacity: Spectral Occupancy for Latent Graph Models11 May 2026
- 2026GravityGraphSAGE: Link Prediction in Directed Attributed Graphs10 May 2026
- 2026Attention-based graph neural networks: a survey9 May 2026
- 2026On the Safety of Graph Representation Learning7 May 2026
- 2026H3: A Healthcare Three-Hop Index for Physician Referral Network Prediction4 May 2026
- 2026Evaluating LLMs on Large-Scale Graph Property Estimation via Random Walks2 May 2026
- 2026Aitchison Embeddings for Learning Compositional Graph Representations1 May 2026
- 2026A Survey on GNN-based Link Prediction: Techniques, Applications, and Challenges29 Apr 2026
- 2026Modern Structure-Aware Simplicial Spatiotemporal Neural Network17 Apr 2026
- 2026NOMAD: Generating Embeddings for Massive Distributed Graphs10 Apr 2026
50 newest of 1,543 All 1,543 (JSON)
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 83
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databasescited by 35
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Surveycited by 21
- 2024KnowFormer: Revisiting Transformers for Knowledge Graph Reasoningcited by 5
- 2025Omne-R1: Learning to Reason with Memory for Multi-hop Question Answeringcited by 1
- 2026Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layercited by 1
- 2026Evaluating LLMs on Large-Scale Graph Property Estimation via Random Walkscited by 0
- 2026Evaluating LLMs on Large-Scale Graph Property Estimation via Random Walks2 May 2026
- 2026Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layer2 Mar 2026
- 2025Omne-R1: Learning to Reason with Memory for Multi-hop Question Answering24 Aug 2025
- 2024KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning19 Sep 2024
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning13 Jun 2024
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databases26 Mar 2023
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Survey14 Feb 2023
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Materialcited by 34
- 2026Prior-Informed Flow Matching for Graph Reconstructioncited by 3
- 2025SBGD: Improving Graph Diffusion Generative Model via Stochastic Block Diffusioncited by 2
- 2026Inference Attacks Against Graph Generative Diffusion Modelscited by 2
- 2025Diffusion-augmented Graph Contrastive Learning for Collaborative Filtercited by 1
- 2026Prior-Informed Flow Matching for Graph Reconstruction29 Jan 2026
- 2026Inference Attacks Against Graph Generative Diffusion Models7 Jan 2026
- 2025SBGD: Improving Graph Diffusion Generative Model via Stochastic Block Diffusion20 Aug 2025
- 2025Diffusion-augmented Graph Contrastive Learning for Collaborative Filter20 Mar 2025
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material4 Apr 2023
- 2026Structurally-bounded Agentic Graph Exploration for Evidence-Grounded Scholarly DeepSearch25 Aug 2026
- 2026Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design20 Aug 2026
- 2026MemRec: Collaborative Memory-Augmented Agentic Recommender System13 Jan 2026
- 2024Graph Knowledge Distillation to Mixture of Expertscited by 2
- 2024Graph Knowledge Distillation to Mixture of Experts17 Jun 2024
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2021Ensemble deep learning: A reviewcited by 283
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2021A Comprehensive Survey on Graph Anomaly Detection with Deep Learningcited by 230
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2022Graph neural networks for materials science and chemistrycited by 181
- 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
12 most cited of 1,519 All 1,519 (JSON)
- 2026TopoEmbedX: A General Framework for Representation Learning on Topological Domains29 Sep 2026
- 2026Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Prediction28 Sep 2026
- 2026Extremely Fast and Compact Binary Graph Representations via Randomized Operator Sketching26 Sep 2026
- 2026Kernel-Complexity Edge Sanitization for Training-Free Defense against Structural Graph Attacks9 Sep 2026
- 2026SWORD: Wikidata-based Distortions Reveal Hidden Cross-Lingual Inconsistencies in LLM Factual Error Rejection8 Sep 2026
- 2026Topology-induced Operators Reveal Complementary Graph Representations without Training8 Sep 2026
- 2026ValueGraph: Value-Signal Guided Graph Pre-training for Contextualized User Representation30 Aug 2026
- 2026Context-Aware Interpretable Representations for Retrieval and Graph Convolutional Network Classification29 Aug 2026
- 2026Effective Graph and Rank-based Contextual Embeddings for Textual and Multimedia Data29 Aug 2026
- 2026A Computational Framework for Modelling Organisation-Level Semantic Identity from Longitudinal Textual Data27 Aug 2026
- 2026Structured Learning on Mapper Representations22 Aug 2026
- 2026Fairness-Aware Network Embeddings: Methods, Applications, and Challenges19 Aug 2026
12 newest of 1,519 All 1,519 (JSON)