Multi-scale Attributed Node Embedding
Not on the map. Why?
Abstract (arXiv)
We present network embedding algorithms that capture information about a node from the local distribution over node attributes around it, as observed over random walks following an approach similar to Skip-gram. Observations from neighborhoods of different sizes are either pooled (AE) or encoded distinctly in a multi-scale approach (MUSAE). Capturing attribute-neighborhood relationships over multiple scales is useful for a diverse range of applications, including latent feature identification across disconnected networks with similar attributes. We prove theoretically that matrices of node-feature pointwise mutual information are implicitly factorized by the embeddings. Experiments show that our algorithms are robust, computationally efficient and outperform comparable models on social networks and web graphs.
Key facts. Cited by 548 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 57; 2022: 97; 2023: 103; 2024: 125; 2025: 101; 2026: 65.
548 papers.
Sort:
By area:
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
- 2021Is Homophily a Necessity for Graph Neural Networks?cited by 182
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2022Revisiting Heterophily For Graph Neural Networkscited by 169
38 more
- 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 164
- 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 138
- 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 133
- 2021MagNet: A Neural Network for Directed Graphscited by 107
- 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
- 2022How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervisioncited by 102
- 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
- 2022Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci Curvaturecited by 98
- 2022Out-Of-Distribution Generalization on Graphs: A Surveycited by 97
- 2021Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patternscited by 95
- 2022Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networkscited by 94
- 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
- 2024Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classificationcited by 85
- 2021GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophilycited by 84
- 2023Attending to Graph Transformerscited by 83
- 2021New Benchmarks for Learning on Non-Homophilous Graphscited by 81
- 2022Empowering Graph Representation Learning with Test-Time Graph Transformationcited by 67
- 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
- 2021LinkTeller: Recovering Private Edges from Graph Neural Networks via Influence Analysiscited by 65
- 2022Sheaf Neural Networks with Connection Laplacianscited by 65
- 2022On the Trade-off between Over-smoothing and Over-squashing in Deep Graph Neural Networkscited by 64
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 62
- 2022Characterizing Graph Datasets for Node Classification: Homophily-Heterophily Dichotomy and Beyondcited by 60
- 2022Understanding convolution on graphs via energiescited by 59
- 2022GraphFramEx: Towards Systematic Evaluation of Explainability Methods for Graph Neural Networkscited by 58
- 2021Simplifying approach to Node Classification in Graph Neural Networkscited by 56
- 2022GREAD: Graph Neural Reaction-Diffusion Networkscited by 54
- 2021Local Augmentation for Graph Neural Networkscited by 53
- 2022KerGNNs: Interpretable Graph Neural Networks with Graph Kernelscited by 50
- 2021Twitch Gamers: a Dataset for Evaluating Proximity Preserving and Structural Role-based Node Embeddingscited by 49
- 2022Gradient Gating for Deep Multi-Rate Learning on Graphscited by 49
- 2023A Fractional Graph Laplacian Approach to Oversmoothingcited by 45
- 2021Boost then Convolve: Gradient Boosting Meets Graph Neural Networkscited by 44
- 2021Improving Graph Neural Networks with Simple Architecture Designcited by 41
- 2022TAM: Topology-Aware Margin Loss for Class-Imbalanced Node Classificationcited by 41
- 2023Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?cited by 41
- 2023Mitigating Over-Smoothing and Over-Squashing using Augmentations of Forman-Ricci Curvaturecited by 41
- 2021Scalable Rule-Based Representation Learning for Interpretable Classificationcited by 40
50 most cited of 548 All 548 (JSON)
- 2026Riemannian Graph Tokenizer for Structural Knowledge Transfer11 Oct 2026
- 2026When Edge Independence Fails: Joint Graph Diffusion with Latent Sociability Priors9 Oct 2026
- 2026GNN-CB: A Graph Neural Network Competition Benchmark for Human and LLM Evaluation4 Oct 2026
- 2026When Is a Graph a Covariance? Bayesian Residual Propagation under Covariance Uncertainty4 Oct 2026
- 2026Mitigating Over-squashing without Rewiring: A Sheaf Effective Resistance Perspective3 Oct 2026
- 2026NodeGround: A Node Classification Benchmark in the Graph Foundation Model Era30 Sep 2026
- 2026Message Passing Does More with Less for In-Context Learning on Graphs29 Sep 2026
- 2026Reference-Tail Trust:Certified Probability Floors for Learned Updates Inside a Deployed Network28 Sep 2026
- 2026Hierarchical Clustering and Signal Denoising on Digraphs28 Sep 2026
- 2026TwinS-GCN: Spectral conjugate for Spectral Graph Convolutional Networks26 Sep 2026
- 2026Efficient Dynamic Algorithms for Graph Neural Networks with Non-Linear Propagation26 Sep 2026
- 2026Learning the Graph and the Embedding Together: Classifier-Independent Rewiring for Heterophilic Node Classification26 Sep 2026
38 more
- 2026Preserving Geometric Integrity in Graph Prompting via Measure-Constrained Optimal Transport20 Sep 2026
- 2026When Connected Does Not Mean Similar: Charting the Homophily Boundary of SNAP-KG for Streaming Entity Integration11 Sep 2026
- 2026HOPE: Heterophily-Aware Open-Set Node Classification with Pseudo-Extrapolation8 Sep 2026
- 2026Multi-granularity Adaptive Hypergraph Representation Learning via Granular-ball4 Sep 2026
- 2026Transportable Causal Effect Estimation across Networks under Interference19 Aug 2026
- 2026Pair-Centric Graph Rewiring for Over-Squashing via Optimal Transport-Guided Communication Alignment11 Aug 2026
- 2026CoRe-GNN: Multilevel Message passing on Coarsened graphs3 Aug 2026
- 2026Differentiable Lifting for Topological Neural Networks2 Aug 2026
- 2026What Makes Graph Unified? Principles and Generative Sliding-Window Transformer for Graph Foundation Models30 Jul 2026
- 2026Selectivity Matters: Source Node Influence Pruning for Unsupervised Graph Domain Adaptation20 Jul 2026
- 2026Measuring What Matters: A Unified Evaluation Framework for GNN Explainability6 Jul 2026
- 2026Swarm-Inspired Generation of Collective Behaviors in Graph Dynamical Systems23 Jun 2026
- 2026Convex--Concave Quadratic Spectral Filtering for Graph Neural Networks23 Jun 2026
- 2026Enhanced Graph Neural Networks using K-Hop Gaussian Diffusion16 Jun 2026
- 2026Revisiting Positive Samples in Graph Contrastive Learning: From the Perspective of Message Passing9 Jun 2026
- 2026Differentially Private Range Subgraph Counting6 Jun 2026
- 2026Are Common Substructures Transferable? Riemannian Graph Foundation Model with Neural Vector Bundles2 Jun 2026
- 2026Do Deep Ensembles Actually Capture Uncertainty in Graph Neural Networks?21 May 2026
- 2026Graph Navier Stokes Networks20 May 2026
- 2026GFMate: Empowering Graph Foundation Models with Test-time Prompt Tuning14 May 2026
- 2026Random-Set Graph Neural Networks12 May 2026
- 2026Full-Spectrum Graph Neural Networks: Expressive and Scalable7 May 2026
- 2026Adversarial Graph Neural Network Benchmarks: Towards Practical and Fair Evaluation7 May 2026
- 2026Quantile-Free Uncertainty Quantification in Graph Neural Networks6 May 2026
- 2026Graph Reconstruction from Differentially Private GNN Explanations5 May 2026
- 2026GRAFT: Auditing Graph Neural Networks via Global Feature Attribution5 May 2026
- 2026Latent-Hysteresis Graph ODEs: Modeling Coupled Topology-Feature Evolution via Continuous Phase Transitions27 Apr 2026
- 2026Layer Embedding Deep Fusion Graph Neural Network25 Apr 2026
- 2026Operational Feature Fingerprints of Graph Datasets via a White-Box Signal-Subspace Probe24 Apr 2026
- 2026Learning Posterior Predictive Distributions for Node Classification from Synthetic Graph Priors21 Apr 2026
- 2026Beyond the Laplacian: Doubly Stochastic Matrices for Graph Neural Networks16 Apr 2026
- 2026Learning How Much to Think: Difficulty-Aware Dynamic MoEs for Graph Node Classification13 Apr 2026
- 2026The Impact of Dimensionality on the Stability of Node Embeddings9 Apr 2026
- 2026ASPECT: Node-Level Adaptive Spectral Fusion for Graph Contrastive Learning2 Apr 2026
- 2026Predicting Dynamics of Ultra-Large Complex Systems by Inferring Governing Equations1 Apr 2026
- 2026Geometric Evolution Graph Convolutional Networks: Enhancing Graph Representation Learning via Ricci Flow27 Mar 2026
- 2026Can Graph Foundation Models Generalize Over Architecture?24 Mar 2026
- 2026P2GNN: Two Prototype Sets to boost GNN Performance10 Mar 2026
50 newest of 548 All 548 (JSON)
- 2024Node-wise Filtering in Graph Neural Networks: A Mixture of Experts Approachcited by 17
- 2024Mixture of Link Predictors on Graphscited by 10
- 2024Mixture of Experts for Node Classificationcited by 4
- 2025Adaptive Graph Mixture of Residual Experts: Unsupervised Learning on Diverse Graphs with Heterogeneous Specializationcited by 0
- 2026Learning How Much to Think: Difficulty-Aware Dynamic MoEs for Graph Node Classificationcited by 0
- 2026Learning How Much to Think: Difficulty-Aware Dynamic MoEs for Graph Node Classification13 Apr 2026
- 2025Adaptive Graph Mixture of Residual Experts: Unsupervised Learning on Diverse Graphs with Heterogeneous Specialization24 Oct 2025
- 2024Mixture of Experts for Node Classification30 Nov 2024
- 2024Node-wise Filtering in Graph Neural Networks: A Mixture of Experts Approach5 Jun 2024
- 2024Mixture of Link Predictors on Graphs13 Feb 2024
- 2022T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillationcited by 32
- 2022FreeKD: Free-direction Knowledge Distillation for Graph Neural Networkscited by 23
- 2023Shared Growth of Graph Neural Networks via Prompted Free-direction Knowledge Distillationcited by 1
- 2023Shared Growth of Graph Neural Networks via Prompted Free-direction Knowledge Distillation2 Jul 2023
- 2022T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation24 Dec 2022
- 2022FreeKD: Free-direction Knowledge Distillation for Graph Neural Networks14 Jun 2022
- 2025GCoT: Chain-of-Thought Prompt Learning for Graphscited by 9
- 2025GCoT: Chain-of-Thought Prompt Learning for Graphs12 Feb 2025
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
- 2021Is Homophily a Necessity for Graph Neural Networks?cited by 182
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2022Revisiting Heterophily For Graph Neural Networkscited by 169
12 most cited of 531 All 531 (JSON)
- 2026Riemannian Graph Tokenizer for Structural Knowledge Transfer11 Oct 2026
- 2026GNN-CB: A Graph Neural Network Competition Benchmark for Human and LLM Evaluation4 Oct 2026
- 2026When Is a Graph a Covariance? Bayesian Residual Propagation under Covariance Uncertainty4 Oct 2026
- 2026Mitigating Over-squashing without Rewiring: A Sheaf Effective Resistance Perspective3 Oct 2026
- 2026NodeGround: A Node Classification Benchmark in the Graph Foundation Model Era30 Sep 2026
- 2026Message Passing Does More with Less for In-Context Learning on Graphs29 Sep 2026
- 2026Reference-Tail Trust:Certified Probability Floors for Learned Updates Inside a Deployed Network28 Sep 2026
- 2026Hierarchical Clustering and Signal Denoising on Digraphs28 Sep 2026
- 2026TwinS-GCN: Spectral conjugate for Spectral Graph Convolutional Networks26 Sep 2026
- 2026Efficient Dynamic Algorithms for Graph Neural Networks with Non-Linear Propagation26 Sep 2026
- 2026Learning the Graph and the Embedding Together: Classifier-Independent Rewiring for Heterophilic Node Classification26 Sep 2026
- 2026Preserving Geometric Integrity in Graph Prompting via Measure-Constrained Optimal Transport20 Sep 2026
12 newest of 531 All 531 (JSON)