How Expressive are Graph Neural Networks in Recommendation?
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have demonstrated superior performance on various graph learning tasks, including recommendation, where they leverage user-item collaborative filtering signals in graphs. However, theoretical formulations of their capability are scarce, despite their empirical effectiveness in state-of-the-art recommender models. Recently, research has explored the expressiveness of GNNs in general, demonstrating that message passing GNNs are at most as powerful as the Weisfeiler-Lehman test, and that GNNs combined with random node initialization are universal. Nevertheless, the concept of "expressiveness" for GNNs remains vaguely defined. Most existing works adopt the graph isomorphism test as the metric of expressiveness, but this graph-level task may not effectively assess a model's ability in recommendation, where the objective is to distinguish nodes of different closeness. In this paper, we provide a comprehensive theoretical analysis of the expressiveness of GNNs in recommendation, considering three levels of expressiveness metrics: graph isomorphism (graph-level), node automorphism (node-level), and topological closeness (link-level). We propose the topological closeness metric to evaluate GNNs' ability to capture the structural distance between nodes, which aligns closely with the objective of recommendation. To validate the effectiveness of this new metric in evaluating recommendation performance, we introduce a learning-less GNN algorithm that is optimal on the new metric and can be optimal on the node-level metric with suitable modification. We conduct extensive experiments comparing the proposed algorithm against various types of state-of-the-art GNN models to explore the explainability of the new metric in the recommendation task. For reproducibility, implementation codes are available at https://github.com/HKUDS/GTE.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 30 of its 42 references that are in the map. First posted on arXiv 22 Aug 2023.
Builds on
30 of 42 references.
References · 30
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2019Neural Graph Collaborative Filteringcited by 661
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2017Representation Learning on Graphs: Methods and Applicationscited by 457
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2020The Surprising Power of Graph Neural Networks with Random Node Initializationcited by 198
18 more
- 2020Random Features Strengthen Graph Neural Networkscited by 186
- 2019Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approachescited by 185
- 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
- 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
- 2020A Survey on Knowledge Graph-Based Recommender Systemscited by 170
- 2020Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approachcited by 120
- 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendationcited by 72
- 2019A Troubling Analysis of Reproducibility and Progress in Recommender Systems Researchcited by 65
- 2022Hypergraph Contrastive Collaborative Filteringcited by 63
- 2019STAR-GCN: Stacked and Reconstructed Graph Convolutional Networks for Recommender Systemscited by 54
- 2021How Powerful is Graph Convolution for Recommendation?cited by 50
- 2023Multi-Modal Self-Supervised Learning for Recommendationcited by 45
- 2021Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior Recommendationcited by 39
- 2022Self-Supervised Hypergraph Transformer for Recommender Systemscited by 32
- 2023Graph Transformer for Recommendationcited by 28
- 2023Disentangled Contrastive Collaborative Filteringcited by 22
- 2020SAIL: Self-Augmented Graph Contrastive Learningcited by 20
- 2020Critically Examining the Claimed Value of Convolutions over User-Item Embedding Maps for Recommender Systemscited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.