# UltraGCN: Ultra Simplification of Graph Convolutional Networks for Recommendation

arXiv: https://arxiv.org/abs/2110.15114 · HTML: https://mlsanity.com/paper/2110.15114/

## Key facts

- Cited by 87 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 28 Oct 2021.

## Built on by (most cited first, 30 of 87)

- [A Survey of Graph Neural Networks for Social Recommender Systems](https://mlsanity.com/paper/2212.04481/) (2022)
- [Blurring-Sharpening Process Models for Collaborative Filtering](https://mlsanity.com/paper/2211.09324/) (2022)
- [Survey on Graph Neural Network Acceleration: An Algorithmic Perspective](https://mlsanity.com/paper/2202.04822/) (2022)
- [Towards Graph Contrastive Learning: A Survey and Beyond](https://mlsanity.com/paper/2405.11868/) (2024)
- [PaGE-Link: Path-based Graph Neural Network Explanation for Heterogeneous Link Prediction](https://mlsanity.com/paper/2302.12465/) (2023)
- [Towards Unified Multi-Modal Personalization: Large Vision-Language Models for Generative Recommendation and Beyond](https://mlsanity.com/paper/2403.10667/) (2024)
- [HICF: Hyperbolic Informative Collaborative Filtering](https://mlsanity.com/paper/2207.09051/) (2022)
- [Embedding in Recommender Systems: A Survey](https://mlsanity.com/paper/2310.18608/) (2023)
- [ContextGNN: Beyond Two-Tower Recommendation Systems](https://mlsanity.com/paper/2411.19513/) (2024)
- [A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardware](https://mlsanity.com/paper/2306.14052/) (2023)
- [Collaborative Filtering Based on Diffusion Models: Unveiling the Potential of High-Order Connectivity](https://mlsanity.com/paper/2404.14240/) (2024)
- [GraphPro: Graph Pre-training and Prompt Learning for Recommendation](https://mlsanity.com/paper/2311.16716/) (2023)
- [Graph Collaborative Signals Denoising and Augmentation for Recommendation](https://mlsanity.com/paper/2304.03344/) (2023)
- [Collaboration-Aware Graph Convolutional Network for Recommender Systems](https://mlsanity.com/paper/2207.06221/) (2022)
- [STERLING: Synergistic Representation Learning on Bipartite Graphs](https://mlsanity.com/paper/2302.05428/) (2023)
- [Robust Collaborative Filtering to Popularity Distribution Shift](https://mlsanity.com/paper/2310.10696/) (2023)
- [MGDCF: Distance Learning via Markov Graph Diffusion for Neural Collaborative Filtering](https://mlsanity.com/paper/2204.02338/) (2022)
- [Large Language Model with Graph Convolution for Recommendation](https://mlsanity.com/paper/2402.08859/) (2024)
- [Neighborhood-Enhanced Supervised Contrastive Learning for Collaborative Filtering](https://mlsanity.com/paper/2402.11523/) (2024)
- [On Manipulating Signals of User-Item Graph: A Jacobi Polynomial-based Graph Collaborative Filtering](https://mlsanity.com/paper/2306.03624/) (2023)
- [Sheaf4Rec: Sheaf Neural Networks for Graph-based Recommender Systems](https://mlsanity.com/paper/2304.09097/) (2023)
- [Dynamic Sparse Learning: A Novel Paradigm for Efficient Recommendation](https://mlsanity.com/paper/2402.02855/) (2024)
- [Heterophily-Aware Fair Recommendation using Graph Convolutional Networks](https://mlsanity.com/paper/2402.03365/) (2024)
- [Collaborative-Enhanced Prediction of Spending on Newly Downloaded Mobile Games under Consumption Uncertainty](https://mlsanity.com/paper/2404.08301/) (2024)
- [Turbo-CF: Matrix Decomposition-Free Graph Filtering for Fast Recommendation](https://mlsanity.com/paper/2404.14243/) (2024)
- [Graph Spectral Filtering with Chebyshev Interpolation for Recommendation](https://mlsanity.com/paper/2505.00552/) (2025)
- [Personality-Driven Social Multimedia Content Recommendation](https://mlsanity.com/paper/2207.12236/) (2022)
- [Criteria Tell You More than Ratings: Criteria Preference-Aware Light Graph Convolution for Effective Multi-Criteria Recommendation](https://mlsanity.com/paper/2305.18885/) (2023)
- [Graph Neural Ordinary Differential Equations-based method for Collaborative Filtering](https://mlsanity.com/paper/2311.12329/) (2023)
- [BSL: Understanding and Improving Softmax Loss for Recommendation](https://mlsanity.com/paper/2312.12882/) (2023)

## Abstract (arXiv)

With the recent success of graph convolutional networks (GCNs), they have been widely applied for recommendation, and achieved impressive performance gains. The core of GCNs lies in its message passing mechanism to aggregate neighborhood information. However, we observed that message passing largely slows down the convergence of GCNs during training, especially for large-scale recommender systems, which hinders their wide adoption. LightGCN makes an early attempt to simplify GCNs for collaborative filtering by omitting feature transformations and nonlinear activations. In this paper, we take one step further to propose an ultra-simplified formulation of GCNs (dubbed UltraGCN), which skips infinite layers of message passing for efficient recommendation. Instead of explicit message passing, UltraGCN resorts to directly approximate the limit of infinite-layer graph convolutions via a constraint loss. Meanwhile, UltraGCN allows for more appropriate edge weight assignments and flexible adjustment of the relative importances among different types of relationships. This finally yields a simple yet effective UltraGCN model, which is easy to implement and efficient to train. Experimental results on four benchmark datasets show that UltraGCN not only outperforms the state-of-the-art GCN models but also achieves more than 10x speedup over LightGCN. Our source code will be available at https://reczoo.github.io/UltraGCN.
