Node Duplication Improves Cold-start Link Prediction
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) are prominent in graph machine learning and have shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless, recent studies show that GNNs struggle to produce good results on low-degree nodes despite their overall strong performance. In practical applications of LP, like recommendation systems, improving performance on low-degree nodes is critical, as it amounts to tackling the cold-start problem of improving the experiences of users with few observed interactions. In this paper, we investigate improving GNNs' LP performance on low-degree nodes while preserving their performance on high-degree nodes and propose a simple yet surprisingly effective augmentation technique called NodeDup. Specifically, NodeDup duplicates low-degree nodes and creates links between nodes and their own duplicates before following the standard supervised LP training scheme. By leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows significant LP performance improvements on low-degree nodes without compromising any performance on high-degree nodes. Additionally, as a plug-and-play augmentation module, NodeDup can be easily applied to existing GNNs with very light computational cost. Extensive experiments show that NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated, low-degree, and warm nodes, respectively, on average across all datasets compared to GNNs and state-of-the-art cold-start methods.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 67 of its 88 references that are in the map. First posted on arXiv 15 Feb 2024.
Builds on
67 of 88 references.
References · 67
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
38 more
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2016Complex Embeddings for Simple Link Predictioncited by 897
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
- 2018Link Prediction Based on Graph Neural Networkscited by 829
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 806
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
- 2020A Generalization of Transformer Networks to Graphscited by 653
- 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 397
- 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
- 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
- 2020Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learningcited by 292
- 2020Equalization Loss for Long-Tailed Object Recognitioncited by 285
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
- 2020Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effectcited by 256
- 2020Graph Random Neural Network for Semi-Supervised Learning on Graphscited by 213
- 2020Data Augmentation for Graph Neural Networkscited by 200
- 2018Hyperspherical Variational Auto-Encoderscited by 188
- 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 163
- 2020Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learningcited by 148
- 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 137
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
- 2020Line Graph Neural Networks for Link Predictioncited by 89
- 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
- 2022Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Predictioncited by 78
- 2022Graph Rationalization with Environment-based Augmentationscited by 70
- 2021Learning from Counterfactual Links for Link Predictioncited by 69
- 2019Few-Shot Knowledge Graph Completioncited by 63
- 2022Graph Data Augmentation for Graph Machine Learning: A Surveycited by 61
- 2019DEMO-Net: Degree-specific Graph Neural Networks for Node and Graph Classificationcited by 59
- 2021Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoodscited by 57
- 2021Graph Trend Filtering Networks for Recommendationscited by 53
- 2021Local Augmentation for Graph Neural Networkscited by 52
- 2021SafeDrug: Dual Molecular Graph Encoders for Recommending Effective and Safe Drug Combinationscited by 51
- 2022Graph-based Molecular Representation Learningcited by 51
- 2021Knowledge-aware Coupled Graph Neural Network for Social Recommendationcited by 49
- 2021Zero-Shot Recommender Systemscited by 45
- 2020GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systemscited by 42
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2025GiGL: Large-Scale Graph Neural Networks at Snapchatcited by 8
- 2024How Does Message Passing Improve Collaborative Filtering?cited by 5
- 2025Diffusion on Graph: Augmentation of Graph Structure for Node Classificationcited by 4
- 2025Graph-Assisted Culturally Adaptable Idiomatic Translation for Indic Languagescited by 1
- 2025Graph-Assisted Culturally Adaptable Idiomatic Translation for Indic Languages28 May 2025
- 2025Diffusion on Graph: Augmentation of Graph Structure for Node Classification16 Mar 2025
- 2025GiGL: Large-Scale Graph Neural Networks at Snapchat20 Feb 2025
- 2024How Does Message Passing Improve Collaborative Filtering?27 Mar 2024