mlsanityData to 7 Oct 2026

Node Duplication Improves Cold-start Link Prediction

arXiv 2402.09711 ↗First posted 15 Feb 2024cs.LG cs.SIcited by 4

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) are prominent in graph machine learning and have shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless, recent studies show that GNNs struggle to produce good results on low-degree nodes despite their overall strong performance. In practical applications of LP, like recommendation systems, improving performance on low-degree nodes is critical, as it amounts to tackling the cold-start problem of improving the experiences of users with few observed interactions. In this paper, we investigate improving GNNs' LP performance on low-degree nodes while preserving their performance on high-degree nodes and propose a simple yet surprisingly effective augmentation technique called NodeDup. Specifically, NodeDup duplicates low-degree nodes and creates links between nodes and their own duplicates before following the standard supervised LP training scheme. By leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows significant LP performance improvements on low-degree nodes without compromising any performance on high-degree nodes. Additionally, as a plug-and-play augmentation module, NodeDup can be easily applied to existing GNNs with very light computational cost. Extensive experiments show that NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated, low-degree, and warm nodes, respectively, on average across all datasets compared to GNNs and state-of-the-art cold-start methods.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 67 of its 88 references that are in the map. First posted on arXiv 15 Feb 2024.

Builds on

67 of 88 references.

References · 67

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  7. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  8. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  9. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  10. 2016Variational Graph Auto-Encoderscited by 1,373
  11. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  12. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
38 more
  1. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  2. 2016Complex Embeddings for Simple Link Predictioncited by 897
  3. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
  4. 2018Link Prediction Based on Graph Neural Networkscited by 829
  5. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  6. 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 806
  7. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
  8. 2020A Generalization of Transformer Networks to Graphscited by 653
  9. 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 397
  10. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
  11. 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
  12. 2020Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learningcited by 292
  13. 2020Equalization Loss for Long-Tailed Object Recognitioncited by 285
  14. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
  15. 2020Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effectcited by 256
  16. 2020Graph Random Neural Network for Semi-Supervised Learning on Graphscited by 213
  17. 2020Data Augmentation for Graph Neural Networkscited by 200
  18. 2018Hyperspherical Variational Auto-Encoderscited by 188
  19. 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 163
  20. 2020Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learningcited by 148
  21. 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 137
  22. 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
  23. 2020Line Graph Neural Networks for Link Predictioncited by 89
  24. 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
  25. 2022Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Predictioncited by 78
  26. 2022Graph Rationalization with Environment-based Augmentationscited by 70
  27. 2021Learning from Counterfactual Links for Link Predictioncited by 69
  28. 2019Few-Shot Knowledge Graph Completioncited by 63
  29. 2022Graph Data Augmentation for Graph Machine Learning: A Surveycited by 61
  30. 2019DEMO-Net: Degree-specific Graph Neural Networks for Node and Graph Classificationcited by 59
  31. 2021Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoodscited by 57
  32. 2021Graph Trend Filtering Networks for Recommendationscited by 53
  33. 2021Local Augmentation for Graph Neural Networkscited by 52
  34. 2021SafeDrug: Dual Molecular Graph Encoders for Recommending Effective and Safe Drug Combinationscited by 51
  35. 2022Graph-based Molecular Representation Learningcited by 51
  36. 2021Knowledge-aware Coupled Graph Neural Network for Social Recommendationcited by 49
  37. 2021Zero-Shot Recommender Systemscited by 45
  38. 2020GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systemscited by 42

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.