mlsanityData to 14 Oct 2026

Rethinking Graph Contrastive Learning through Relative Similarity Preservation

arXiv 2505.05533 ↗First posted 8 May 2025cs.LG cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Graph contrastive learning (GCL) has achieved remarkable success by following the computer vision paradigm of preserving absolute similarity between augmented views. However, this approach faces fundamental challenges in graphs due to their discrete, non-Euclidean nature -- view generation often breaks semantic validity and similarity verification becomes unreliable. Through analyzing 11 real-world graphs, we discover a universal pattern transcending the homophily-heterophily dichotomy: label consistency systematically diminishes as structural distance increases, manifesting as smooth decay in homophily graphs and oscillatory decay in heterophily graphs. We establish theoretical guarantees for this pattern through random walk theory, proving label distribution convergence and characterizing the mechanisms behind different decay behaviors. This discovery reveals that graphs naturally encode relative similarity patterns, where structurally closer nodes exhibit collectively stronger semantic relationships. Leveraging this insight, we propose RELGCL, a novel GCL framework with complementary pairwise and listwise implementations that preserve these inherent patterns through collective similarity objectives. Extensive experiments demonstrate that our method consistently outperforms 20 existing approaches across both homophily and heterophily graphs, validating the effectiveness of leveraging natural relative similarity over artificial absolute similarity.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

45 of 61 references.

References · 45

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  7. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  8. 2020Supervised Contrastive Learningcited by 2,829
  9. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  10. 2016Variational Graph Auto-Encoderscited by 1,382
  11. 2018Deep Graph Infomaxcited by 1,106
  12. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
33 more
  1. 2015Image-based Recommendations on Styles and Substitutescited by 706
  2. 2020Contrastive Multi-View Representation Learning on Graphscited by 652
  3. 2019Multi-scale Attributed Node Embeddingcited by 548
  4. 2020Deep Graph Contrastive Representation Learningcited by 539
  5. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  6. 2019End-to-End Learning of Visual Representations from Uncurated Instructional Videoscited by 507
  7. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  8. 2019On Mutual Information Maximization for Representation Learningcited by 316
  9. 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
  10. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 186
  11. 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 141
  12. 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
  13. 2021Graph Barlow Twins: A self-supervised representation learning framework for graphscited by 85
  14. 2022Characterizing Graph Datasets for Node Classification: Homophily-Heterophily Dichotomy and Beyondcited by 60
  15. 2021Automated Self-Supervised Learning for Graphscited by 50
  16. 2023Simple and Asymmetric Graph Contrastive Learning without Augmentationscited by 38
  17. 2021Prototypical Graph Contrastive Learningcited by 37
  18. 2022Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positivescited by 37
  19. 2021Graph Communal Contrastive Learningcited by 34
  20. 2023HomoGCL: Rethinking Homophily in Graph Contrastive Learningcited by 18
  21. 2022Graph Soft-Contrastive Learning via Neighborhood Rankingcited by 16
  22. 2021Towards Graph Self-Supervised Learning with Contrastive Adjusted Zoomingcited by 15
  23. 2022Single-Pass Contrastive Learning Can Work for Both Homophilic and Heterophilic Graphcited by 14
  24. 2021LightCAKE: A Lightweight Framework for Context-Aware Knowledge Graph Embeddingcited by 11
  25. 2024scCDCG: Efficient Deep Structural Clustering for single-cell RNA-seq via Deep Cut-informed Graph Embeddingcited by 10
  26. 2021RPT: Toward Transferable Model on Heterogeneous Researcher Data via Pre-Trainingcited by 9
  27. 2023Adaptive Path-Memory Network for Temporal Knowledge Graph Reasoningcited by 9
  28. 2023Temporal Inductive Path Neural Network for Temporal Knowledge Graph Reasoningcited by 9
  29. 2024FedGCS: A Generative Framework for Efficient Client Selection in Federated Learning via Gradient-based Optimizationcited by 9
  30. 2023PathMLP: Smooth Path Towards High-order Homophilycited by 8
  31. 2025Deep Cut-informed Graph Embedding and Clusteringcited by 7
  32. 2020Context-Enhanced Entity and Relation Embedding for Knowledge Graph Completioncited by 6
  33. 2020Conformity: A Path-Aware Homophily Measure for Node-Attributed Networkscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.