Capturing Fine-grained Semantics in Contrastive Graph Representation Learning
Not on the map. Why?
Abstract (arXiv)
Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past few years. Nevertheless, existing methods of graph contrastive learning ignore the differences between diverse semantics existed in graphs, which learn coarse-grained node embeddings and lead to sub-optimal performances on downstream tasks. To bridge this gap, we propose a novel Fine-grained Semantics enhanced Graph Contrastive Learning (FSGCL) in this paper. Concretely, FSGCL first introduces a motif-based graph construction, which employs graph motifs to extract diverse semantics existed in graphs from the perspective of input data. Then, the semantic-level contrastive task is explored to further enhance the utilization of fine-grained semantics from the perspective of model training. Experiments on five real-world datasets demonstrate the superiority of our proposed FSGCL over state-of-the-art methods. To make the results reproducible, we will make our codes public on GitHub after this paper is accepted.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 42 references that are in the map. First posted on arXiv 23 Apr 2023.
Builds on
27 of 42 references.
References · 27
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2018Deep Graph Infomaxcited by 1,106
- 2020What Makes for Good Views for Contrastive Learning?cited by 846
- 2020Contrastive Multi-View Representation Learning on Graphscited by 652
- 2020Deep Graph Contrastive Representation Learningcited by 539
15 more
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2019Diffusion Improves Graph Learningcited by 414
- 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
- 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 186
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
- 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
- 2017Network Representation Learning: A Surveycited by 101
- 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
- 2021ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learningcited by 72
- 2017Contrastive Learning for Image Captioningcited by 54
- 2021Prototypical Graph Contrastive Learningcited by 37
- 2019Deep Representation Learning for Social Network Analysiscited by 35
- 2017Motif-based Convolutional Neural Network on Graphscited by 7
- 2019motif2vec: Motif Aware Node Representation Learning for Heterogeneous Networkscited by 6
Built on by
Not cited yet.