Subgraph Gaussian Embedding Contrast for Self-Supervised Graph Representation Learning
Not on the map. Why?
Abstract (arXiv)
Graph Representation Learning (GRL) is a fundamental task in machine learning, aiming to encode high-dimensional graph-structured data into low-dimensional vectors. Self-Supervised Learning (SSL) methods are widely used in GRL because they can avoid expensive human annotation. In this work, we propose a novel Subgraph Gaussian Embedding Contrast (SubGEC) method. Our approach introduces a subgraph Gaussian embedding module, which adaptively maps subgraphs to a structured Gaussian space, ensuring the preservation of input subgraph characteristics while generating subgraphs with a controlled distribution. We then employ optimal transport distances, more precisely the Wasserstein and Gromov-Wasserstein distances, to effectively measure the similarity between subgraphs, enhancing the robustness of the contrastive learning process. Extensive experiments across multiple benchmarks demonstrate that method~outperforms or presents competitive performance against state-of-the-art approaches. Our findings provide insights into the design of SSL methods for GRL, emphasizing the importance of the distribution of the generated contrastive pairs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 55 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
38 of 55 references.
References · 38
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2018Deep Graph Infomaxcited by 1,106
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 786
26 more
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2020A Survey on Contrastive Self-supervised Learningcited by 554
- 2019Multi-scale Attributed Node Embeddingcited by 548
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
- 2019Diffusion Improves Graph Learningcited by 414
- 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 378
- 2016Stochastic Optimization for Large-scale Optimal Transportcited by 189
- 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 186
- 2018Optimal Transport for structured data with application on graphscited by 172
- 2018Fused Gromov-Wasserstein distance for structured objects: theoretical foundations and mathematical propertiescited by 93
- 2020Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learningcited by 90
- 2023A Comprehensive Survey on Deep Graph Representation Learningcited by 72
- 2018A Twofold Siamese Network for Real-Time Object Trackingcited by 62
- 2022Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminatingcited by 57
- 2017Optimal transport for Gaussian mixture modelscited by 45
- 2024Towards Graph Contrastive Learning: A Survey and Beyondcited by 26
- 2022Learning to Predict Graphs with Fused Gromov-Wasserstein Barycenterscited by 22
- 2023MUSE: Multi-View Contrastive Learning for Heterophilic Graphscited by 13
- 2022Generative Subgraph Contrast for Self-Supervised Graph Representation Learningcited by 8
- 2023The Gromov-Wasserstein distance between spherescited by 6
- 2024Bootstrap Latents of Nodes and Neighbors for Graph Self-Supervised Learningcited by 6
- 2020Optimal transport for vector Gaussian mixture modelscited by 1
- 2025A Fused Gromov-Wasserstein Approach to Subgraph Contrastive Learningcited by 1
Built on by
Not cited yet.