# Dual Space Graph Contrastive Learning

arXiv: https://arxiv.org/abs/2201.07409 · HTML: https://mlsanity.com/paper/2201.07409/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 39 references that are in the map.
- First posted on arXiv 19 Jan 2022.

## Builds on (most cited first, 24 of 24)

- [Semi-Supervised Classification with Graph Convolutional Networks](https://mlsanity.com/paper/1609.02907/) (2016)
- [Graph Attention Networks](https://mlsanity.com/paper/1710.10903/) (2017)
- [Inductive Representation Learning on Large Graphs](https://mlsanity.com/paper/1706.02216/) (2017)
- [How Powerful are Graph Neural Networks?](https://mlsanity.com/paper/1810.00826/) (2018)
- [Learning deep representations by mutual information estimation and maximization](https://mlsanity.com/paper/1808.06670/) (2018)
- [Graph Contrastive Learning with Augmentations](https://mlsanity.com/paper/2010.13902/) (2020)
- [Deep Graph Infomax](https://mlsanity.com/paper/1809.10341/) (2018)
- [Convolutional Networks on Graphs for Learning Molecular Fingerprints](https://mlsanity.com/paper/1509.09292/) (2015)
- [Poincar'e Embeddings for Learning Hierarchical Representations](https://mlsanity.com/paper/1705.08039/) (2017)
- [Contrastive Multi-View Representation Learning on Graphs](https://mlsanity.com/paper/2006.05582/) (2020)
- [Graph Contrastive Learning with Adaptive Augmentation](https://mlsanity.com/paper/2010.14945/) (2020)
- [GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training](https://mlsanity.com/paper/2006.09963/) (2020)
- [Hyperbolic Graph Convolutional Neural Networks](https://mlsanity.com/paper/1910.12933/) (2019)
- [Graph Representation Learning via Graphical Mutual Information Maximization](https://mlsanity.com/paper/2002.01169/) (2020)
- [Multi-view Graph Contrastive Representation Learning for Drug-Drug Interaction Prediction](https://mlsanity.com/paper/2010.11711/) (2020)
- [Self-Supervised Graph Representation Learning via Global Context Prediction](https://mlsanity.com/paper/2003.01604/) (2020)
- [Where are we in embedding spaces? A Comprehensive Analysis on Network Embedding Approaches for Recommender Systems](https://mlsanity.com/paper/2105.08908/) (2021)
- [Hyperbolic Hypergraphs for Sequential Recommendation](https://mlsanity.com/paper/2108.08134/) (2021)
- [Hyper Meta-Path Contrastive Learning for Multi-Behavior Recommendation](https://mlsanity.com/paper/2109.02859/) (2021)
- [Fast Sequence-Based Embedding with Diffusion Graphs](https://mlsanity.com/paper/2001.07463/) (2020)
- [Hyperbolic Node Embedding for Signed Networks](https://mlsanity.com/paper/1910.13090/) (2019)
- [Hyperbolic Neural Collaborative Recommender](https://mlsanity.com/paper/2104.07414/) (2021)
- [HCGR: Hyperbolic Contrastive Graph Representation Learning for Session-based Recommendation](https://mlsanity.com/paper/2107.05366/) (2021)
- [Interpretable Signed Link Prediction with Signed Infomax Hyperbolic Graph](https://mlsanity.com/paper/2011.12517/) (2020)

## Built on by (most cited first, 20 of 20)

- [GraphGPT: Graph Instruction Tuning for Large Language Models](https://mlsanity.com/paper/2310.13023/) (2023)
- [A Comprehensive Survey on Deep Graph Representation Learning](https://mlsanity.com/paper/2304.05055/) (2023)
- [CoCo: A Coupled Contrastive Framework for Unsupervised Domain Adaptive Graph Classification](https://mlsanity.com/paper/2306.04979/) (2023)
- [Self-Supervised Continual Graph Learning in Adaptive Riemannian Spaces](https://mlsanity.com/paper/2211.17068/) (2022)
- [A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learning](https://mlsanity.com/paper/2208.14073/) (2022)
- [DeepRicci: Self-supervised Graph Structure-Feature Co-Refinement for Alleviating Over-squashing](https://mlsanity.com/paper/2401.12780/) (2024)
- [Contrastive Graph Clustering in Curvature Spaces](https://mlsanity.com/paper/2305.03555/) (2023)
- [Generating Counterfactual Hard Negative Samples for Graph Contrastive Learning](https://mlsanity.com/paper/2207.00148/) (2022)
- [MA-GCL: Model Augmentation Tricks for Graph Contrastive Learning](https://mlsanity.com/paper/2212.07035/) (2022)
- [KRACL: Contrastive Learning with Graph Context Modeling for Sparse Knowledge Graph Completion](https://mlsanity.com/paper/2208.07622/) (2022)
- [A Survey on Self-Supervised Graph Foundation Models: Knowledge-Based Perspective](https://mlsanity.com/paper/2403.16137/) (2024)
- [LATEX-GCL: Large Language Models (LLMs)-Based Data Augmentation for Text-Attributed Graph Contrastive Learning](https://mlsanity.com/paper/2409.01145/) (2024)
- [Heterogeneous Social Event Detection via Hyperbolic Graph Representations](https://mlsanity.com/paper/2302.10362/) (2023)
- [Contrastive Sequential Interaction Network Learning on Co-Evolving Riemannian Spaces](https://mlsanity.com/paper/2401.01243/) (2024)
- [Mitigating the Performance Sacrifice in DP-Satisfied Federated Settings through Graph Contrastive Learning](https://mlsanity.com/paper/2207.11836/) (2022)
- [Self-supervised Representation Learning on Electronic Health Records with Graph Kernel Infomax](https://mlsanity.com/paper/2209.00655/) (2022)
- [Structure-Aware Consensus Network on Graphs with Few Labeled Nodes](https://mlsanity.com/paper/2407.02188/) (2024)
- [Why are hyperbolic neural networks effective? A study on hierarchical representation capability](https://mlsanity.com/paper/2402.02478/) (2024)
- [Subgraph Networks Based Contrastive Learning](https://mlsanity.com/paper/2306.03506/) (2023)
- [Cross-Domain Molecular Relational Learning: Leveraging Chemical Structure-Activity Analysis](https://mlsanity.com/paper/2605.16799/) (2026)

## Abstract (arXiv)

Unsupervised graph representation learning has emerged as a powerful tool to address real-world problems and achieves huge success in the graph learning domain. Graph contrastive learning is one of the unsupervised graph representation learning methods, which recently attracts attention from researchers and has achieved state-of-the-art performances on various tasks. The key to the success of graph contrastive learning is to construct proper contrasting pairs to acquire the underlying structural semantics of the graph. However, this key part is not fully explored currently, most of the ways generating contrasting pairs focus on augmenting or perturbating graph structures to obtain different views of the input graph. But such strategies could degrade the performances via adding noise into the graph, which may narrow down the field of the applications of graph contrastive learning. In this paper, we propose a novel graph contrastive learning method, namely Dual Space Graph Contrastive (DSGC) Learning, to conduct graph contrastive learning among views generated in different spaces including the hyperbolic space and the Euclidean space. Since both spaces have their own advantages to represent graph data in the embedding spaces, we hope to utilize graph contrastive learning to bridge the spaces and leverage advantages from both sides. The comparison experiment results show that DSGC achieves competitive or better performances among all the datasets. In addition, we conduct extensive experiments to analyze the impact of different graph encoders on DSGC, giving insights about how to better leverage the advantages of contrastive learning between different spaces.
