Dual-Kernel Graph Community Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message passing mechanism of GNN and the quadratic computational complexity of contrastive loss over positive and negative node pairs. To address these issues, we propose an efficient GCL framework that transforms the input graph into a compact network of interconnected node sets while preserving structural information across communities. We firstly introduce a kernelized graph community contrastive loss with linear complexity, enabling effective information transfer among node sets to capture hierarchical structural information of the graph. We then incorporate a knowledge distillation technique into the decoupled GNN architecture to accelerate inference while maintaining strong generalization performance. Extensive experiments on sixteen real-world datasets of varying scales demonstrate that our method outperforms state-of-the-art GCL baselines in both effectiveness and scalability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
22 of 45 references.
References · 22
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2018Deep Graph Infomaxcited by 1,106
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2019Multi-scale Attributed Node Embeddingcited by 548
- 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 541
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
10 more
- 2020A unifying mutual information view of metric learning: cross-entropy vs. pairwise lossescited by 100
- 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 69
- 2024Polynormer: Polynomial-Expressive Graph Transformer in Linear Timecited by 65
- 2022Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminatingcited by 57
- 2023Neighbor Contrastive Learning on Learnable Graph Augmentationcited by 25
- 2023Quantifying the Knowledge in GNNs for Reliable Distillation into MLPscited by 25
- 2022Single-Pass Contrastive Learning Can Work for Both Homophilic and Heterophilic Graphcited by 14
- 2024Cluster-wise Graph Transformer with Dual-granularity Kernelized Attentioncited by 8
- 2025Does GCL Need a Large Number of Negative Samples? Enhancing Graph Contrastive Learning with Effective and Efficient Negative Samplingcited by 8
- 2021Multiple Kernel Representation Learning on Networkscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2021On Representation Knowledge Distillation for Graph Neural Networks
- 2023Rethinking and Simplifying Bootstrapped Graph Latents
- 2023Hierarchical Topology Isomorphism Expertise Embedded Graph Contrastive Learning
- 2025Node-level Contrastive Unlearning on Graph Neural Networks
- 2023Graph Self-Contrast Representation Learning
- 2025Simple Graph Contrastive Learning via Fractional-order Neural Diffusion Networks
- 2024GraphEdit: Large Language Models for Graph Structure Learning
- 2023A Graph is Worth 1-bit Spikes: When Graph Contrastive Learning Meets Spiking Neural Networks