A Unified Perspective for Learning Graph Representations Across Multi-Level Abstractions
Not on the map. Why?
Abstract (arXiv)
Graph Self-Supervised Learning (GSSL) has emerged as a powerful paradigm for generating high-quality representations for graph-structured data. While multi-scale graph contrastive learning has received increasing attention, many existing methods still predominantly focus on a single graph abstraction level. To address this limitation, we propose a unified contrastive framework that can target node-level, proximity-level, cluster-level, and graph-level information and integrate them through a linear combination of similarity scores on positive pairs and dissimilarity scores (i.e., similarity scores on negative pairs). Furthermore, current approaches typically assign uniform penalty strengths to all examples, which reduces optimization flexibility and leads to ambiguous convergence status. To overcome this, we introduce a novel parameter-free fine-grained self-weighting mechanism that adaptively assigns weights to individual similarity and dissimilarity scores. The proposed mechanism emphasizes the scores that deviate significantly from their target values. Our approach not only enhances optimization flexibility but also eliminates the computational overhead of hyperparameter tuning in conventional multi-task GSSL methods. Comprehensive experiments on real-world datasets show that our methods consistently outperform state-of-the-art approaches across downstream tasks, including classification, clustering, and link prediction, in both single-level and multi-level scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 69 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
49 of 69 references.
References · 49
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2020Gradient Surgery for Multi-Task Learningcited by 1,210
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2017A Survey on Multi-Task Learningcited by 838
37 more
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
- 2014Deep metric learning using Triplet networkcited by 421
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 402
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2017Multi-task Self-Supervised Visual Learningcited by 200
- 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
- 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 179
- 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 175
- 2019Attributed Graph Clustering: A Deep Attentional Embedding Approachcited by 149
- 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 147
- 2020Learning the Pareto Front with Hypernetworkscited by 122
- 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 108
- 2020Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learningcited by 90
- 2022What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoderscited by 82
- 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
- 2021Automated Self-Supervised Learning for Graphscited by 50
- 2021Rethinking Graph Auto-Encoder Models for Attributed Graph Clusteringcited by 37
- 2022Multi-task Self-supervised Graph Neural Networks Enable Stronger Task Generalizationcited by 35
- 2022AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learningcited by 31
- 2023Neighbor Contrastive Learning on Learnable Graph Augmentationcited by 25
- 2023DGCLUSTER: A Neural Framework for Attributed Graph Clustering via Modularity Maximizationcited by 21
- 2023Improvable Gap Balancing for Multi-Task Learningcited by 9
- 2023Latent Graph Inference with Limited Supervisioncited by 9
- 2023Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learningcited by 9
- 2024Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Taskscited by 7
- 2024Exploring Correlations of Self-Supervised Tasks for Graphscited by 7
- 2024Every Node is Different: Dynamically Fusing Self-Supervised Tasks for Attributed Graph Clusteringcited by 6
- 2024Multi-Scale Subgraph Contrastive Learningcited by 5
- 2023Local Structure-aware Graph Contrastive Representation Learningcited by 4
- 2023A Contrastive Variational Graph Auto-Encoder for Node Clusteringcited by 4
- 2023Contrastive Representation Learning Based on Multiple Node-centered Subgraphscited by 3
- 2025Scale-Free Graph-Language Modelscited by 2
Built on by
Not cited yet.