mlsanityData to 14 Oct 2026

Learning Robust Heterogeneous Graph Representations via Contrastive-Reconstruction under Sparse Semantics

arXiv 2506.06682 ↗First posted 7 Jun 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In graph self-supervised learning, masked autoencoders (MAE) and contrastive learning (CL) are two prominent paradigms. MAE focuses on reconstructing masked elements, while CL maximizes similarity between augmented graph views. Recent studies highlight their complementarity: MAE excels at local feature capture, and CL at global information extraction. Hybrid frameworks for homogeneous graphs have been proposed, but face challenges in designing shared encoders to meet the semantic requirements of both tasks. In semantically sparse scenarios, CL struggles with view construction, and gradient imbalance between positive and negative samples persists. This paper introduces HetCRF, a novel dual-channel self-supervised learning framework for heterogeneous graphs. HetCRF uses a two-stage aggregation strategy to adapt embedding semantics, making it compatible with both MAE and CL. To address semantic sparsity, it enhances encoder output for view construction instead of relying on raw features, improving efficiency. Two positive sample augmentation strategies are also proposed to balance gradient contributions. Node classification experiments on four real-world heterogeneous graph datasets demonstrate that HetCRF outperforms state-of-the-art baselines. On datasets with missing node features, such as Aminer and Freebase, at a 40% label rate in node classification, HetCRF improves the Macro-F1 score by 2.75% and 2.2% respectively compared to the second-best baseline, validating its effectiveness and superiority.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 7 Jun 2025.

Builds on

19 of 35 references.

References · 19

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2020Self-supervised Learning: Generative or Contrastivecited by 694
  4. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  5. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  6. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  7. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  8. 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
  9. 2020When Does Self-Supervision Help Graph Convolutional Networks?cited by 121
  10. 2024Rethinking Graph Masked Autoencoders through Alignment and Uniformitycited by 22
  11. 2022Graph Contrastive Learning with Personalized Augmentationcited by 14
  12. 2021Relation-aware Graph Attention Model With Adaptive Self-adversarial Trainingcited by 12
7 more
  1. 2021Learning Combinatorial Node Labeling Algorithmscited by 10
  2. 2022Heterogeneous Graph Contrastive Learning with Meta-path Contexts and Adaptively Weighted Negative Samplescited by 6
  3. 2025DiffGraph: Heterogeneous Graph Diffusion Modelcited by 6
  4. 2020Hop-Hop Relation-aware Graph Neural Networkscited by 5
  5. 2022Positive-Negative Equal Contrastive Loss for Semantic Segmentationcited by 5
  6. 2024LocalGCL: Local-aware Contrastive Learning for Graphscited by 2
  7. 2025NodeReg: Mitigating the Imbalance and Distribution Shift Effects in Semi-Supervised Node Classification via Norm Consistencycited by 1

Built on by

Not cited yet.