mlsanityData to 14 Oct 2026

Multi-Task Curriculum Graph Contrastive Learning with Clustering Entropy Guidance

arXiv 2408.12071 ↗First posted 22 Aug 2024cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in unsupervised deep graph clustering have been significantly promoted by contrastive learning. Despite the strides, most graph contrastive learning models face challenges: 1) graph augmentation is used to improve learning diversity, but commonly used random augmentation methods may destroy inherent semantics and cause noise; 2) the fixed positive and negative sample selection strategy is limited to deal with complex real data, thereby impeding the model's capability to capture fine-grained patterns and relationships. To reduce these problems, we propose the Clustering-guided Curriculum Graph contrastive Learning (CCGL) framework. CCGL uses clustering entropy as the guidance of the following graph augmentation and contrastive learning. Specifically, according to the clustering entropy, the intra-class edges and important features are emphasized in augmentation. Then, a multi-task curriculum learning scheme is proposed, which employs the clustering guidance to shift the focus from the discrimination task to the clustering task. In this way, the sample selection strategy of contrastive learning can be adjusted adaptively from early to late stage, which enhances the model's flexibility for complex data structure. Experimental results demonstrate that CCGL has achieved excellent performance compared to state-of-the-art competitors.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 51 references that are in the map. First posted on arXiv 22 Aug 2024.

Builds on

40 of 51 references.

References · 40

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  5. 2016Variational Graph Auto-Encoderscited by 1,382
  6. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  7. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  8. 2018Deep Graph Infomaxcited by 1,106
  9. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
  10. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
  11. 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
  12. 2020Contrastive Multi-View Representation Learning on Graphscited by 652
28 more
  1. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  2. 2020Deep Graph Contrastive Representation Learningcited by 539
  3. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  4. 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 401
  5. 2021Graph Contrastive Learning Automatedcited by 287
  6. 2019On The Power of Curriculum Learning in Training Deep Networkscited by 286
  7. 2017Automated Curriculum Learning for Neural Networkscited by 257
  8. 2020Graph Random Neural Network for Semi-Supervised Learning on Graphscited by 213
  9. 2017Teacher-Student Curriculum Learningcited by 210
  10. 2019Competence-based Curriculum Learning for Neural Machine Translationcited by 202
  11. 2021Dynamic Graph Convolutional Recurrent Network for Traffic Prediction: Benchmark and Solutioncited by 157
  12. 2019Attributed Graph Clustering: A Deep Attentional Embedding Approachcited by 149
  13. 2020Structural Deep Clustering Networkcited by 145
  14. 2022Towards Unsupervised Deep Graph Structure Learningcited by 114
  15. 2021Contrastive Learning with Stronger Augmentationscited by 100
  16. 2021Deep Graph Clustering via Dual Correlation Reductioncited by 97
  17. 2020Adaptive Graph Encoder for Attributed Graph Embeddingcited by 89
  18. 2022Hard Sample Aware Network for Contrastive Deep Graph Clusteringcited by 61
  19. 2023Cluster-guided Contrastive Graph Clustering Networkcited by 60
  20. 2019Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narrativescited by 59
  21. 2016Visualizing and Understanding Curriculum Learning for Long Short-Term Memory Networkscited by 44
  22. 2021Prototypical Graph Contrastive Learningcited by 37
  23. 2020Generative Partial Multi-View Clusteringcited by 25
  24. 2024Data Augmentation of Contrastive Learning is Estimating Positive-incentive Noisecited by 25
  25. 2021Self-supervised Contrastive Attributed Graph Clusteringcited by 18
  26. 2024Deep Contrastive Graph Learning with Clustering-Oriented Guidancecited by 7
  27. 2024Doubly Stochastic Adaptive Neighbors Clustering via the Marcus Mappingcited by 4
  28. 2021Entropy Minimizing Matrix Factorizationcited by 2

Built on by

Not cited yet.