mlsanityData to 7 Oct 2026

Self-Supervised Deep Graph Embedding with High-Order Information Fusion for Community Discovery

arXiv 2102.03302 ↗First posted 5 Feb 2021cs.SI cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Deep graph embedding is an important approach for community discovery. Deep graph neural network with self-supervised mechanism can obtain the low-dimensional embedding vectors of nodes from unlabeled and unstructured graph data. The high-order information of graph can provide more abundant structure information for the representation learning of nodes. However, most self-supervised graph neural networks only use adjacency matrix as the input topology information of graph and cannot obtain too high-order information since the number of layers of graph neural network is fairly limited. If there are too many layers, the phenomenon of over smoothing will appear. Therefore how to obtain and fuse high-order information of graph by a shallow graph neural network is an important problem. In this paper, a deep graph embedding algorithm with self-supervised mechanism for community discovery is proposed. The proposed algorithm uses self-supervised mechanism and different high-order information of graph to train multiple deep graph convolution neural networks. The outputs of multiple graph convolution neural networks are fused to extract the representations of nodes which include the attribute and structure information of a graph. In addition, data augmentation and negative sampling are introduced into the training process to facilitate the improvement of embedding result. The proposed algorithm and the comparison algorithms are conducted on the five experimental data sets. The experimental results show that the proposed algorithm outperforms the comparison algorithms on the most experimental data sets. The experimental results demonstrate that the proposed algorithm is an effective algorithm for community discovery.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 54 references that are in the map. First posted on arXiv 5 Feb 2021.

Builds on

32 of 54 references.

References · 32

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  7. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  8. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  9. 2018Deep Graph Infomaxcited by 1,101
  10. 2020Simple and Deep Graph Convolutional Networkscited by 857
  11. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  12. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
20 more
  1. 2015LINE: Large-scale Information Network Embeddingcited by 582
  2. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  3. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 332
  4. 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
  5. 2017struc2vec: Learning Node Representations from Structural Identitycited by 214
  6. 2019What graph neural networks cannot learn: depth vs widthcited by 195
  7. 2019Attributed Graph Clustering: A Deep Attentional Embedding Approachcited by 149
  8. 2020Structural Deep Clustering Networkcited by 145
  9. 2017A Survey on Network Embeddingcited by 142
  10. 2020AM-GCN: Adaptive Multi-channel Graph Convolutional Networkscited by 121
  11. 2020Controllable Multi-Interest Framework for Recommendationcited by 92
  12. 2020Understanding Negative Sampling in Graph Representation Learningcited by 66
  13. 2019Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoningcited by 63
  14. 2020Dynamic ReLUcited by 55
  15. 2019NetSMF: Large-Scale Network Embedding as Sparse Matrix Factorizationcited by 48
  16. 2020Deep Learning for Community Detection: Progress, Challenges and Opportunitiescited by 42
  17. 2020Convolutional Kernel Networks for Graph-Structured Datacited by 38
  18. 2020Graph InfoClust: Leveraging cluster-level node information for unsupervised graph representation learningcited by 35
  19. 2019Sequential Scenario-Specific Meta Learner for Online Recommendationcited by 28
  20. 2018SPINE: Structural Identity Preserved Inductive Network Embeddingcited by 3

Built on by

Cited by year

Citing papers per year: 2021: 1.

1 paper.