mlsanityData to 7 Oct 2026

Self-supervised Consensus Representation Learning for Attributed Graph

arXiv 2108.04822 ↗First posted 10 Aug 2021cs.SI cs.AI cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus Representation Learning (SCRL) framework. In contrast to most existing works that only explore one graph, our proposed SCRL method treats graph from two perspectives: topology graph and feature graph. We argue that their embeddings should share some common information, which could serve as a supervisory signal. Specifically, we construct the feature graph of node features via k-nearest neighbor algorithm. Then graph convolutional network (GCN) encoders extract features from two graphs respectively. Self-supervised loss is designed to maximize the agreement of the embeddings of the same node in the topology graph and the feature graph. Extensive experiments on real citation networks and social networks demonstrate the superiority of our proposed SCRL over the state-of-the-art methods on semi-supervised node classification task. Meanwhile, compared with its main competitors, SCRL is rather efficient.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 37 of its 44 references that are in the map. First posted on arXiv 10 Aug 2021.

Builds on

37 of 44 references.

References · 37

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  9. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  10. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  11. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  12. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
25 more
  1. 2019Simplifying Graph Convolutional Networkscited by 1,470
  2. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  3. 2018Deep Graph Infomaxcited by 1,101
  4. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  5. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
  6. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  7. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  8. 2019Heterogeneous Graph Attention Networkcited by 732
  9. 2015LINE: Large-scale Information Network Embeddingcited by 582
  10. 2020Deep Graph Contrastive Representation Learningcited by 535
  11. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 442
  12. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 260
  13. 2018Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecastingcited by 145
  14. 2018DeepInf: Social Influence Prediction with Deep Learningcited by 128
  15. 2020AM-GCN: Adaptive Multi-channel Graph Convolutional Networkscited by 121
  16. 2019Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labelscited by 111
  17. 2017Knowledge Transfer for Out-of-Knowledge-Base Entities: A Graph Neural Network Approachcited by 102
  18. 2019DEMO-Net: Degree-specific Graph Neural Networks for Node and Graph Classificationcited by 59
  19. 2017Hybrid Approach of Relation Network and Localized Graph Convolutional Filtering for Breast Cancer Subtype Classificationcited by 40
  20. 2018Robust Graph Learning from Noisy Datacited by 34
  21. 2021Pseudo-supervised Deep Subspace Clusteringcited by 29
  22. 2018Semi-supervised User Geolocation via Graph Convolutional Networkscited by 27
  23. 2020Structured Graph Learning for Clustering and Semi-supervised Classificationcited by 16
  24. 2021Towards Clustering-friendly Representations: Subspace Clustering via Graph Filteringcited by 14
  25. 2020Relation-Guided Representation Learningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 3; 2023: 4; 2024: 4; 2025: 0; 2026: 2.

15 papers.

Sort: