Self-supervised Consensus Representation Learning for Attributed Graph
Not on the map. Why?
Abstract (arXiv)
Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus Representation Learning (SCRL) framework. In contrast to most existing works that only explore one graph, our proposed SCRL method treats graph from two perspectives: topology graph and feature graph. We argue that their embeddings should share some common information, which could serve as a supervisory signal. Specifically, we construct the feature graph of node features via k-nearest neighbor algorithm. Then graph convolutional network (GCN) encoders extract features from two graphs respectively. Self-supervised loss is designed to maximize the agreement of the embeddings of the same node in the topology graph and the feature graph. Extensive experiments on real citation networks and social networks demonstrate the superiority of our proposed SCRL over the state-of-the-art methods on semi-supervised node classification task. Meanwhile, compared with its main competitors, SCRL is rather efficient.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 37 of its 44 references that are in the map. First posted on arXiv 10 Aug 2021.
Builds on
37 of 44 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
25 more
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2018Deep Graph Infomaxcited by 1,101
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
- 2019Cross-lingual Language Model Pretrainingcited by 1,088
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2015LINE: Large-scale Information Network Embeddingcited by 582
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 442
- 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 260
- 2018Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecastingcited by 145
- 2018DeepInf: Social Influence Prediction with Deep Learningcited by 128
- 2020AM-GCN: Adaptive Multi-channel Graph Convolutional Networkscited by 121
- 2019Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labelscited by 111
- 2017Knowledge Transfer for Out-of-Knowledge-Base Entities: A Graph Neural Network Approachcited by 102
- 2019DEMO-Net: Degree-specific Graph Neural Networks for Node and Graph Classificationcited by 59
- 2017Hybrid Approach of Relation Network and Localized Graph Convolutional Filtering for Breast Cancer Subtype Classificationcited by 40
- 2018Robust Graph Learning from Noisy Datacited by 34
- 2021Pseudo-supervised Deep Subspace Clusteringcited by 29
- 2018Semi-supervised User Geolocation via Graph Convolutional Networkscited by 27
- 2020Structured Graph Learning for Clustering and Semi-supervised Classificationcited by 16
- 2021Towards Clustering-friendly Representations: Subspace Clustering via Graph Filteringcited by 14
- 2020Relation-Guided Representation Learningcited by 7
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 4; 2024: 4; 2025: 0; 2026: 2.
15 papers.
Sort:
- 2021Multi-view Contrastive Graph Clusteringcited by 76
- 2023Beyond Homophily: Reconstructing Structure for Graph-agnostic Clusteringcited by 29
- 2023PC-Conv: Unifying Homophily and Heterophily with Two-fold Filteringcited by 28
- 2022Structure-Preserving Graph Representation Learningcited by 17
- 2022The Devil is in the Conflict: Disentangled Information Graph Neural Networks for Fraud Detectioncited by 11
- 2023Collaborative Graph Neural Networks for Attributed Network Embeddingcited by 8
- 2023Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learningcited by 6
- 2024Non-Neighbors Also Matter to Kriging: A New Contrastive-Prototypical Learningcited by 5
- 2024Multi-View Subgraph Neural Networks: Self-Supervised Learning with Scarce Labeled Datacited by 5
- 2024Simplified PCNet with Robustnesscited by 3
- 2026Graph Domain Adaptation via Homophily-Agnostic Reconstructing Structurecited by 3
- 2021DPGNN: Dual-Perception Graph Neural Network for Representation Learningcited by 2
- 2026Continuous-Time Quantum Walks based Graph Neural Network21 Aug 2026
- 2026Graph Domain Adaptation via Homophily-Agnostic Reconstructing Structure7 Feb 2026
- 2024Core Knowledge Learning Framework for Graph Adaptation and Scalability Learning2 Jul 2024
- 2024Multi-View Subgraph Neural Networks: Self-Supervised Learning with Scarce Labeled Data19 Apr 2024
- 2024Simplified PCNet with Robustness6 Mar 2024
- 2024Non-Neighbors Also Matter to Kriging: A New Contrastive-Prototypical Learning23 Jan 2024
- 2023PC-Conv: Unifying Homophily and Heterophily with Two-fold Filtering22 Dec 2023
- 2023Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learning12 Sep 2023
- 2023Collaborative Graph Neural Networks for Attributed Network Embedding22 Jul 2023
- 2023Beyond Homophily: Reconstructing Structure for Graph-agnostic Clustering3 May 2023
- 2022The Devil is in the Conflict: Disentangled Information Graph Neural Networks for Fraud Detection22 Oct 2022
- 2022Structure-Preserving Graph Representation Learning2 Sep 2022
- 2021Multi-view Contrastive Graph Clusteringcited by 76
- 2023Beyond Homophily: Reconstructing Structure for Graph-agnostic Clusteringcited by 29
- 2023PC-Conv: Unifying Homophily and Heterophily with Two-fold Filteringcited by 28
- 2022Structure-Preserving Graph Representation Learningcited by 17
- 2022The Devil is in the Conflict: Disentangled Information Graph Neural Networks for Fraud Detectioncited by 11
- 2023Collaborative Graph Neural Networks for Attributed Network Embeddingcited by 8
- 2023Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learningcited by 6
- 2024Non-Neighbors Also Matter to Kriging: A New Contrastive-Prototypical Learningcited by 5
- 2024Multi-View Subgraph Neural Networks: Self-Supervised Learning with Scarce Labeled Datacited by 5
- 2024Simplified PCNet with Robustnesscited by 3
- 2026Graph Domain Adaptation via Homophily-Agnostic Reconstructing Structurecited by 3
- 2021DPGNN: Dual-Perception Graph Neural Network for Representation Learningcited by 2
12 most cited of 15 All 15 (JSON)
- 2026Continuous-Time Quantum Walks based Graph Neural Network21 Aug 2026
- 2026Graph Domain Adaptation via Homophily-Agnostic Reconstructing Structure7 Feb 2026
- 2024Core Knowledge Learning Framework for Graph Adaptation and Scalability Learning2 Jul 2024
- 2024Multi-View Subgraph Neural Networks: Self-Supervised Learning with Scarce Labeled Data19 Apr 2024
- 2024Simplified PCNet with Robustness6 Mar 2024
- 2024Non-Neighbors Also Matter to Kriging: A New Contrastive-Prototypical Learning23 Jan 2024
- 2023PC-Conv: Unifying Homophily and Heterophily with Two-fold Filtering22 Dec 2023
- 2023Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learning12 Sep 2023
- 2023Collaborative Graph Neural Networks for Attributed Network Embedding22 Jul 2023
- 2023Beyond Homophily: Reconstructing Structure for Graph-agnostic Clustering3 May 2023
- 2022The Devil is in the Conflict: Disentangled Information Graph Neural Networks for Fraud Detection22 Oct 2022
- 2022Structure-Preserving Graph Representation Learning2 Sep 2022
12 newest of 15 All 15 (JSON)