Learning Graph Representation by Aggregating Subgraphs via Mutual Information Maximization
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce a self-supervised learning method to enhance the graph-level representations with the help of a set of subgraphs. For this purpose, we propose a universal framework to generate subgraphs in an auto-regressive way and then using these subgraphs to guide the learning of graph representation by Graph Neural Networks. Under this framework, we can get a comprehensive understanding of the graph structure in a learnable way. And to fully capture enough information of original graphs, we design three information aggregators: attribute-conv, layer-conv and subgraph-conv to gather information from different aspects. And to achieve efficient and effective contrastive learning, a Head-Tail contrastive construction is proposed to provide abundant negative samples. Under all proposed components which can be generalized to any Graph Neural Networks, in the unsupervised case, we achieve new state-of-the-art results in several benchmarks. We also evaluate our model on semi-supervised learning tasks and make a fair comparison to state-of-the-art semi-supervised methods.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 39 of its 74 references that are in the map. First posted on arXiv 24 Mar 2021.
Builds on
39 of 74 references.
References · 39
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2016Variational Graph Auto-Encoderscited by 1,373
27 more
- 2019Contrastive Multiview Codingcited by 1,297
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 504
- 2019Graph U-Netscited by 489
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2019Self-Attention Graph Poolingcited by 421
- 2019Diffusion Improves Graph Learningcited by 414
- 2018Session-based Recommendation with Graph Neural Networkscited by 312
- 2015Diffusion-Convolutional Neural Networkscited by 268
- 2020DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representationscited by 249
- 2015Semi-Supervised Learning with Ladder Networkscited by 246
- 2017graph2vec: Learning Distributed Representations of Graphscited by 228
- 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
- 2019LanczosNet: Multi-Scale Deep Graph Convolutional Networkscited by 73
- 2019Learning Disentangled Representations via Mutual Information Estimationcited by 52
- 2016The Multiscale Laplacian Graph Kernelcited by 31
- 2020Graph Cross Networks with Vertex Infomax Poolingcited by 31
- 2019Relational Graph Representation Learning for Open-Domain Question Answeringcited by 4
- 2019Learning Topological Representation for Networks via Hierarchical Samplingcited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 0; 2024: 2; 2025: 1.
5 papers.
- 2021Graph Contrastive Learning Automatedcited by 287
- 2022Data Augmentation on Graphs: A Technical Surveycited by 10
- 2025Graph Prompting for Graph Learning Models: Recent Advances and Future Directionscited by 3
- 2024POWN: Prototypical Open-World Node Classificationcited by 0
- 2024Multiplex Graph Contrastive Learning with Soft Negativescited by 0
- 2025Graph Prompting for Graph Learning Models: Recent Advances and Future Directions10 Jun 2025
- 2024Multiplex Graph Contrastive Learning with Soft Negatives12 Sep 2024
- 2024POWN: Prototypical Open-World Node Classification14 Jun 2024
- 2022Data Augmentation on Graphs: A Technical Survey20 Dec 2022
- 2021Graph Contrastive Learning Automated10 Jun 2021