mlsanityData to 7 Oct 2026

Learning Graph Representation by Aggregating Subgraphs via Mutual Information Maximization

arXiv 2103.13125 ↗First posted 24 Mar 2021cs.LG cs.IT math.ITcited by 5

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce a self-supervised learning method to enhance the graph-level representations with the help of a set of subgraphs. For this purpose, we propose a universal framework to generate subgraphs in an auto-regressive way and then using these subgraphs to guide the learning of graph representation by Graph Neural Networks. Under this framework, we can get a comprehensive understanding of the graph structure in a learnable way. And to fully capture enough information of original graphs, we design three information aggregators: attribute-conv, layer-conv and subgraph-conv to gather information from different aspects. And to achieve efficient and effective contrastive learning, a Head-Tail contrastive construction is proposed to provide abundant negative samples. Under all proposed components which can be generalized to any Graph Neural Networks, in the unsupervised case, we achieve new state-of-the-art results in several benchmarks. We also evaluate our model on semi-supervised learning tasks and make a fair comparison to state-of-the-art semi-supervised methods.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 39 of its 74 references that are in the map. First posted on arXiv 24 Mar 2021.

Builds on

39 of 74 references.

References · 39

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2018How Powerful are Graph Neural Networks?cited by 4,355
  8. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  9. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  10. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  11. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
  12. 2016Variational Graph Auto-Encoderscited by 1,373
27 more
  1. 2019Contrastive Multiview Codingcited by 1,297
  2. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  3. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  4. 2018Deep Graph Infomaxcited by 1,101
  5. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
  6. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
  7. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  8. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  9. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  10. 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 504
  11. 2019Graph U-Netscited by 489
  12. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  13. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  14. 2019Self-Attention Graph Poolingcited by 421
  15. 2019Diffusion Improves Graph Learningcited by 414
  16. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  17. 2015Diffusion-Convolutional Neural Networkscited by 268
  18. 2020DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representationscited by 249
  19. 2015Semi-Supervised Learning with Ladder Networkscited by 246
  20. 2017graph2vec: Learning Distributed Representations of Graphscited by 228
  21. 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
  22. 2019LanczosNet: Multi-Scale Deep Graph Convolutional Networkscited by 73
  23. 2019Learning Disentangled Representations via Mutual Information Estimationcited by 52
  24. 2016The Multiscale Laplacian Graph Kernelcited by 31
  25. 2020Graph Cross Networks with Vertex Infomax Poolingcited by 31
  26. 2019Relational Graph Representation Learning for Open-Domain Question Answeringcited by 4
  27. 2019Learning Topological Representation for Networks via Hierarchical Samplingcited by 3

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 1; 2023: 0; 2024: 2; 2025: 1.

5 papers.