mlsanityData to 7 Oct 2026

HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption

arXiv 2301.12063 ↗First posted 28 Jan 2023cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised auto-encoders have emerged as a successful framework for representation learning in computer vision and natural language processing in recent years, However, their application to graph data has been met with limited performance due to the non-Euclidean and complex structure of graphs in comparison to images or text, as well as the limitations of conventional auto-encoder architectures. In this paper, we investigate factors impacting the performance of auto-encoders on graph data and propose a novel auto-encoder model for graph representation learning. Our model incorporates a hierarchical adaptive masking mechanism to incrementally increase the difficulty of training in order to mimic the process of human cognitive learning, and a trainable corruption scheme to enhance the robustness of learned representations. Through extensive experimentation on ten benchmark datasets, we demonstrate the superiority of our proposed method over state-of-the-art graph representation learning models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 68 references that are in the map. First posted on arXiv 28 Jan 2023.

Builds on

42 of 68 references.

References · 42

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  8. 2016Variational Graph Auto-Encoderscited by 1,373
  9. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  10. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  11. 2018Deep Graph Infomaxcited by 1,101
  12. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
30 more
  1. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  2. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  3. 2020Deep Graph Contrastive Representation Learningcited by 535
  4. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  5. 2020Graph Neural Networks in Recommender Systems: A Surveycited by 493
  6. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  7. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  8. 2019Diffusion Improves Graph Learningcited by 414
  9. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 302
  10. 2014Recurrent Neural Network Regularizationcited by 189
  11. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
  12. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  13. 2017Predicting multicellular function through multi-layer tissue networkscited by 138
  14. 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
  15. 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
  16. 2020When Does Self-Supervision Help Graph Convolutional Networks?cited by 121
  17. 2021InfoGCL: Information-Aware Graph Contrastive Learningcited by 105
  18. 2022How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervisioncited by 102
  19. 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
  20. 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
  21. 2019Semi-Implicit Graph Variational Auto-Encoderscited by 54
  22. 2019Graph Attention Auto-Encoderscited by 41
  23. 2022Adversarial Graph Contrastive Learning with Information Regularizationcited by 38
  24. 2022SelfKG: Self-Supervised Entity Alignment in Knowledge Graphscited by 32
  25. 2022Unsupervised Graph Poisoning Attack via Contrastive Loss Back-propagationcited by 25
  26. 2020Self-supervised Training of Graph Convolutional Networkscited by 24
  27. 2022Bi-CLKT: Bi-Graph Contrastive Learning based Knowledge Tracingcited by 23
  28. 2020Graph-Based Neural Network Models with Multiple Self-Supervised Auxiliary Taskscited by 21
  29. 2022Disentangled Spatiotemporal Graph Generative Modelscited by 12
  30. 2022Curvature Graph Generative Adversarial Networkscited by 9

Built on by

Not cited yet.