mlsanityData to 7 Oct 2026

Graph Representation Learning via Aggregation Enhancement

arXiv 2201.12843 ↗First posted 30 Jan 2022cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph neural networks (GNNs) have become a powerful tool for processing graph-structured data but still face challenges in effectively aggregating and propagating information between layers, which limits their performance. We tackle this problem with the kernel regression (KR) approach, using KR loss as the primary loss in self-supervised settings or as a regularization term in supervised settings. We show substantial performance improvements compared to state-of-the-art in both scenarios on multiple transductive and inductive node classification datasets, especially for deep networks. As opposed to mutual information (MI), KR loss is convex and easy to estimate in high-dimensional cases, even though it indirectly maximizes the MI between its inputs. Our work highlights the potential of KR to advance the field of graph representation learning and enhance the performance of GNNs. The code to reproduce our experiments is available at https://github.com/Anonymous1252022/KR_for_GNNs

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 67 of its 90 references that are in the map. First posted on arXiv 30 Jan 2022.

Builds on

67 of 90 references.

References · 67

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  7. 2016Variational Inference: A Review for Statisticianscited by 1,466
  8. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  9. 2018Deep Graph Infomaxcited by 1,101
  10. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  11. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  12. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
38 more
  1. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  2. 2016Deep Variational Information Bottleneckcited by 915
  3. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  4. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  5. 2021How Attentive are Graph Attention Networks?cited by 818
  6. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  7. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  8. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  9. 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
  10. 2020Deep Graph Contrastive Representation Learningcited by 535
  11. 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 471
  12. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  13. 2019Diffusion Improves Graph Learningcited by 414
  14. 2016Kernel Mean Embedding of Distributions: A Review and Beyondcited by 360
  15. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  16. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 302
  17. 2021Graph Self-Supervised Learning: A Surveycited by 289
  18. 2021Graph Contrastive Learning Automatedcited by 287
  19. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
  20. 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
  21. 2017struc2vec: Learning Node Representations from Structural Identitycited by 214
  22. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
  23. 2017Predicting multicellular function through multi-layer tissue networkscited by 138
  24. 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
  25. 2020Node Similarity Preserving Graph Convolutional Networkscited by 112
  26. 2020Self-supervised Learning on Graphs: Deep Insights and New Directioncited by 108
  27. 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
  28. 2020Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learningcited by 90
  29. 2018Adversarially Regularized Graph Autoencoder for Graph Embeddingcited by 84
  30. 2021HDMI: High-order Deep Multiplex Infomaxcited by 82
  31. 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
  32. 2020Contrastive Self-supervised Learning for Graph Classificationcited by 68
  33. 2019Semi-Implicit Graph Variational Auto-Encoderscited by 54
  34. 2020Supervised Learning on Relational Databases with Graph Neural Networkscited by 48
  35. 2020Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learningcited by 43
  36. 2020Self-Supervised Graph Representation Learning via Global Context Predictioncited by 38
  37. 2021Structured Graph Learning for Scalable Subspace Clustering: From Single-view to Multi-viewcited by 30
  38. 2019Pre-Training Graph Neural Networks for Generic Structural Feature Extractioncited by 24

50 most cited of 67 All 67 (JSON)

Built on by

Not cited yet.