mlsanityData to 14 Oct 2026

Position-Aware Subgraph Neural Networks with Data-Efficient Learning

arXiv 2211.00572 ↗First posted 1 Nov 2022cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Data-efficient learning on graphs (GEL) is essential in real-world applications. Existing GEL methods focus on learning useful representations for nodes, edges, or entire graphs with ``small'' labeled data. But the problem of data-efficient learning for subgraph prediction has not been explored. The challenges of this problem lie in the following aspects: 1) It is crucial for subgraphs to learn positional features to acquire structural information in the base graph in which they exist. Although the existing subgraph neural network method is capable of learning disentangled position encodings, the overall computational complexity is very high. 2) Prevailing graph augmentation methods for GEL, including rule-based, sample-based, adaptive, and automated methods, are not suitable for augmenting subgraphs because a subgraph contains fewer nodes but richer information such as position, neighbor, and structure. Subgraph augmentation is more susceptible to undesirable perturbations. 3) Only a small number of nodes in the base graph are contained in subgraphs, which leads to a potential ``bias'' problem that the subgraph representation learning is dominated by these ``hot'' nodes. By contrast, the remaining nodes fail to be fully learned, which reduces the generalization ability of subgraph representation learning. In this paper, we aim to address the challenges above and propose a Position-Aware Data-Efficient Learning framework for subgraph neural networks called PADEL. Specifically, we propose a novel node position encoding method that is anchor-free, and design a new generative subgraph augmentation method based on a diffused variational subgraph autoencoder, and we propose exploratory and exploitable views for subgraph contrastive learning. Extensive experiment results on three real-world datasets show the superiority of our proposed method over state-of-the-art baselines.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 30 of its 56 references that are in the map. First posted on arXiv 1 Nov 2022.

Builds on

30 of 56 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2018How Powerful are Graph Neural Networks?cited by 4,393
  6. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  7. 2016Variational Graph Auto-Encoderscited by 1,382
  8. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  9. 2018Deep Graph Infomaxcited by 1,106
  10. 2020Contrastive Multi-View Representation Learning on Graphscited by 652
  11. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  12. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
18 more
  1. 2017Representation Learning on Graphs: Methods and Applicationscited by 457
  2. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  3. 2021Graph Contrastive Learning Automatedcited by 287
  4. 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 281
  5. 2020Bias and Debias in Recommender System: A Survey and Future Directionscited by 240
  6. 2019Inductive Relation Prediction by Subgraph Reasoningcited by 239
  7. 2020What Should Not Be Contrastive in Contrastive Learningcited by 226
  8. 2019Position-aware Graph Neural Networkscited by 203
  9. 2020Data Augmentation for Graph Neural Networkscited by 203
  10. 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
  11. 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
  12. 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
  13. 2021SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanismcited by 75
  14. 2020Subgraph Neural Networkscited by 73
  15. 2020Rethinking pooling in graph neural networkscited by 73
  16. 2020Contrastive Self-supervised Learning for Graph Classificationcited by 68
  17. 2020Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous Graphscited by 38
  18. 2020Self-Supervised Learning of Contextual Embeddings for Link Prediction in Heterogeneous Networkscited by 17

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1; 2025: 1.

3 papers.