mlsanityData to 7 Oct 2026

Few-Shot Causal Representation Learning for Out-of-Distribution Generalization on Heterogeneous Graphs

arXiv 2401.03597 ↗First posted 7 Jan 2024cs.LG cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Heterogeneous graph few-shot learning (HGFL) has been developed to address the label sparsity issue in heterogeneous graphs (HGs), which consist of various types of nodes and edges. The core concept of HGFL is to extract knowledge from rich-labeled classes in a source HG, transfer this knowledge to a target HG to facilitate learning new classes with few-labeled training data, and finally make predictions on unlabeled testing data. Existing methods typically assume that the source HG, training data, and testing data all share the same distribution. However, in practice, distribution shifts among these three types of data are inevitable due to two reasons: (1) the limited availability of the source HG that matches the target HG distribution, and (2) the unpredictable data generation mechanism of the target HG. Such distribution shifts result in ineffective knowledge transfer and poor learning performance in existing methods, thereby leading to a novel problem of out-of-distribution (OOD) generalization in HGFL. To address this challenging problem, we propose a novel Causal OOD Heterogeneous graph Few-shot learning model, namely COHF. In COHF, we first characterize distribution shifts in HGs with a structural causal model, establishing an invariance principle for OOD generalization in HGFL. Then, following this invariance principle, we propose a new variational autoencoder-based heterogeneous graph neural network to mitigate the impact of distribution shifts. Finally, by integrating this network with a novel meta-learning framework, COHF effectively transfers knowledge to the target HG to predict new classes with few-labeled data. Extensive experiments on seven real-world datasets have demonstrated the superior performance of COHF over the state-of-the-art methods.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 52 of its 93 references that are in the map. First posted on arXiv 7 Jan 2024.

Builds on

52 of 93 references.

References · 52

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  8. 2019Simplifying Graph Convolutional Networkscited by 1,470
  9. 2016Variational Inference: A Review for Statisticianscited by 1,466
  10. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  11. 2018Link Prediction Based on Graph Neural Networkscited by 829
  12. 2021How Attentive are Graph Attention Networks?cited by 818
38 more
  1. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
  2. 2019Heterogeneous Graph Attention Networkcited by 732
  3. 2019Graph Transformer Networkscited by 520
  4. 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
  5. 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 375
  6. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  7. 2022Discovering Invariant Rationales for Graph Neural Networkscited by 186
  8. 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
  9. 2019A Meta-Transfer Objective for Learning to Disentangle Causal Mechanismscited by 158
  10. 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
  11. 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 140
  12. 2020A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sourcescited by 126
  13. 2015A Survey of Heterogeneous Information Network Analysiscited by 109
  14. 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
  15. 2020Visual Commonsense R-CNNcited by 106
  16. 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
  17. 2017Learning Structural Node Embeddings Via Diffusion Waveletscited by 97
  18. 2020Graph Prototypical Networks for Few-shot Learning on Attributed Networkscited by 90
  19. 2020Graph Meta Learning via Local Subgraphscited by 89
  20. 2022Debiasing Graph Neural Networks via Learning Disentangled Causal Substructurecited by 83
  21. 2021Size-Invariant Graph Representations for Graph Classification Extrapolationscited by 82
  22. 2019An Attention-based Graph Neural Network for Heterogeneous Structural Learningcited by 71
  23. 2021Graph Convolution for Semi-Supervised Classification: Improved Linear Separability and Out-of-Distribution Generalizationcited by 70
  24. 2020Interpretable and Efficient Heterogeneous Graph Convolutional Networkcited by 48
  25. 2022GOOD-D: On Unsupervised Graph Out-Of-Distribution Detectioncited by 47
  26. 2023Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Needcited by 46
  27. 2022Tree Mover's Distance: Bridging Graph Metrics and Stability of Graph Neural Networkscited by 39
  28. 2023HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformercited by 35
  29. 2023HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networkscited by 32
  30. 2023Heterogeneous Graph Contrastive Learning for Recommendationcited by 28
  31. 2019A Flexible Generative Framework for Graph-based Semi-supervised Learningcited by 24
  32. 2019Relation Structure-Aware Heterogeneous Information Network Embeddingcited by 19
  33. 2020Leveraging Meta-path Contexts for Classification in Heterogeneous Information Networkscited by 19
  34. 2016Task-Guided and Path-Augmented Heterogeneous Network Embedding for Author Identificationcited by 18
  35. 2022Few-Shot Learning on Graphscited by 11
  36. 2022Zero-shot Transfer Learning within a Heterogeneous Graph via Knowledge Transfer Networkscited by 10
  37. 2023Task-Equivariant Graph Few-shot Learningcited by 8
  38. 2020Semi-Supervised Disentangled Framework for Transferable Named Entity Recognitioncited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 3.

6 papers.