Meta-Learning with Graph Neural Networks: Methods and Applications
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are few available samples. Meta-learning has been an important framework to address the lack of samples in machine learning, and in recent years, researchers have started to apply meta-learning to GNNs. In this work, we provide a comprehensive survey of different meta-learning approaches involving GNNs on various graph problems showing the power of using these two approaches together. We categorize the literature based on proposed architectures, shared representations, and applications. Finally, we discuss several exciting future research directions and open problems.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 49 of its 78 references that are in the map. First posted on arXiv 27 Feb 2021.
Builds on
49 of 78 references.
References · 49
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2018Link Prediction Based on Graph Neural Networkscited by 829
37 more
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
- 2017Representation Learning on Graphs: Methods and Applicationscited by 456
- 2019Multi-Task Deep Neural Networks for Natural Language Understandingcited by 349
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 313
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2019A Fair Comparison of Graph Neural Networks for Graph Classificationcited by 244
- 2020Generalization and Representational Limits of Graph Neural Networkscited by 217
- 2020Few-Shot Learning via Learning the Representation, Provablycited by 213
- 2019Position-aware Graph Neural Networkscited by 203
- 2019Deep Dynamics Models for Learning Dexterous Manipulationcited by 200
- 2015The Benefit of Multitask Representation Learningcited by 194
- 2019SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learningcited by 194
- 2020On the Theory of Transfer Learning: The Importance of Task Diversitycited by 186
- 2019Adaptive Gradient-Based Meta-Learning Methodscited by 183
- 2018Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Searchcited by 182
- 2018GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphscited by 164
- 2020Provable Meta-Learning of Linear Representationscited by 161
- 2018Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecastingcited by 145
- 2019Online Meta-Learningcited by 137
- 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
- 2019Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screeningcited by 94
- 2020Graph Prototypical Networks for Few-shot Learning on Attributed Networkscited by 90
- 2018SimGNN: A Neural Network Approach to Fast Graph Similarity Computationcited by 89
- 2020Graph Meta Learning via Local Subgraphscited by 89
- 2021Few-Shot Graph Learning for Molecular Property Predictioncited by 81
- 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
- 2019Provable Guarantees for Gradient-Based Meta-Learningcited by 67
- 2021Few-shot Network Anomaly Detection via Cross-network Meta-learningcited by 64
- 2019Graph Few-shot Learning via Knowledge Transfercited by 63
- 2019Learning-to-Learn Stochastic Gradient Descent with Biased Regularizationcited by 49
- 2020Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Predictioncited by 46
- 2019MetaPred: Meta-Learning for Clinical Risk Prediction with Limited Patient Electronic Health Recordscited by 33
- 2020Few-Shot Learning on Graphs via Super-Classes based on Graph Spectral Measurescited by 31
- 2019Meta-Graph: Few Shot Link Prediction via Meta Learningcited by 24
- 2020Node Classification on Graphs with Few-Shot Novel Labels via Meta Transformed Network Embeddingcited by 19
- 2020A Meta-Learning Approach for Graph Representation Learning in Multi-Task Settingscited by 8
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 2; 2024: 2.
7 papers.
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 38
- 2023Exploring Causal Learning through Graph Neural Networks: An In-depth Reviewcited by 8
- 2022Graph Neural Network Expressivity and Meta-Learning for Molecular Property Regressioncited by 2
- 2023A hybrid deep-learning-metaheuristic framework for bi-level network design problemscited by 1
- 2024Graph Size-imbalanced Learning with Energy-guided Structural Smoothingcited by 1
- 2022Meta-learning Based Short-Term Passenger Flow Prediction for Newly-Operated Urban Rail Transit Stationscited by 0
- 2024A Review of Graph-Powered Data Quality Applications for IoT Monitoring Sensor Networkscited by 0
- 2024Graph Size-imbalanced Learning with Energy-guided Structural Smoothing23 Dec 2024
- 2024A Review of Graph-Powered Data Quality Applications for IoT Monitoring Sensor Networks28 Oct 2024
- 2023Exploring Causal Learning through Graph Neural Networks: An In-depth Review25 Nov 2023
- 2023A hybrid deep-learning-metaheuristic framework for bi-level network design problems10 Mar 2023
- 2022Meta-learning Based Short-Term Passenger Flow Prediction for Newly-Operated Urban Rail Transit Stations13 Oct 2022
- 2022Graph Neural Network Expressivity and Meta-Learning for Molecular Property Regression24 Sep 2022
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI11 Nov 2021