Test-Time Training for Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have made tremendous progress in the graph classification task. However, a performance gap between the training set and the test set has often been noticed. To bridge such gap, in this work we introduce the first test-time training framework for GNNs to enhance the model generalization capacity for the graph classification task. In particular, we design a novel test-time training strategy with self-supervised learning to adjust the GNN model for each test graph sample. Experiments on the benchmark datasets have demonstrated the effectiveness of the proposed framework, especially when there are distribution shifts between training set and test set. We have also conducted exploratory studies and theoretical analysis to gain deeper understandings on the rationality of the design of the proposed graph test time training framework (GT3).
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 39 of its 50 references that are in the map. First posted on arXiv 17 Oct 2022.
Builds on
39 of 50 references.
References · 39
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
27 more
- 2018Deep Graph Infomaxcited by 1,101
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2020Graph Structure Learning for Robust Graph Neural Networkscited by 368
- 2020Improving Graph Neural Network Expressivity via Subgraph Isomorphism Countingcited by 312
- 2020Understanding the Failure Modes of Out-of-Distribution Generalizationcited by 146
- 2020Self-Supervised Policy Adaptation during Deploymentcited by 121
- 2020A Unified View on Graph Neural Networks as Graph Signal Denoisingcited by 110
- 2019Graph Convolutional Networks with EigenPoolingcited by 94
- 2020Scalable Graph Neural Networks via Bidirectional Propagationcited by 87
- 2019Graph Transformer for Graph-to-Sequence Learningcited by 82
- 2021Elastic Graph Neural Networkscited by 67
- 2021MT3: Meta Test-Time Training for Self-Supervised Test-Time Adaptioncited by 65
- 2019Text Level Graph Neural Network for Text Classificationcited by 60
- 2019Test-Time Training with Self-Supervision for Generalization under Distribution Shiftscited by 55
- 2021AdsGNN: Behavior-Graph Augmented Relevance Modeling in Sponsored Searchcited by 38
- 2019Deep Representation Learning for Social Network Analysiscited by 35
- 2022HousE: Knowledge Graph Embedding with Householder Parameterizationcited by 29
- 2021Learning to Track Instances without Video Annotationscited by 18
- 2022Graph Neural Networks for Multimodal Single-Cell Data Integrationcited by 18
- 2022Going Deeper into Permutation-Sensitive Graph Neural Networkscited by 15
- 2021Localized Graph Collaborative Filteringcited by 6
Built on by
Citing papers per year: 2023: 3; 2024: 8; 2025: 3; 2026: 3.
17 papers.
Sort:
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2023CONVERT:Contrastive Graph Clustering with Reliable Augmentationcited by 23
- 2024A Survey of Data-Efficient Graph Learningcited by 18
- 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learningcited by 17
- 2024Dual Test-time Training for Out-of-distribution Recommender Systemcited by 16
- 2024A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptationcited by 16
- 2024Safety in Graph Machine Learning: Threats and Safeguardscited by 11
- 2024Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptationcited by 10
- 2024Beyond Generalization: A Survey of Out-Of-Distribution Adaptation on Graphscited by 6
- 2023Addressing the Impact of Localized Training Data in Graph Neural Networkscited by 2
- 2025Structural Alignment Improves Graph Test-Time Adaptationcited by 2
- 2025Cross-Domain Graph Anomaly Detection via Test-Time Training with Homophily-Guided Self-Supervisioncited by 1
5 more
- 2026GFMate: Empowering Graph Foundation Models with Test-time Prompt Tuningcited by 1
- 2026PromptDyG: Test-Time Prompt Adaptation on Dynamic Graphscited by 1
- 2024One-Step Late Fusion Multi-view Clustering with Compressed Subspacecited by 0
- 2025Evaluating Out-of-Distribution Robustness in Graph-Based Android Malware Classification: A New Principled Benchmarkcited by 0
- 2026When does distribution shift break graph neural networks calibration?cited by 0
- 2026When does distribution shift break graph neural networks calibration?12 Jul 2026
- 2026PromptDyG: Test-Time Prompt Adaptation on Dynamic Graphs22 Jun 2026
- 2026GFMate: Empowering Graph Foundation Models with Test-time Prompt Tuning14 May 2026
- 2025Evaluating Out-of-Distribution Robustness in Graph-Based Android Malware Classification: A New Principled Benchmark8 Aug 2025
- 2025Structural Alignment Improves Graph Test-Time Adaptation25 Feb 2025
- 2025Cross-Domain Graph Anomaly Detection via Test-Time Training with Homophily-Guided Self-Supervision20 Feb 2025
- 2024A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptation25 Oct 2024
- 2024Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptation9 Oct 2024
- 2024Dual Test-time Training for Out-of-distribution Recommender System22 Jul 2024
- 2024Safety in Graph Machine Learning: Threats and Safeguards17 May 2024
- 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learning26 Feb 2024
- 2024Beyond Generalization: A Survey of Out-Of-Distribution Adaptation on Graphs17 Feb 2024
5 more
- 2024A Survey of Data-Efficient Graph Learning1 Feb 2024
- 2024One-Step Late Fusion Multi-view Clustering with Compressed Subspace3 Jan 2024
- 2023CONVERT:Contrastive Graph Clustering with Reliable Augmentation17 Aug 2023
- 2023Addressing the Impact of Localized Training Data in Graph Neural Networks24 Jul 2023
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts27 Mar 2023
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2023CONVERT:Contrastive Graph Clustering with Reliable Augmentationcited by 23
- 2024A Survey of Data-Efficient Graph Learningcited by 18
- 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learningcited by 17
- 2024Dual Test-time Training for Out-of-distribution Recommender Systemcited by 16
- 2024A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptationcited by 16
- 2024Safety in Graph Machine Learning: Threats and Safeguardscited by 11
- 2024Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptationcited by 10
- 2024Beyond Generalization: A Survey of Out-Of-Distribution Adaptation on Graphscited by 6
- 2023Addressing the Impact of Localized Training Data in Graph Neural Networkscited by 2
- 2025Structural Alignment Improves Graph Test-Time Adaptationcited by 2
- 2025Cross-Domain Graph Anomaly Detection via Test-Time Training with Homophily-Guided Self-Supervisioncited by 1
12 most cited of 17 All 17 (JSON)
- 2026When does distribution shift break graph neural networks calibration?12 Jul 2026
- 2026PromptDyG: Test-Time Prompt Adaptation on Dynamic Graphs22 Jun 2026
- 2026GFMate: Empowering Graph Foundation Models with Test-time Prompt Tuning14 May 2026
- 2025Evaluating Out-of-Distribution Robustness in Graph-Based Android Malware Classification: A New Principled Benchmark8 Aug 2025
- 2025Structural Alignment Improves Graph Test-Time Adaptation25 Feb 2025
- 2025Cross-Domain Graph Anomaly Detection via Test-Time Training with Homophily-Guided Self-Supervision20 Feb 2025
- 2024A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptation25 Oct 2024
- 2024Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptation9 Oct 2024
- 2024Dual Test-time Training for Out-of-distribution Recommender System22 Jul 2024
- 2024Safety in Graph Machine Learning: Threats and Safeguards17 May 2024
- 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learning26 Feb 2024
- 2024Beyond Generalization: A Survey of Out-Of-Distribution Adaptation on Graphs17 Feb 2024
12 newest of 17 All 17 (JSON)