Freeze, Prompt, and Adapt: A Framework for Source-free Unsupervised GNN Prompting
Not on the map. Why?
Abstract (arXiv)
Prompt tuning has become a key mechanism for adapting pre-trained Graph Neural Networks (GNNs) to new downstream tasks. However, existing approaches are predominantly supervised, relying on labeled data to optimize the prompting parameters and typically fine-tuning a task-specific prediction head -- practices that undermine the promise of parameter-efficient adaptation. We propose Unsupervised Graph Prompting Problem (UGPP), a challenging new setting where the pre-trained GNN is kept entirely frozen, labels on the target domain are unavailable, the source data is inaccessible, and the target distribution exhibits covariate shift. To address this, we propose UGPrompt, the first fully unsupervised GNN prompting framework. UGPrompt leverages consistency regularization and pseudo-labeling to train a prompting function, complemented with diversity and domain regularization to mitigate class imbalance and distribution mismatch. Our extensive experiments demonstrate that UGPrompt consistently outperforms state-of-the-art supervised prompting methods with access to labeled data, demonstrating the viability of unsupervised prompting as a practical adaptation paradigm for GNNs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 68 of its 83 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
68 of 83 references.
References · 68
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
38 more
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2023Large Language Models as Optimizerscited by 864
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
- 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 384
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2020A Brief Review of Domain Adaptationcited by 288
- 2014Learning with Pseudo-Ensemblescited by 241
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 188
- 2021Reframing Instructional Prompts to GPTk's Languagecited by 176
- 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
- 2021Generalized Source-free Domain Adaptationcited by 175
- 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
- 2019Understanding Attention and Generalization in Graph Neural Networkscited by 169
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
- 2017Learning Discrete Representations via Information Maximizing Self-Augmented Trainingcited by 149
- 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
- 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
- 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
50 most cited of 68 All 68 (JSON)
Built on by
Not cited yet.