mlsanityData to 14 Oct 2026

Freeze, Prompt, and Adapt: A Framework for Source-free Unsupervised GNN Prompting

arXiv 2505.16903 ↗First posted 22 May 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Prompt tuning has become a key mechanism for adapting pre-trained Graph Neural Networks (GNNs) to new downstream tasks. However, existing approaches are predominantly supervised, relying on labeled data to optimize the prompting parameters and typically fine-tuning a task-specific prediction head -- practices that undermine the promise of parameter-efficient adaptation. We propose Unsupervised Graph Prompting Problem (UGPP), a challenging new setting where the pre-trained GNN is kept entirely frozen, labels on the target domain are unavailable, the source data is inaccessible, and the target distribution exhibits covariate shift. To address this, we propose UGPrompt, the first fully unsupervised GNN prompting framework. UGPrompt leverages consistency regularization and pseudo-labeling to train a prompting function, complemented with diversity and domain regularization to mitigate class imbalance and distribution mismatch. Our extensive experiments demonstrate that UGPrompt consistently outperforms state-of-the-art supervised prompting methods with access to labeled data, demonstrating the viability of unsupervised prompting as a practical adaptation paradigm for GNNs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 68 of its 83 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

68 of 83 references.

References · 68

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  6. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  7. 2017Graph Attention Networkscited by 8,923
  8. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  10. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  11. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  12. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
38 more
  1. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  2. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  3. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
  4. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
  5. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  6. 2019A Comprehensive Survey on Transfer Learningcited by 1,160
  7. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
  8. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  9. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  10. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  11. 2023Large Language Models as Optimizerscited by 864
  12. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
  13. 2021How Attentive are Graph Attention Networks?cited by 835
  14. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  15. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  16. 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
  17. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  18. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  19. 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
  20. 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
  21. 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
  22. 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 384
  23. 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
  24. 2020A Brief Review of Domain Adaptationcited by 288
  25. 2014Learning with Pseudo-Ensemblescited by 241
  26. 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
  27. 2022Discovering Invariant Rationales for Graph Neural Networkscited by 188
  28. 2021Reframing Instructional Prompts to GPTk's Languagecited by 176
  29. 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
  30. 2021Generalized Source-free Domain Adaptationcited by 175
  31. 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
  32. 2019Understanding Attention and Generalization in Graph Neural Networkscited by 169
  33. 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
  34. 2017Learning Discrete Representations via Information Maximizing Self-Augmented Trainingcited by 149
  35. 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
  36. 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
  37. 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
  38. 2022Universal Prompt Tuning for Graph Neural Networkscited by 100

50 most cited of 68 All 68 (JSON)

Built on by

Not cited yet.