One Prompt Fits All: Universal Graph Adaptation for Pretrained Models
Not on the map. Why?
Abstract (arXiv)
Graph Prompt Learning (GPL) has emerged as a promising paradigm that bridges graph pretraining models and downstream scenarios, mitigating label dependency and the misalignment between upstream pretraining and downstream tasks. Although existing GPL studies explore various prompt strategies, their effectiveness and underlying principles remain unclear. We identify two critical limitations: (1) Lack of consensus on underlying mechanisms: Despite current GPLs have advanced the field, there is no consensus on how prompts interact with pretrained models, as different strategies intervene at varying spaces within the model, i.e., input-level, layer-wise, and representation-level prompts. (2) Limited scenario adaptability: Most methods fail to generalize across diverse downstream scenarios, especially under data distribution shifts (e.g., homophilic-to-heterophilic graphs). To address these issues, we theoretically analyze existing GPL approaches and reveal that representation-level prompts essentially function as fine-tuning a simple downstream classifier, proposing that graph prompt learning should focus on unleashing the capability of pretrained models, and the classifier should adapt to downstream scenarios. Based on our findings, we propose UniPrompt, a novel GPL method that adapts any pretrained models, unleashing the capability of pretrained models while preserving the input graph. Extensive experiments demonstrate that our method can effectively integrate with various pretrained models and achieve strong performance across in-domain and cross-domain scenarios.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 74 of its 91 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
74 of 91 references.
References · 74
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2017Neural Discrete Representation Learningcited by 4,712
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2018Deep Graph Infomaxcited by 1,106
38 more
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2020Contrastive Multi-View Representation Learning on Graphscited by 652
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2019Multi-scale Attributed Node Embeddingcited by 548
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2021Graph Contrastive Learning Automatedcited by 287
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 226
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2024LLaGA: Large Language and Graph Assistantcited by 181
- 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
- 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
- 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 132
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 103
- 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
- 2023PRODIGY: Enabling In-context Learning Over Graphscited by 98
- 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
- 2024All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretrainingcited by 86
- 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 85
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
- 2021ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learningcited by 72
- 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 69
- 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 66
- 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
- 2024LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddingscited by 61
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
- 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 57
- 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
- 2023GSLB: The Graph Structure Learning Benchmarkcited by 50
- 2023HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learningcited by 45
50 most cited of 74 All 74 (JSON)
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026MUG: Meta-path-aware Universal Heterogeneous Graph Pre-Trainingcited by 5
- 2026MAGPrompt: Message-Adaptive Graph Prompt Tuning for Graph Neural Networkscited by 1
- 2026Decoupled and Divergence-Conditioned Prompt for Multi-domain Dynamic Graph Foundation Modelscited by 1
- 2026CHoE: Cross-Domain Heterogeneous Graph Prompt Learning via Structure-Conditioned Expertscited by 1
- 2026LoRAP: Low-Rank Aggregation Prompting for Quantized Graph Neural Networks Trainingcited by 0
- 2026GP2F: Cross-Domain Graph Prompting with Adaptive Fusion of Pre-trained Graph Neural Networkscited by 0
- 2026Unified Graph Prompt Learning via Low-Rank Graph Message Promptingcited by 0
- 2026Are Common Substructures Transferable? Riemannian Graph Foundation Model with Neural Vector Bundlescited by 0
- 2026Geometry-Informed Parameter-Efficient Fine-Tuning of Pre-trained Molecular GNNs for Blood-Brain Barrier Permeability Predictioncited by 0
- 2026Preserving Geometric Integrity in Graph Prompting via Measure-Constrained Optimal Transportcited by 0
- 2026Spectral Reversal: Counteracting Singular Value Bias for Graph Promptingcited by 0
- 2026Spectral Reversal: Counteracting Singular Value Bias for Graph Prompting26 Sep 2026
- 2026Preserving Geometric Integrity in Graph Prompting via Measure-Constrained Optimal Transport20 Sep 2026
- 2026Geometry-Informed Parameter-Efficient Fine-Tuning of Pre-trained Molecular GNNs for Blood-Brain Barrier Permeability Prediction4 Aug 2026
- 2026Are Common Substructures Transferable? Riemannian Graph Foundation Model with Neural Vector Bundles2 Jun 2026
- 2026CHoE: Cross-Domain Heterogeneous Graph Prompt Learning via Structure-Conditioned Experts15 May 2026
- 2026Decoupled and Divergence-Conditioned Prompt for Multi-domain Dynamic Graph Foundation Models13 May 2026
- 2026Unified Graph Prompt Learning via Low-Rank Graph Message Prompting13 Apr 2026
- 2026MUG: Meta-path-aware Universal Heterogeneous Graph Pre-Training26 Feb 2026
- 2026GP2F: Cross-Domain Graph Prompting with Adaptive Fusion of Pre-trained Graph Neural Networks12 Feb 2026
- 2026MAGPrompt: Message-Adaptive Graph Prompt Tuning for Graph Neural Networks5 Feb 2026
- 2026LoRAP: Low-Rank Aggregation Prompting for Quantized Graph Neural Networks Training21 Jan 2026