Message Tuning Outshines Graph Prompt Tuning: A Prismatic Space Perspective
Not on the map. Why?
Abstract (arXiv)
Graph Foundation Models (GFMs), built upon the Pre-training and Adaptation paradigm, have emerged as a research hotspot in graph learning. For GNN-based GFMs, graph prompt tuning has become the prevailing adaptation method for downstream tasks. Although recent methods explain why graph prompt tuning works, how to rigorously measure its adaptation capacity remains an open problem. Addressing this problem is critical for understanding the capability limits of graph prompt tuning and for developing more powerful adaptation methods. In this paper, we propose Prismatic Space Theory (PS-Theory), a novel mathematical framework to quantify the capacity of adaptation methods, while focusing on establishing the upper bound for the adaptation capacity of graph prompt tuning. Building upon the proposed PS-Theory, we further introduce Message Tuning for GFMs (MTG), a lightweight approach that injects a small set of learnable message prototypes into each layer of the GNN backbone to adaptively guide message fusion without updating pre-trained weights. Through our PS-Theory, we prove that the adaptation capacity of MTG can exceed the theoretical upper bound of graph prompt tuning. Extensive experiments demonstrate that MTG consistently outperforms graph prompt baselines across diverse benchmark datasets, providing strong empirical support for our theoretical findings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 65 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
38 of 65 references.
References · 38
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2018Deep Graph Infomaxcited by 1,106
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
26 more
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
- 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 341
- 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 303
- 2016Understanding Deep Neural Networks with Rectified Linear Unitscited by 257
- 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
- 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 103
- 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
- 2024Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classificationcited by 85
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
- 2021AFEC: Active Forgetting of Negative Transfer in Continual Learningcited by 73
- 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
- 2025Graph Foundation Models: A Comprehensive Surveycited by 44
- 2020Empirical Studies on the Properties of Linear Regions in Deep Neural Networkscited by 36
- 2024Non-Homophilic Graph Pre-Training and Prompt Learningcited by 31
- 2025Can Classic GNNs Be Strong Baselines for Graph-level Tasks? Simple Architectures Meet Excellencecited by 26
- 2022FAITH: Few-Shot Graph Classification with Hierarchical Task Graphscited by 22
- 2022MolCPT: Molecule Continuous Prompt Tuning to Generalize Molecular Representation Learningcited by 12
- 2024Replay-and-Forget-Free Graph Class-Incremental Learning: A Task Profiling and Prompting Approachcited by 12
- 2023ReLU Neural Networks, Polyhedral Decompositions, and Persistent Homologcited by 10
- 2024Does Graph Prompt Work? A Data Operation Perspective with Theoretical Analysiscited by 10
- 2025Toric geometry of ReLU neural networkscited by 2
- 2025Stealthy Yet Effective: Distribution-Preserving Backdoor Attacks on Graph Classificationcited by 2
Built on by
Not cited yet.