mlsanityData to 14 Oct 2026

Task-Specific Prompt with Global Context for Multi-Task Graph Pre-Training

arXiv 2609.00047 ↗First posted 30 Aug 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph prompt learning is an effective paradigm to adapt pre-trained graph models to downstream tasks in low-resource scenarios. However, existing multi-task graph pre-training frameworks generally use randomly initialized prompts, leading to poor alignment between the prompt space, pretext objectives and graph structural characteristics. This greatly weakens the task relevance, structural awareness and transferability of prompt representations. To address this challenge, we propose TPGC, a dual-prior prompt initialization solution that explicitly models the synergy between task prior and structural prior. Specifically, the Task-Prior Injection Module first conducts a short homologous multi-task pre-training on an auxiliary graph, enabling prompt initialization to inherit optimization preferences associated with multiple pretext tasks. Built on the task-aware representations, the Structure-Prior Injection Module further extracts transferable global structural context from the auxiliary graph, converting it into layer-wise prompt vectors by aggregating structurally informative node embeddings. Extensive experiments on 6 mainstream benchmarks covering node and graph classification show that TPGC achieves consistently better performance under few-shot settings than state-of-the-art baselines, with fewer downstream tunable parameters and lower runtime. The code is available at https://github.com/Virgilqiu/TPGC

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

20 of 39 references.

References · 20

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  6. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  7. 2018Deep Graph Infomaxcited by 1,106
  8. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  9. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
  10. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
  11. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  12. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 303
8 more
  1. 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 132
  2. 2023MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphscited by 40
  3. 2023Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphscited by 39
  4. 2023Progressive Visual Prompt Learning with Contrastive Feature Re-formationcited by 36
  5. 2024Non-Homophilic Graph Pre-Training and Prompt Learningcited by 31
  6. 2024Task Prompt Vectors: Effective Initialization through Multi-Task Soft-Prompt Transfercited by 13
  7. 2025HGMP:Heterogeneous Graph Multi-Task Prompt Learningcited by 4
  8. 2025Vision Graph Prompting via Semantic Low-Rank Decompositioncited by 3

Built on by

Not cited yet.