mlsanityData to 14 Oct 2026

HGMP:Heterogeneous Graph Multi-Task Prompt Learning

arXiv 2507.07405 ↗First posted 10 Jul 2025cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

The pre-training and fine-tuning methods have gained widespread attention in the field of heterogeneous graph neural networks due to their ability to leverage large amounts of unlabeled data during the pre-training phase, allowing the model to learn rich structural features. However, these methods face the issue of a mismatch between the pre-trained model and downstream tasks, leading to suboptimal performance in certain application scenarios. Prompt learning methods have emerged as a new direction in heterogeneous graph tasks, as they allow flexible adaptation of task representations to address target inconsistency. Building on this idea, this paper proposes a novel multi-task prompt framework for the heterogeneous graph domain, named HGMP. First, to bridge the gap between the pre-trained model and downstream tasks, we reformulate all downstream tasks into a unified graph-level task format. Next, we address the limitations of existing graph prompt learning methods, which struggle to integrate contrastive pre-training strategies in the heterogeneous graph domain. We design a graph-level contrastive pre-training strategy to better leverage heterogeneous information and enhance performance in multi-task scenarios. Finally, we introduce heterogeneous feature prompts, which enhance model performance by refining the representation of input graph features. Experimental results on public datasets show that our proposed method adapts well to various tasks and significantly outperforms baseline methods.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 32 of its 36 references that are in the map. First posted on arXiv 10 Jul 2025.

Builds on

32 of 36 references.

References · 32

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  5. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  6. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  7. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
  8. 2019Heterogeneous Graph Attention Networkcited by 734
  9. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
  10. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  11. 2020Knowledge Graphscited by 621
  12. 2020Heterogeneous Graph Transformercited by 582
20 more
  1. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  2. 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
  3. 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
  4. 2019Understanding Attention and Generalization in Graph Neural Networkscited by 169
  5. 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
  6. 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
  7. 2021A Survey of Graph Neural Networks for Recommender Systems: Challenges, Methods, and Directionscited by 144
  8. 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
  9. 2020From Local Structures to Size Generalization in Graph Neural Networkscited by 124
  10. 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
  11. 2023PRODIGY: Enabling In-context Learning Over Graphscited by 98
  12. 2019Unsupervised Attributed Multiplex Network Embeddingcited by 95
  13. 2021HDMI: High-order Deep Multiplex Infomaxcited by 82
  14. 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
  15. 2021Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNscited by 51
  16. 2023Virtual Node Tuning for Few-shot Node Classificationcited by 46
  17. 2023HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learningcited by 45
  18. 2023HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformercited by 35
  19. 2023HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networkscited by 33
  20. 2024ProG: A Graph Prompt Learning Benchmarkcited by 29

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.