mlsanityData to 14 Oct 2026

PromptGNN-sim: Deep Fusion and Alignment of GNN and LLMs for Text-Attributed Graph Learning

arXiv 2606.30291 ↗First posted 29 Jun 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-Attributed Graphs (TAGs) combine textual semantics with graph structure and are central to many graph learning tasks. However, existing fusion methods often treat text and structure as separate inputs in a shallow, one-way pipeline, which limits deep interaction between modalities and weakens performance under sparse connectivity or cross-graph generalisation. To address this issue, we propose PromptGNN-sim, a bi-directional structure-semantic fusion framework for collaborative GNN-LLM learning. PromptGNN-sim uses a Graph Attention Network (GAT) for semantically aware neighborhood selection by combining structural attention with textual similarity. The selected structural context is then used to generate structure-aware prompts for an LLM, including the target node summary, label categories, and representative keywords from similar neighbors. During training, bi-directional cross-modal contrastive learning and cross-attention are introduced to jointly optimize the GNN and LLM components. Experiments on six public datasets, including Cora, Pubmed, and WikiCS, evaluate accuracy, generalisation, and robustness under cross-task transfer, cross-dataset generalisation, and sparse perturbations. Results show that PromptGNN-sim outperforms classical GNNs, LLMs, and recent GNN-LLM fusion methods, demonstrating the effectiveness of interactive structure-semantic collaboration for text-attributed graph learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 45 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

37 of 45 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2017Graph Attention Networkscited by 8,923
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  8. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  9. 2017Inductive Representation Learning on Large Graphscited by 6,320
  10. 2018How Powerful are Graph Neural Networks?cited by 4,393
  11. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  12. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
25 more
  1. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  2. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  3. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
  4. 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 447
  5. 2018Adversarial Attack on Graph Structured Datacited by 301
  6. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
  7. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  8. 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 210
  9. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
  10. 2024LLaGA: Large Language and Graph Assistantcited by 181
  11. 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 152
  12. 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 85
  13. 2024Efficient Tuning and Inference for Large Language Models on Textual Graphscited by 54
  14. 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
  15. 2024A survey of dynamic graph neural networkscited by 24
  16. 2025LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Modelscited by 22
  17. 2024GAugLLM: Improving Graph Contrastive Learning for Text-Attributed Graphs with Large Language Modelscited by 17
  18. 2025Graph2text or Graph2token: A Perspective of Large Language Models for Graph Learningcited by 12
  19. 2024Similarity-based Neighbor Selection for Graph LLMscited by 10
  20. 2024LinkGPT: Teaching Large Language Models To Predict Missing Linkscited by 9
  21. 2025LLM-driven Knowledge Distillation for Dynamic Text-Attributed Graphscited by 8
  22. 2025Model Generalization on Text Attribute Graphs: Principles with Large Language Modelscited by 8
  23. 2025Toward General and Robust LLM-enhanced Text-attributed Graph Learningcited by 6
  24. 2025GraphiT: Efficient Node Classification on Text-Attributed Graphs with Prompt Optimized LLMscited by 4
  25. 2025Exploring the Potential of Large Language Models as Predictors in Dynamic Text-Attributed Graphscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Teaching LLMs to See Graphs: Unifying Text and Structural Reasoning
  2. 2024GL-Fusion: Rethinking the Combination of Graph Neural Network and Large Language model
  3. 2026ERAlign: Energy-based Representation Alignment of GNNs and LLMs on Text-attributed Graphs
  4. 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphs
  5. 2026A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning
  6. 2024Multi-View Empowered Structural Graph Wordification for Language Models
  7. 2026TemporalGraphLLM: Temporal Graph Neural Networks with Large Language Models for Dynamic Text-Attributed Graphs
  8. 2024LangTopo: Aligning Language Descriptions of Graphs with Tokenized Topological Modeling