mlsanityData to 14 Oct 2026

Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Tasks

arXiv 2412.12456 ↗First posted 17 Dec 2024cs.LG cs.AI cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models (LLMs) into a unified Model architecture (e.g., LLM as enhancer, LLM as collaborators, LLM as predictor) has emerged as a promising technological paradigm. The core of this new graph learning paradigm lies in the synergistic combination of GNNs' ability to capture complex structural relationships and LLMs' proficiency in understanding informative contexts from the rich textual descriptions of graphs. Therefore, we can leverage graph description texts with rich semantic context to fundamentally enhance Data quality, thereby improving the representational capacity of model-centric approaches in line with data-centric machine learning principles. By leveraging the strengths of these distinct neural network architectures, this integrated approach addresses a wide range of TAG-based Task (e.g., graph learning, graph reasoning, and graph question answering), particularly in complex industrial scenarios (e.g., supervised, few-shot, and zero-shot settings). In other words, we can treat text as a medium to enable cross-domain generalization of graph learning Model, allowing a single graph model to effectively handle the diversity of downstream graph-based Task across different data domains. This work serves as a foundational reference for researchers and practitioners looking to advance graph learning methodologies in the rapidly evolving landscape of LLM. We consistently maintain the related open-source materials at urlhttps://github.com/xkLi-Allen/Awesome-GNN-in-LLMs-Papers.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 40 of its 93 references that are in the map. First posted on arXiv 17 Dec 2024.

Builds on

40 of 93 references.

References · 40

  1. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  2. 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
  3. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  4. 2021Datasets: A Community Library for Natural Language Processingcited by 530
  5. 2018Learning Word Vectors for 157 Languagescited by 280
  6. 2023Can Language Models Solve Graph Problems in Natural Language?cited by 252
  7. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  8. 2023Language is All a Graph Needscited by 220
  9. 2024LLaGA: Large Language and Graph Assistantcited by 181
  10. 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
  11. 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
  12. 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
28 more
  1. 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 133
  2. 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 118
  3. 2023GraphText: Graph Reasoning in Text Spacecited by 111
  4. 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 107
  5. 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
  6. 2023PRODIGY: Enabling In-context Learning Over Graphscited by 98
  7. 2023SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learningcited by 73
  8. 2023Label-free Node Classification on Graphs with Large Language Models (LLMS)cited by 72
  9. 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 57
  10. 2024AnyGraph: Graph Foundation Model in the Wildcited by 53
  11. 2024Fully-inductive Node Classification on Arbitrary Graphscited by 39
  12. 2023Disentangled Representation Learning with Large Language Models for Text-Attributed Graphscited by 36
  13. 2024RAGraph: A General Retrieval-Augmented Graph Learning Frameworkcited by 24
  14. 2024Scalable and Accurate Graph Reasoning with LLM-based Multi-Agentscited by 21
  15. 2024Graph-oriented Instruction Tuning of Large Language Models for Generic Graph Miningcited by 20
  16. 2024Learning Graph Quantized Tokenizerscited by 19
  17. 2024HIGHT: Hierarchical Graph Tokenization for Molecule-Language Alignmentcited by 17
  18. 2024GraphAlign: Pretraining One Graph Neural Network on Multiple Graphs via Feature Alignmentcited by 15
  19. 2024One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphscited by 12
  20. 2024Advancing Molecular Graph-Text Pre-training via Fine-grained Alignmentcited by 9
  21. 2024GL-Fusion: Rethinking the Combination of Graph Neural Network and Large Language modelcited by 8
  22. 2024Generalizing Graph Transformers Across Diverse Graphs and Tasks via Pre-trainingcited by 7
  23. 2024GraphNarrator: Generating Textual Explanations for Graph Neural Networkscited by 7
  24. 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphscited by 6
  25. 2024TAGA: Text-Attributed Graph Self-Supervised Learning by Synergizing Graph and Text Mutual Transformationscited by 5
  26. 2024Link Prediction on Textual Edge Graphscited by 4
  27. 2024How to Make LMs Strong Node Classifiers?cited by 4
  28. 2024Unleashing the Potential of Text-attributed Graphs: Automatic Relation Decomposition via Large Language Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 5.

10 papers.