Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Tasks
Not on the map. Why?
Abstract (arXiv)
With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models (LLMs) into a unified Model architecture (e.g., LLM as enhancer, LLM as collaborators, LLM as predictor) has emerged as a promising technological paradigm. The core of this new graph learning paradigm lies in the synergistic combination of GNNs' ability to capture complex structural relationships and LLMs' proficiency in understanding informative contexts from the rich textual descriptions of graphs. Therefore, we can leverage graph description texts with rich semantic context to fundamentally enhance Data quality, thereby improving the representational capacity of model-centric approaches in line with data-centric machine learning principles. By leveraging the strengths of these distinct neural network architectures, this integrated approach addresses a wide range of TAG-based Task (e.g., graph learning, graph reasoning, and graph question answering), particularly in complex industrial scenarios (e.g., supervised, few-shot, and zero-shot settings). In other words, we can treat text as a medium to enable cross-domain generalization of graph learning Model, allowing a single graph model to effectively handle the diversity of downstream graph-based Task across different data domains. This work serves as a foundational reference for researchers and practitioners looking to advance graph learning methodologies in the rapidly evolving landscape of LLM. We consistently maintain the related open-source materials at urlhttps://github.com/xkLi-Allen/Awesome-GNN-in-LLMs-Papers.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 40 of its 93 references that are in the map. First posted on arXiv 17 Dec 2024.
Builds on
40 of 93 references.
References · 40
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2018Learning Word Vectors for 157 Languagescited by 280
- 2023Can Language Models Solve Graph Problems in Natural Language?cited by 252
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2023Language is All a Graph Needscited by 220
- 2024LLaGA: Large Language and Graph Assistantcited by 181
- 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
- 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
- 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
28 more
- 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 133
- 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 118
- 2023GraphText: Graph Reasoning in Text Spacecited by 111
- 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 107
- 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
- 2023PRODIGY: Enabling In-context Learning Over Graphscited by 98
- 2023SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learningcited by 73
- 2023Label-free Node Classification on Graphs with Large Language Models (LLMS)cited by 72
- 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 57
- 2024AnyGraph: Graph Foundation Model in the Wildcited by 53
- 2024Fully-inductive Node Classification on Arbitrary Graphscited by 39
- 2023Disentangled Representation Learning with Large Language Models for Text-Attributed Graphscited by 36
- 2024RAGraph: A General Retrieval-Augmented Graph Learning Frameworkcited by 24
- 2024Scalable and Accurate Graph Reasoning with LLM-based Multi-Agentscited by 21
- 2024Graph-oriented Instruction Tuning of Large Language Models for Generic Graph Miningcited by 20
- 2024Learning Graph Quantized Tokenizerscited by 19
- 2024HIGHT: Hierarchical Graph Tokenization for Molecule-Language Alignmentcited by 17
- 2024GraphAlign: Pretraining One Graph Neural Network on Multiple Graphs via Feature Alignmentcited by 15
- 2024One Model for One Graph: A New Perspective for Pretraining with Cross-domain Graphscited by 12
- 2024Advancing Molecular Graph-Text Pre-training via Fine-grained Alignmentcited by 9
- 2024GL-Fusion: Rethinking the Combination of Graph Neural Network and Large Language modelcited by 8
- 2024Generalizing Graph Transformers Across Diverse Graphs and Tasks via Pre-trainingcited by 7
- 2024GraphNarrator: Generating Textual Explanations for Graph Neural Networkscited by 7
- 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphscited by 6
- 2024TAGA: Text-Attributed Graph Self-Supervised Learning by Synergizing Graph and Text Mutual Transformationscited by 5
- 2024Link Prediction on Textual Edge Graphscited by 4
- 2024How to Make LMs Strong Node Classifiers?cited by 4
- 2024Unleashing the Potential of Text-attributed Graphs: Automatic Relation Decomposition via Large Language Modelscited by 3
Built on by
Citing papers per year: 2025: 5; 2026: 5.
10 papers.
- 2025GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environmentscited by 19
- 2026Learning Posterior Predictive Distributions for Node Classification from Synthetic Graph Priorscited by 10
- 2025A Query-Aware Multi-Path Knowledge Graph Fusion Approach for Enhancing Retrieval-Augmented Generation in Large Language Modelscited by 1
- 2025Deploying AI for Signal Processing education: Selected challenges and intriguing opportunitiescited by 1
- 2026GraphSeek: Next-Generation Graph Analytics with LLMscited by 1
- 2026LLM as Graph Kernel: Rethinking Message Passing on Text-Rich Graphscited by 1
- 2026Detecting Differences Is Not Understanding Structure: Large Language Models Fail at Graph Isomorphismcited by 1
- 2025When LLM Agents Meet Graph Optimization: An Automated Data Quality Improvement Approachcited by 0
- 2025GraphShaper: Geometry-aware Alignment for Improving Transfer Learning in Text-Attributed Graphscited by 0
- 2026OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph Learning under Data Quality Degradationcited by 0
- 2026OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph Learning under Data Quality Degradation21 Jul 2026
- 2026Detecting Differences Is Not Understanding Structure: Large Language Models Fail at Graph Isomorphism8 Jun 2026
- 2026Learning Posterior Predictive Distributions for Node Classification from Synthetic Graph Priors21 Apr 2026
- 2026LLM as Graph Kernel: Rethinking Message Passing on Text-Rich Graphs16 Mar 2026
- 2026GraphSeek: Next-Generation Graph Analytics with LLMs11 Feb 2026
- 2025GraphShaper: Geometry-aware Alignment for Improving Transfer Learning in Text-Attributed Graphs14 Oct 2025
- 2025When LLM Agents Meet Graph Optimization: An Automated Data Quality Improvement Approach10 Oct 2025
- 2025Deploying AI for Signal Processing education: Selected challenges and intriguing opportunities10 Sep 2025
- 2025A Query-Aware Multi-Path Knowledge Graph Fusion Approach for Enhancing Retrieval-Augmented Generation in Large Language Models7 Jul 2025
- 2025GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environments1 Apr 2025