Towards Versatile Graph Learning Approach: from the Perspective of Large Language Models
Not on the map. Why?
Abstract (arXiv)
Graph-structured data are the commonly used and have wide application scenarios in the real world. For these diverse applications, the vast variety of learning tasks, graph domains, and complex graph learning procedures present challenges for human experts when designing versatile graph learning approaches. Facing these challenges, large language models (LLMs) offer a potential solution due to the extensive knowledge and the human-like intelligence. This paper proposes a novel conceptual prototype for designing versatile graph learning methods with LLMs, with a particular focus on the "where" and "how" perspectives. From the "where" perspective, we summarize four key graph learning procedures, including task definition, graph data feature engineering, model selection and optimization, deployment and serving. We then explore the application scenarios of LLMs in these procedures across a wider spectrum. In the "how" perspective, we align the abilities of LLMs with the requirements of each procedure. Finally, we point out the promising directions that could better leverage the strength of LLMs towards versatile graph learning methods.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 42 of its 49 references that are in the map. First posted on arXiv 18 Feb 2024.
Builds on
42 of 49 references.
References · 42
- 2017Attention Is All You Needcited by 60,106
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,318
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,107
- 2017Inductive Representation Learning on Large Graphscited by 6,303
- 2017Neural Message Passing for Quantum Chemistrycited by 3,471
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,911
- 2023A Survey of Large Language Modelscited by 2,559
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,218
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,689
- 2023GAIA: a benchmark for General AI Assistantscited by 1,102
30 more
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 353
- 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 273
- 2023Can Language Models Solve Graph Problems in Natural Language?cited by 250
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 240
- 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 225
- 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 210
- 2023OpenAGI: When LLM Meets Domain Expertscited by 197
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 191
- 2020Design Space for Graph Neural Networkscited by 182
- 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
- 2023GraphText: Graph Reasoning in Text Spacecited by 110
- 2022Transformer for Graphs: An Overview from Architecture Perspectivecited by 107
- 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 106
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 101
- 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 84
- 2023AutoML-GPT: Automatic Machine Learning with GPTcited by 81
- 2023Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPTcited by 78
- 2018Automated Machine Learning: From Principles to Practicescited by 62
- 2023Patton: Language Model Pretraining on Text-Rich Networkscited by 49
- 2023Can Large Language Models Empower Molecular Property Prediction?cited by 44
- 2021Automated Machine Learning on Graphs: A Surveycited by 39
- 2022AutoML for Deep Recommender Systems: A Surveycited by 29
- 2023Train Your Own GNN Teacher: Graph-Aware Distillation on Textual Graphscited by 29
- 2023Automated 3D Pre-Training for Molecular Property Predictioncited by 24
- 2023AutoKG: Efficient Automated Knowledge Graph Generation for Language Modelscited by 17
- 2023Prompt Tuning on Graph-augmented Low-resource Text Classificationcited by 13
- 2022Taxonomy of Benchmarks in Graph Representation Learningcited by 11
- 2022KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learningcited by 7
- 2023A Versatile Graph Learning Approach through LLM-based Agentcited by 6
Built on by
Citing papers per year: 2024: 1.
1 paper.