Are Large Language Models Suitable for Graph Computation? Progress and Prospects
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have been increasingly explored for graph computation, where tasks require reasoning over structured relationships and algorithmic operations. Yet, it remains unclear when LLMs can reliably support such computation and how they should be incorporated into graph-solving pipelines. Existing surveys at the intersection of LLMs and graphs primarily focus on graph learning, text-attributed graphs, or graph-language modeling. To bridge this gap, we provide a comprehensive review of LLMs for graph computation through a role-based taxonomy. Specifically, we identify two major paradigms: i) LLMs as executors, where models directly solve graph tasks from graph descriptions and instructions; and ii) LLMs as planners, where models formulate problems, decompose reasoning steps, and invoke external tools or agents for execution. Based on this taxonomy, we analyze the strengths and limitations of current methods. Our review indicates that LLMs are promising for simple, small-scale tasks, but remain unreliable for large-scale and exactness-demanding tasks. Finally, we summarize available datasets and suggest four future directions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 64 of its 104 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
64 of 104 references.
References · 64
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2017Neural Collaborative Filteringcited by 1,111
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
38 more
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 379
- 2019Theoretical Limitations of Self-Attention in Neural Sequence Modelscited by 288
- 2023Can Language Models Solve Graph Problems in Natural Language?cited by 252
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 210
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 152
- 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 119
- 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 118
- 2023Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generationcited by 96
- 2023Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPTcited by 80
- 2024A Survey of Large Language Models for Graphscited by 72
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 69
- 2024Understanding Transformer Reasoning Capabilities via Graph Algorithmscited by 67
- 2024GraphInstruct: Empowering Large Language Models with Graph Understanding and Reasoning Capabilitycited by 58
- 2024InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignmentcited by 56
- 2024GraphArena: Evaluating and Exploring Large Language Models on Graph Computationcited by 49
- 2024Can LLM Graph Reasoning Generalize beyond Pattern Memorization?cited by 47
- 2023LLM4DyG: Can Large Language Models Solve Spatial-Temporal Problems on Dynamic Graphs?cited by 40
- 2024GITA: Graph to Visual and Textual Integration for Vision-Language Graph Reasoningcited by 33
- 2026Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgetscited by 30
- 2023Beyond Text: A Deep Dive into Large Language Models' Ability on Understanding Graph Datacited by 25
- 2024Scalable and Accurate Graph Reasoning with LLM-based Multi-Agentscited by 21
- 2020Friend or Faux: Graph-Based Early Detection of Fake Accounts on Social Networkscited by 19
- 2024Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoningcited by 19
- 2024GraphInsight: Unlocking Insights in Large Language Models for Graph Structure Understandingcited by 18
- 2023Are Chatbots Ready for Privacy-Sensitive Applications? An Investigation into Input Regurgitation and Prompt-Induced Sanitizationcited by 17
- 2024Can Graph Descriptive Order Affect Solving Graph Problems with LLMs?cited by 16
- 2024GraphTool-Instruction: Revolutionizing Graph Reasoning in LLMs through Decomposed Subtask Instructioncited by 14
- 2025Rewarding Graph Reasoning Process makes LLMs more Generalized Reasonerscited by 10
- 2025GraphThought: Graph Combinatorial Optimization with Thought Generationcited by 9
- 2025GraphOmni: A Comprehensive and Extensible Benchmark Framework for Large Language Models on Graph-theoretic Taskscited by 9
- 2025GraphCogent: Mitigating LLMs' Working Memory Constraints via Multi-Agent Collaboration in Complex Graph Understandingcited by 9
- 2025Reasoning Large Language Model Errors Arise from Hallucinating Critical Problem Featurescited by 6
- 2025Rethinking and Benchmarking Large Language Models for Graph Reasoningcited by 6
- 2022Differentially Private Triangle and 4-Cycle Counting in the Shuffle Modelcited by 5
- 2025Pseudocode-Injection Magic: Enabling LLMs to Tackle Graph Computational Taskscited by 5
50 most cited of 64 All 64 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Exploring Graph Learning Tasks with Pure LLMs: A Comprehensive Benchmark and Investigation
- 2024Revisiting the Graph Reasoning Ability of Large Language Models: Case Studies in Translation, Connectivity and Shortest Path
- 2024Graph Reasoning with Large Language Models via Pseudo-code Prompting
- 2023Talk like a Graph: Encoding Graphs for Large Language Models
- 2024Can LLMs perform structured graph reasoning?
- 2026Evaluating LLMs on Large-Scale Graph Property Estimation via Random Walks
- 2023Evaluating Large Language Models on Graphs: Performance Insights and Comparative Analysis
- 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs