mlsanityData to 14 Oct 2026

RestGPT: Connecting Large Language Models with Real-World RESTful APIs

arXiv 2306.06624 ↗First posted 11 Jun 2023cs.CLcited by 135

Not on the map. Why?

Cited by 83 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Tool-augmented large language models (LLMs) have achieved remarkable progress in tackling a broad range of tasks. However, existing methods are mainly restricted to specifically designed tools and fail to fulfill complex instructions, having great limitations when confronted with real-world scenarios. In this paper, we explore a more realistic scenario by connecting LLMs with RESTful APIs, which adhere to the widely adopted REST software architectural style for web service development. To address the practical challenges of tackling complex instructions, we propose RestGPT, which exploits the power of LLMs and conducts a coarse-to-fine online planning mechanism to enhance the abilities of task decomposition and API selection. RestGPT also contains an API executor tailored for calling RESTful APIs, which can meticulously formulate parameters and parse API responses. To fully evaluate the performance of RestGPT, we propose RestBench, a high-quality benchmark which consists of two real-world scenarios and human-annotated instructions with gold solution paths. Experiments show that RestGPT is able to achieve impressive results in complex tasks and has strong robustness, which paves a new way towards AGI. RestGPT and RestBench is publicly available at https://restgpt.github.io/.

Key facts. Cited by 135 papers in the map (data through 14 Oct 2026). Builds on 20 of its 25 references that are in the map. First posted on arXiv 11 Jun 2023.

Builds on

20 of 25 references.

References · 20

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  6. 2022Emergent Abilities of Large Language Modelscited by 2,512
  7. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  8. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  9. 2023Large Language Models are not Fair Evaluatorscited by 1,085
  10. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  11. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
  12. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 603
8 more
  1. 2023Augmented Language Models: a Surveycited by 403
  2. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 398
  3. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 393
  4. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
  5. 2023Tool Learning with Foundation Modelscited by 302
  6. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 248
  7. 2022TALM: Tool Augmented Language Modelscited by 197
  8. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 6; 2024: 32; 2025: 53; 2026: 44.

135 papers.

Sort:

By area:

  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  2. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
  3. 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
  4. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  5. 2025Survey on Evaluation of LLM-based Agentscited by 204
  6. 2023Evaluating Large Language Models: A Comprehensive Surveycited by 202
  7. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  8. 2024EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instructioncited by 154
  9. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agentcited by 93
  10. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  11. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agentscited by 79
  12. 2024SciAgent: Tool-augmented Language Models for Scientific Reasoningcited by 70
38 more
  1. 2025Towards General Agentic Intelligence via Environment Scalingcited by 54
  2. 2023Towards End-to-End Embodied Decision Making via Multi-modal Large Language Model: Explorations with GPT4-Vision and Beyondcited by 51
  3. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 50
  4. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 50
  5. 2024NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Callscited by 48
  6. 2025MCP-RADAR: A Multi-Dimensional Benchmark for Evaluating Tool Use Capabilities in Large Language Modelscited by 48
  7. 2025Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Modelscited by 47
  8. 2023ToolTalk: Evaluating Tool-Usage in a Conversational Settingcited by 45
  9. 2024Learning to Ask: When LLM Agents Meet Unclear Instructioncited by 42
  10. 2024LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Feedbackcited by 41
  11. 2025MPO: Boosting LLM Agents with Meta Plan Optimizationcited by 36
  12. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  13. 2025A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directionscited by 34
  14. 2024PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chaincited by 29
  15. 2023Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Webcited by 24
  16. 2024TOOLVERIFIER: Generalization to New Tools via Self-Verificationcited by 24
  17. 2024A Trembling House of Cards? Mapping Adversarial Attacks against Language Agentscited by 22
  18. 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systemscited by 21
  19. 2025QLASS: Boosting Language Agent Inference via Q-Guided Stepwise Searchcited by 20
  20. 2025Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Taskscited by 19
  21. 2025Towards AI Search Paradigmcited by 19
  22. 2025A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Taskscited by 19
  23. 2026ToolTree: Efficient LLM Agent Tool Planning via Dual-Feedback Monte Carlo Tree Search and Bidirectional Pruningcited by 19
  24. 2025LongFuncEval: Measuring the effectiveness of long context models for function callingcited by 18
  25. 2024Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technologycited by 17
  26. 2024Harnessing LLMs for API Interactions: A Framework for Classification and Synthetic Data Generationcited by 17
  27. 2025LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queriescited by 17
  28. 2025DocLens : A Tool-Augmented Multi-Agent Framework for Long Visual Document Understandingcited by 15
  29. 2025Full-Step-DPO: Self-Supervised Preference Optimization with Step-wise Rewards for Mathematical Reasoningcited by 14
  30. 2025From REST to MCP: An Empirical Study of API Wrapping and Automated Server Generation for LLM Agentscited by 14
  31. 2024Smurfs: Multi-Agent System using Context-Efficient DFSDT for Tool Planningcited by 13
  32. 2025AskToAct: Enhancing LLMs Tool Use via Self-Correcting Clarificationcited by 13
  33. 2025a1: Steep Test-time Scaling Law via Environment Augmented Generationcited by 13
  34. 2025Environment Scaling for Interactive Agentic Experience Collection: A Surveycited by 13
  35. 2025AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoningcited by 11
  36. 2026PlanBench-XL: Evaluating Long-Horizon Planning of LLM Tool-Use Agents in Large-Scale Tool Ecosystemscited by 11
  37. 2024Causal Agent based on Large Language Modelcited by 10
  38. 2024MeNTi: Bridging Medical Calculator and LLM Agent with Nested Tool Callingcited by 10

50 most cited of 135 All 135 (JSON)