GeckOpt: LLM System Efficiency via Intent-Based Tool Selection
Not on the map. Why?
Abstract (arXiv)
In this preliminary study, we investigate a GPT-driven intent-based reasoning approach to streamline tool selection for large language models (LLMs) aimed at system efficiency. By identifying the intent behind user prompts at runtime, we narrow down the API toolset required for task execution, reducing token consumption by up to 24.6%. Early results on a real-world, massively parallel Copilot platform with over 100 GPT-4-Turbo nodes show cost reductions and potential towards improving LLM-based system efficiency.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 6 of its 7 references that are in the map. First posted on arXiv 24 Apr 2024.
Builds on
6 of 7 references.
References · 6
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2024GeoLLM-Engine: A Realistic Environment for Building Geospatial Copilotscited by 27
- 2024Evaluating Tool-Augmented Agents in Remote Sensing Platformscited by 17
- 2023Stable Diffusion For Aerial Object Detectioncited by 9
Built on by
Citing papers per year: 2024: 5; 2025: 6; 2026: 1.
12 papers.
- 2024Tool Learning with Large Language Models: A Surveycited by 221
- 2025Prompt Injection Attack to Tool Selection in LLM Agentscited by 145
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
- 2025Multi-Agent Geospatial Copilots for Remote Sensing Workflowscited by 20
- 2024An LLM-Tool Compiler for Fused Parallel Function Callingcited by 14
- 2024Evaluating Zero-Shot GPT-4V Performance on 3D Visual Question Answering Benchmarkscited by 10
- 2024LLM-dCache: Improving Tool-Augmented LLMs with GPT-Driven Localized Data Cachingcited by 7
- 2025GraphChain: Large Language Models for Large-scale Graph Analysis via Tool Chainingcited by 5
- 2024Unlearning Climate Misinformation in Large Language Modelscited by 4
- 2025MassTool: A Multi-Task Search-Based Tool Retrieval Framework for Large Language Modelscited by 3
- 2025Automated Multi-Agent Workflows for RTL Designcited by 3
- 2026Optimal Skill Selection for LLM Agents with Provable Bicriteria Guaranteescited by 2
- 2026Optimal Skill Selection for LLM Agents with Provable Bicriteria Guarantees20 Aug 2026
- 2025GraphChain: Large Language Models for Large-scale Graph Analysis via Tool Chaining1 Nov 2025
- 2025Automated Multi-Agent Workflows for RTL Design24 Sep 2025
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directions23 Sep 2025
- 2025MassTool: A Multi-Task Search-Based Tool Retrieval Framework for Large Language Models1 Jul 2025
- 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr 2025
- 2025Multi-Agent Geospatial Copilots for Remote Sensing Workflows27 Jan 2025
- 2024LLM-dCache: Improving Tool-Augmented LLMs with GPT-Driven Localized Data Caching10 Jun 2024
- 2024Unlearning Climate Misinformation in Large Language Models29 May 2024
- 2024Evaluating Zero-Shot GPT-4V Performance on 3D Visual Question Answering Benchmarks29 May 2024
- 2024Tool Learning with Large Language Models: A Survey28 May 2024
- 2024An LLM-Tool Compiler for Fused Parallel Function Calling7 May 2024