AskToAct: Enhancing LLMs Tool Use via Self-Correcting Clarification
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Large language models (LLMs) have demonstrated remarkable capabilities in tool learning. In real-world scenarios, user queries are often ambiguous and incomplete, requiring effective clarification. However, existing interactive clarification approaches face two critical limitations: reliance on manually constructed datasets, which inherently constrains training data scale and diversity, and lack of error correction mechanisms during multi-turn clarification, leading to error accumulation that compromises both accuracy and efficiency. We present AskToAct, which addresses these challenges by exploiting the structural mapping between queries and their tool invocation solutions. Our key insight is that tool parameters naturally represent explicit user intents. By systematically removing key parameters from queries while retaining them as ground truth, we enable automated construction of high-quality training data. We further enhance model robustness through error-correction pairs and selective masking, enabling dynamic error detection during clarification interactions. Comprehensive experiments demonstrate that AskToAct significantly outperforms existing approaches, achieving above 57% accuracy in recovering critical unspecified intents and enhancing clarification efficiency by an average of 10.46% while maintaining high accuracy in tool invocation. Our framework exhibits robust performance across different model architectures and successfully generalizes to entirely unseen APIs without additional training, achieving performance comparable to GPT-4o with substantially fewer computational resources.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 29 of its 49 references that are in the map. First posted on arXiv 3 Mar 2025.
Builds on
29 of 49 references.
Closest ancestors · 10
Same direction, newest first
- 2025ToolDial: Multi-turn Dialogue Generation Method for Tool-Augmented Language Models1 Mar
- 2024Learning to Ask: When LLM Agents Meet Unclear Instruction31 Aug
- 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasets26 Jun
- 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use4 Oct
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023ToolQA: A Dataset for LLM Question Answering with External Tools23 Jun
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases8 Jun
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
- 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings19 May
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 19
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2022Large Language Models Can Self-Improvecited by 656
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 138
- 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 129
7 more
- 2024STaR-GATE: Teaching Language Models to Ask Clarifying Questionscited by 99
- 2023Clarify When Necessary: Resolving Ambiguity Through Interaction with LMscited by 93
- 2024Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agentscited by 71
- 2024Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environmentscited by 39
- 2023ToolCoder: Teach Code Generation Models to use API search toolscited by 37
- 2023MultiTool-CoT: GPT-3 Can Use Multiple External Tools with Chain of Thought Promptingcited by 27
- 2024S^3cMath: Spontaneous Step-level Self-correction Makes Large Language Models Better Mathematical Reasonerscited by 17
Built on by
Citing papers per year: 2025: 5; 2026: 7.
12 papers.
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
- 2026When and What to Ask: AskBench and Rubric-Guided RLVR for LLM Clarificationcited by 12
- 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestrationcited by 11
- 2025Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimizationcited by 10
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026IDRBench: Benchmarking the Interactive Capabilities of Deep Research Agentscited by 3
- 2026Egocentric Co-Pilot: Web-Native Smart-Glasses Agents for Assistive Egocentric AIcited by 3
- 2026Asking What Matters: Reward-Driven Clarification for Software Engineering Taskscited by 3
- 2026Pause or Fabricate? Training Language Models for Grounded Reasoningcited by 2
- 2026Ambig-DS: A Benchmark for Task-Framing Ambiguity in Data-Science Agentscited by 2
- 2025COCORELI: Enforcing Execution Preconditions for Reliable Collaborative Instruction Followingcited by 0
- 2026Ambig-DS: A Benchmark for Task-Framing Ambiguity in Data-Science Agents10 May 2026
- 2026Pause or Fabricate? Training Language Models for Grounded Reasoning21 Apr 2026
- 2026Asking What Matters: Reward-Driven Clarification for Software Engineering Tasks16 Apr 2026
- 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestration24 Mar 2026
- 2026Egocentric Co-Pilot: Web-Native Smart-Glasses Agents for Assistive Egocentric AI1 Mar 2026
- 2026When and What to Ask: AskBench and Rubric-Guided RLVR for LLM Clarification4 Feb 2026
- 2026IDRBench: Benchmarking the Interactive Capabilities of Deep Research Agents10 Jan 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directions23 Sep 2025
- 2025COCORELI: Enforcing Execution Preconditions for Reliable Collaborative Instruction Following29 Aug 2025
- 2025Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization8 Jun 2025
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024LLM With Tools: A Survey
- 2024CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models
- 2025TUMS: Enhancing Tool-use Abilities of LLMs with Multi-structure Handlers
- 2024ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
- 2026Try, Check and Retry: A Divide-and-Conquer Framework for Boosting Long-context Tool-Calling Performance of LLMs
- 2025ToolScope: Enhancing LLM Agent Tool Use through Tool Merging and Context-Aware Filtering
- 2025Verification-Guided Context Optimization for Tool Calling via Hierarchical LLMs-as-Editors
- 2024Forewarned is Forearmed: Leveraging LLMs for Data Synthesis through Failure-Inducing Exploration