mlsanityData to 7 Oct 2026

LoopTool: Closing the Data-Training Loop for Robust LLM Tool Calls

arXiv 2511.09148 ↗First posted 12 Nov 2025cs.CL cs.AI cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

Augmenting Large Language Models (LLMs) with external tools enables them to execute complex, multi-step tasks. However, tool learning is hampered by the static synthetic data pipelines where data generation and model training are executed as two separate, non-interactive processes. This approach fails to adaptively focus on a model's specific weaknesses and allows noisy labels to persist, degrading training efficiency. We introduce LoopTool, a fully automated, model-aware data evolution framework that closes this loop by tightly integrating data synthesis and model training. LoopTool iteratively refines both the data and the model through three synergistic modules: (1) Greedy Capability Probing (GCP) diagnoses the model's mastered and failed capabilities; (2) Judgement-Guided Label Verification (JGLV) uses an open-source judge model to find and correct annotation errors, progressively purifying the dataset; and (3) Error-Driven Data Expansion (EDDE) generates new, challenging samples based on identified failures. This closed-loop process operates within a cost-effective, open-source ecosystem, eliminating dependence on expensive closed-source APIs. Experiments show that our 8B model trained with LoopTool significantly surpasses its 32B data generator and achieves new state-of-the-art results on the BFCL-v3 and ACEBench benchmarks for its scale. Our work demonstrates that closed-loop, self-refining data pipelines can dramatically enhance the tool-use capabilities of LLMs.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

41 of 54 references.

References · 41

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023Let's Verify Step by Stepcited by 3,598
  7. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  8. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  9. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  10. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  11. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  12. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
29 more
  1. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
  2. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  3. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  4. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
  5. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
  6. 2025ToolRL: Reward is All Tool Learning Needscited by 342
  7. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
  8. 2024Tool Learning with Large Language Models: A Surveycited by 221
  9. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 188
  10. 2024Are We Done with MMLU?cited by 178
  11. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 158
  12. 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learningcited by 152
  13. 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
  14. 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 88
  15. 2025Self-Adapting Language Modelscited by 71
  16. 2024Reinforcement Learning Enhanced LLMs: A Surveycited by 69
  17. 2025Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoningcited by 67
  18. 2025ACEBench: Who Wins the Match Point in Tool Usage?cited by 66
  19. 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 61
  20. 2025rStar2-Agent: Agentic Reasoning Technical Reportcited by 54
  21. 2025Beyond Pass@1: Self-Play with Variational Problem Synthesis Sustains RLVRcited by 53
  22. 2024Facilitating Multi-turn Function Calling for LLMs via Compositional Instruction Tuningcited by 40
  23. 2024m&m's: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Taskscited by 38
  24. 2025A Survey of Research in Large Language Models for Electronic Design Automationcited by 38
  25. 2025Magnet: Multi-turn Tool-use Data Synthesis and Distillation via Graph Translationcited by 37
  26. 2024Synthesizing Post-Training Data for LLMs through Multi-Agent Simulationcited by 22
  27. 2024Automated test generation to evaluate tool-augmented LLMs as conversational AI agentscited by 17
  28. 2024Nonlinear Discrete-Time Observers with Physics-Informed Neural Networkscited by 8
  29. 2025CoreCodeBench: Decoupling Code Intelligence via Fine-Grained Repository-Level Taskscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

  1. 2026ExpSeek: Self-Triggered Experience Seeking for Web Agentscited by 23
  2. 2026MMSkills: Towards Multimodal Skills for General Visual Agentscited by 13
  3. 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectoriescited by 13
  4. 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestrationcited by 11
  5. 2026Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errorscited by 10
  6. 2026From Failure to Mastery: Generating Hard Samples for Tool-use Agentscited by 8
  7. 2026Agent-Dice: Disentangling Knowledge Updates via Geometric Consensus for Agent Continual Learningcited by 6
  8. 2026Towards On-Policy Data Evolution for Visual-Native Multimodal Deep Search Agentscited by 6
  9. 2026MonoScale: Scaling Multi-Agent System with Monotonic Improvementcited by 5
  10. 2026When Simulation Lies: A Sim-to-Real Benchmark and Domain-Randomized RL Recipe for Tool-Use Agentscited by 5
  11. 2026UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agentscited by 3
  12. 2026On Effectiveness and Efficiency of Agentic Tool-calling and RL Trainingcited by 2
4 more
  1. 2026RODS: Reward-Driven Online Data Synthesis for Multi-Turn Tool-Use Agentscited by 2
  2. 2026DiffCold: A Diffusion-based Generative Model for Cold-Start Item Recommendationcited by 1
  3. 2026A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutionscited by 0
  4. 2026Learning from Unreachable Rewards: Hint-Conditioned Reinforcement Learning for Generative Recommendationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarios
  2. 2025AskToAct: Enhancing LLMs Tool Use via Self-Correcting Clarification
  3. 2024Forewarned is Forearmed: Leveraging LLMs for Data Synthesis through Failure-Inducing Exploration
  4. 2026DataEvolver: Automatic Data Preparation for Large Language Models through Multi-Level Self-Evolving
  5. 2025Enhancing Tool Learning in Large Language Models with Hierarchical Error Checklists
  6. 2024StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models
  7. 2025iTool: Reinforced Fine-Tuning with Dynamic Deficiency Calibration for Advanced Tool Use
  8. 2025LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning