mlsanityData to 7 Oct 2026

From Failure to Mastery: Generating Hard Samples for Tool-use Agents

arXiv 2601.01498 ↗First posted 4 Jan 2026cs.CLcited by 8

On the map: LLM agents and tool use → Tool learning and function calling

Abstract (arXiv)

The advancement of LLM agents with tool-use capabilities requires diverse and complex training corpora. Existing data generation methods, which predominantly follow a paradigm of random sampling and shallow generation, often yield simple and homogeneous trajectories that fail to capture complex, implicit logical dependencies. To bridge this gap, we introduce HardGen, an automatic agentic pipeline designed to generate hard tool-use training samples with verifiable reasoning. Firstly, HardGen establishes a dynamic API Graph built upon agent failure cases, from which it samples to synthesize hard traces. Secondly, these traces serve as conditional priors to guide the instantiation of modular, abstract advanced tools, which are subsequently leveraged to formulate hard queries. Finally, the advanced tools and hard queries enable the generation of verifiable complex Chain-of-Thought (CoT), with a closed-loop evaluation feedback steering the continuous refinement of the process. Extensive evaluations demonstrate that a 4B parameter model trained with our curated dataset achieves superior performance compared to several leading open-source and closed-source competitors (e.g., GPT-5.2, Gemini-3-Pro and Claude-Opus-4.5). Our code, models, and dataset will be open-sourced to facilitate future research.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 16 of its 25 references that are in the map. First posted on arXiv 4 Jan 2026.

Builds on

16 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025TTPA: Token-level Tool-use Preference Alignment Training Framework with Fine-grained Evaluation26 May

Other references · 15

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  3. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  4. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  5. 2025ToolRL: Reward is All Tool Learning Needscited by 342
  6. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 158
  7. 2025Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoningcited by 67
  8. 2024Simulating Financial Market via Large Language Model based Agentscited by 25
  9. 2025Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Modelcited by 20
  10. 2025LoopTool: Closing the Data-Training Loop for Robust LLM Tool Callscited by 16
  11. 2024From Natural Language to SQL: Review of LLM-based Text-to-SQL Systemscited by 15
  12. 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworkscited by 14
3 more
  1. 2025ToolACE-MT: Non-Autoregressive Generation for Agentic Multi-Turn Interactioncited by 11
  2. 2024A Closer Look at Logical Reasoning with LLMs: The Choice of Tool Matterscited by 8
  3. 2025Reasoning through Exploration: A Reinforcement Learning Framework for Robust Function Callingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentEscapeBench: Evaluating Out-of-Domain Tool-Grounded Reasoning in LLM Agents
  2. 2026AgentJudgeBench: A Multi-Difficulty Benchmark for Evaluating LLM Judges on Agentic Tool-Calling
  3. 2026TraceCompiler: Skill-Guided Mining and Compilation of LLM Agent Traces into Mostly Deterministic Workflows
  4. 2026EDGEGEN: Improving Tool-Calling Agents Beyond Happy Paths with Synthetic Edge Case Generation
  5. 2026AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
  6. 2026Learning to Rewrite Tool Descriptions for Reliable LLM-Agent Tool Use
  7. 2026SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generation
  8. 2025ToolFuzz -- Automated Agent Tool Testing