mlsanityData to 7 Oct 2026

TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environments

arXiv 2510.01179 ↗First posted 1 Oct 2025cs.LG cs.AI cs.CLcited by 61

On the map: LLM agents and tool use → Tool learning and function calling

Abstract (arXiv)

Large Language Model (LLM) agents are rapidly emerging as powerful systems for automating tasks across domains. Yet progress in the open-source community is constrained by the lack of high quality permissively licensed tool-agentic training data. Existing datasets are often limited in diversity, realism, and complexity, particularly regarding multi-tool and multi-turn interactions. To address this gap, we introduce Toucan, the largest publicly available tool-agentic dataset to date, containing 1.5 million trajectories synthesized from nearly 500 real-world Model Context Protocols (MCPs). Unlike prior work, Toucan leverages authentic MCP environments to generate diverse, realistic, and challenging tasks with trajectories involving real tool execution. Our pipeline first produces a broad spectrum of tool-use queries using five distinct models, applies model-based quality filtering, and then generates agentic trajectories with three teacher models using two agentic frameworks. Rigorous rule-based and model-based validation ensures high-quality outputs. We also introduce three extension mechanisms to further diversify tasks and simulate multi-turn conversations. Models fine-tuned on Toucan outperform larger closed-source counterparts on the BFCL V3 benchmark and push the Pareto frontier forward on MCP-Universe Bench.

Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 19 of its 36 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

19 of 36 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025MCP-AgentBench: Evaluating Real-World Language Agent Performance with MCP-Mediated Tools10 Sep
  2. 2025MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Servers28 Aug
  3. 2025LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queries21 Aug
  4. 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Servers20 Aug
  5. 2025MCP-RADAR: A Multi-Dimensional Benchmark for Evaluating Tool Use Capabilities in Large Language Models22 May
  6. 2025ACEBench: Who Wins the Match Point in Tool Usage?22 Jan
  7. 2024API-BLEND: A Comprehensive Corpora for Training and Benchmarking API LLMs23 Feb
  8. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
  9. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases8 Jun
  10. 2023Gorilla: Large Language Model Connected with Massive APIs24 May

Other references · 9

  1. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  2. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  3. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  4. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 158
  5. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
  6. 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 115
  7. 2025MCPWorld: A Unified Benchmarking Testbed for API, GUI, and Hybrid Computer Use Agentscited by 37
  8. 2024API Pack: A Massive Multi-Programming Language Dataset for API Call Generationcited by 5
  9. 2025A Scalable Approach to Clustering Embedding Projectionscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 10; 2026: 51.

61 papers.

Sort:

By area:

  1. 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 72
  2. 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 52
  3. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 35
  4. 2026Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 33
  5. 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Datasetcited by 27
  6. 2025LoopTool: Closing the Data-Training Loop for Robust LLM Tool Callscited by 16
  7. 2025AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learningcited by 14
  8. 2026Unlocking Implicit Experience: Synthesizing Tool-Use Trajectories from Textcited by 13
  9. 2026EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RLcited by 11
  10. 2025Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Modelscited by 8
  11. 2026CacheWise: Understanding Workloads and Optimizing KVCache Management for Efficiently Serving LLM Coding Agentscited by 8
  12. 2026ASTRA: Automated Synthesis of agentic Trajectories and Reinforcement Arenascited by 6
38 more
  1. 2026PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planningcited by 6
  2. 2025Delegated Authorization for Agents Constrained to Semantic Task-to-Scope Matchingcited by 5
  3. 2026LOGIGEN: Logic-Driven Generation of Verifiable Agentic Taskscited by 5
  4. 2026EigenData: A Self-Evolving Multi-Agent Platform for Function-Calling Data Synthesis, Auditing, and Repaircited by 5
  5. 2026Controllable and Verifiable Tool-Use Data Synthesis for Agentic Reinforcement Learningcited by 5
  6. 2026Learning to Rewrite Tool Descriptions for Reliable LLM-Agent Tool Usecited by 4
  7. 2026Tool-Genesis: A Task-Driven Tool Creation Benchmark for Self-Evolving Language Agentcited by 4
  8. 2026SING: Synthetic Intention Graph for Scalable Active Tool Discovery in LLM Agentscited by 4
  9. 2025K2-V2: A 360-Open, Reasoning-Enhanced LLMcited by 3
  10. 2026Simulating Complex Multi-Turn Tool Calling Interactions in Stateless Execution Environmentscited by 3
  11. 2026UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agentscited by 3
  12. 2026ToolVerse: Unlocking Massive Environments and Long-Horizon Tasks for Agentic Reinforcement Learningcited by 3
  13. 2026ReCache: Efficient KV Cache Reuse and Compression for Tool-Augmented LLM Agentscited by 3
  14. 2026Typhoon-S: Minimal Open Post-Training for Sovereign Large Language Modelscited by 2
  15. 2026ARTIS: Agentic Risk-Aware Test-Time Scaling via Iterative Simulationcited by 2
  16. 2026Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIscited by 2
  17. 2026RODS: Reward-Driven Online Data Synthesis for Multi-Turn Tool-Use Agentscited by 2
  18. 2026EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learningcited by 2
  19. 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 2
  20. 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectoriescited by 2
  21. 2025AMAP Agentic Planning Technical Reportcited by 1
  22. 2026Dicta-LM 3.0: Advancing The Frontier of Hebrew Sovereign LLMscited by 1
  23. 2026Fine-Tuning Small Reasoning Models for Quantum Field Theorycited by 1
  24. 2026When the Strongest Teacher Is Not the Best Teacher: Student-Centric Answer Selectioncited by 1
  25. 2026WRIT: Write-Read Intensive Trajectory Synthesis for Multi-Turn User-Facing Agentscited by 1
  26. 2026ISE: An Execution-Grounded Recipe for Multi-Turn OS-Agent Trajectoriescited by 1
  27. 2026Execution-First Synthetic Tool-Use Trace Generation for LLM Agentscited by 1
  28. 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modelingcited by 1
  29. 2026Learning Generalizable Behaviors for Terminal Agentscited by 1
  30. 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agentcited by 1
  31. 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 1
  32. 2025HumanMCP: A Human-Like Query Dataset for Evaluating MCP Tool Retrieval Performancecited by 0
  33. 2026NGDBench: Towards Neural Graph Data Managementcited by 0
  34. 2026A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarkscited by 0
  35. 2026Towards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflowscited by 0
  36. 2026From Knowing to Acting: Benchmarking Self-Awareness Capability of LLM Agentscited by 0
  37. 2026The Open Source Economic Index of AI Adoption and Capabilitycited by 0
  38. 2026UMoE:Unlocking Every Expert in Domain-Specific Trainingcited by 0

50 most cited of 61 All 61 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025MCPVerse: An Expansive, Real-World Benchmark for Agentic Tool Use
  2. 2025Close the Loop: Synthesizing Infinite Tool-Use Data via Multi-Agent Role-Playing
  3. 2025MCP-Flow: Facilitating LLM Agents to Master Real-World, Diverse and Scaling MCP Tools
  4. 2025TRAJECT-Bench:A Trajectory-Aware Benchmark for Evaluating Agentic Tool Use
  5. 2026Action-Space Shaping for LLM Agents: Measuring and Mitigating Tool-Schema Bias
  6. 2026BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents
  7. 2025AutoTool: Efficient Tool Selection for Large Language Model Agents
  8. 2026AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments