mlsanityData to 14 Oct 2026

T1: A Tool-Oriented Conversational Dataset for Multi-Turn Agentic Planning

arXiv 2505.16986 ↗First posted 22 May 2025cs.CL cs.AIcited by 14

On the map: LLM agents and tool use → Tool learning and function calling

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated impressive capabilities as intelligent agents capable of solving complex problems. However, effective planning in scenarios involving dependencies between API or tool calls-particularly in multi-turn conversations-remains a significant challenge. To address this, we introduce T1, a tool-augmented, multi-domain, multi-turn conversational dataset specifically designed to capture and manage inter-tool dependencies across diverse domains. T1 enables rigorous evaluation of agents' ability to coordinate tool use across nine distinct domains (4 single domain and 5 multi-domain) with the help of an integrated caching mechanism for both short- and long-term memory, while supporting dynamic replanning-such as deciding whether to recompute or reuse cached results. Beyond facilitating research on tool use and planning, T1 also serves as a benchmark for evaluating the performance of open-weight and proprietary large language models. We present results powered by T1-Agent, highlighting their ability to plan and reason in complex, tool-dependent scenarios.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 22 of its 39 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

22 of 39 references.

Closest ancestors · 5

Same direction, newest first

  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
  2. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases8 Jun
  3. 2023Gorilla: Large Language Model Connected with Massive APIs24 May
  4. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs14 Apr
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb

Other references · 17

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  4. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  5. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  6. 2025s1: Simple test-time scalingcited by 1,341
  7. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  8. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  9. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  10. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  11. 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
  12. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
5 more
  1. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
  2. 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 177
  3. 2025Phi-4-reasoning Technical Reportcited by 151
  4. 2024GTA: A Benchmark for General Tool Agentscited by 77
  5. 2024m&m's: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Taskscited by 38

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 10.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025How Can Input Reformulation Improve Tool Usage Accuracy in a Complex Dynamic Environment? A Study on τ-bench
  2. 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset
  3. 2026Internalizing Tool Knowledge in Small Language Models via QLoRA Fine-Tuning
  4. 2025TRAJECT-Bench:A Trajectory-Aware Benchmark for Evaluating Agentic Tool Use
  5. 2025ToolACE-MT: Non-Autoregressive Generation for Agentic Multi-Turn Interaction
  6. 2026PDEU-Bench: Benchmarking the Personalized Planning Lifecycle of Tool-Calling LLM Agents
  7. 2026ToolAtlas: Learning Once, Reusing Everywhere with Tool-Side Memory
  8. 2026UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agents