T1: A Tool-Oriented Conversational Dataset for Multi-Turn Agentic Planning
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated impressive capabilities as intelligent agents capable of solving complex problems. However, effective planning in scenarios involving dependencies between API or tool calls-particularly in multi-turn conversations-remains a significant challenge. To address this, we introduce T1, a tool-augmented, multi-domain, multi-turn conversational dataset specifically designed to capture and manage inter-tool dependencies across diverse domains. T1 enables rigorous evaluation of agents' ability to coordinate tool use across nine distinct domains (4 single domain and 5 multi-domain) with the help of an integrated caching mechanism for both short- and long-term memory, while supporting dynamic replanning-such as deciding whether to recompute or reuse cached results. Beyond facilitating research on tool use and planning, T1 also serves as a benchmark for evaluating the performance of open-weight and proprietary large language models. We present results powered by T1-Agent, highlighting their ability to plan and reason in complex, tool-dependent scenarios.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 22 of its 39 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
22 of 39 references.
Closest ancestors · 5
Same direction, newest first
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases8 Jun
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs14 Apr
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 17
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2025s1: Simple test-time scalingcited by 1,341
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
5 more
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
- 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 177
- 2025Phi-4-reasoning Technical Reportcited by 151
- 2024GTA: A Benchmark for General Tool Agentscited by 77
- 2024m&m's: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Taskscited by 38
Built on by
Citing papers per year: 2025: 4; 2026: 10.
14 papers.
Sort:
By area:
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2025GTM: Simulating the World of Tools for AI Agentscited by 14
- 2026CacheWise: Understanding Workloads and Optimizing KVCache Management for Efficiently Serving LLM Coding Agentscited by 10
- 2026TraceCompiler: Skill-Guided Mining and Compilation of LLM Agent Traces into Mostly Deterministic Workflowscited by 5
- 2025SEADialogues: A Multilingual Culturally Grounded Multi-turn Dialogue Dataset on Southeast Asian Languagescited by 4
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agentscited by 4
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
- 2026SynAE: A Framework for Measuring the Quality of Synthetic Data for Tool-Calling Agent Evaluationscited by 2
- 2026Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversationscited by 2
- 2026T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domainscited by 2
- 2026ATOD: An Evaluation Framework and Benchmark for Agentic Task-Oriented Dialogue Systemscited by 0
- 2026Towards Scalable Customization and Deployment of Multi-Agent Systems for Enterprise Applicationscited by 0
- 2026TraceCompiler: Skill-Guided Mining and Compilation of LLM Agent Traces into Mostly Deterministic Workflows3 Aug 2026
- 2026PAUSE: A User-Centric Benchmark for Personal AI Assistants in Unified Service Environments29 Jul 2026
- 2026Out of Sight: Compression-Aware Content Protection against Agentic Crawlers9 Jul 2026
- 2026Towards Scalable Customization and Deployment of Multi-Agent Systems for Enterprise Applications16 Jun 2026
- 2026CacheWise: Understanding Workloads and Optimizing KVCache Management for Efficiently Serving LLM Coding Agents15 Jun 2026
- 2026T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domains9 Jun 2026
- 2026Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversations30 May 2026
- 2026SynAE: A Framework for Measuring the Quality of Synthetic Data for Tool-Calling Agent Evaluations21 May 2026
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents1 Feb 2026
- 2026ATOD: An Evaluation Framework and Benchmark for Agentic Task-Oriented Dialogue Systems17 Jan 2026
- 2025GTM: Simulating the World of Tools for AI Agents4 Dec 2025
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents20 Oct 2025
- 2025GTM: Simulating the World of Tools for AI Agentscited by 14
- 2026TraceCompiler: Skill-Guided Mining and Compilation of LLM Agent Traces into Mostly Deterministic Workflowscited by 5
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agentscited by 4
- 2026SynAE: A Framework for Measuring the Quality of Synthetic Data for Tool-Calling Agent Evaluationscited by 2
- 2026Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversationscited by 2
- 2026T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domainscited by 2
- 2026ATOD: An Evaluation Framework and Benchmark for Agentic Task-Oriented Dialogue Systemscited by 0
- 2026Towards Scalable Customization and Deployment of Multi-Agent Systems for Enterprise Applicationscited by 0
- 2026TraceCompiler: Skill-Guided Mining and Compilation of LLM Agent Traces into Mostly Deterministic Workflows3 Aug 2026
- 2026Towards Scalable Customization and Deployment of Multi-Agent Systems for Enterprise Applications16 Jun 2026
- 2026T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domains9 Jun 2026
- 2026Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversations30 May 2026
- 2026SynAE: A Framework for Measuring the Quality of Synthetic Data for Tool-Calling Agent Evaluations21 May 2026
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents1 Feb 2026
- 2026ATOD: An Evaluation Framework and Benchmark for Agentic Task-Oriented Dialogue Systems17 Jan 2026
- 2025GTM: Simulating the World of Tools for AI Agents4 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025How Can Input Reformulation Improve Tool Usage Accuracy in a Complex Dynamic Environment? A Study on τ-bench
- 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset
- 2026Internalizing Tool Knowledge in Small Language Models via QLoRA Fine-Tuning
- 2025TRAJECT-Bench:A Trajectory-Aware Benchmark for Evaluating Agentic Tool Use
- 2025ToolACE-MT: Non-Autoregressive Generation for Agentic Multi-Turn Interaction
- 2026PDEU-Bench: Benchmarking the Personalized Planning Lifecycle of Tool-Calling LLM Agents
- 2026ToolAtlas: Learning Once, Reusing Everywhere with Tool-Side Memory
- 2026UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agents