Davinci-Tool: Scaling Agentic Tool-Use Supervision with Verifiable Executable Environments
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Reliable agentic tool use requires training data that pair diverse multi-step workflows with executable evidence that the requested outcomes were achieved. Scaling either trajectory coverage or verification alone is insufficient as new environments introduce distinct states, rules, and dependencies that must also be reflected in the success criteria. To address this challenge, we introduce Davinci-Tool, a 30B tool-use model, and Davinci-ToolData, an execution-grounded dataset designed to scale environment coverage and outcome verification together. Davinci-ToolData preserves restorable states, execution traces, outcomes, and verifiers as a unified substrate for supervision. Two complementary pipelines populate this substrate: Execution-Grounded Task Synthesis (EGTS) derives verified demonstrations from independently authored systems, and Executable Environment Synthesis (EES) synthesizes auditable environments, state-grounded tasks, and executable verifiers across single and coordinated domains. These pipelines yield 30,395 verified trajectories spanning 2,260 invoked tool names. We first train on these demonstrations with supervised fine-tuning, then reuse EES states and verifiers to compare alternative actions and construct outcome-grounded preferences for Direct Preference Optimization. Davinci-Tool improves Qwen3-Coder-30B-A3B-Instruct from 52.4 to 88.2 on τ2-bench, from 30.4 to 62.8 on BFCL v4 multi-turn, and from 16.9 to 56.2 on MCP-Atlas, outperforming Qwen3-Coder-480B-A35B-Instruct on all three benchmarks with only 1/16 of its total parameters. Code is available at https://github.com/MassLab-SII/Davinci-Tool.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 45 of its 49 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
45 of 49 references.
Closest ancestors · 3
Same direction, newest first
- 2026Execution-First Synthetic Tool-Use Trace Generation for LLM Agents31 Jul
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents26 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 42
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2016Training Deep Nets with Sublinear Memory Costcited by 848
30 more
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
- 2024Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learningcited by 241
- 2024ToolACE: Winning the Points of LLM Function Callingcited by 216
- 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agentscited by 208
- 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 197
- 2024StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Modelscited by 132
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 130
- 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 100
- 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Executioncited by 85
- 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 85
- 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 69
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
- 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Serverscited by 53
- 2025MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Usecited by 39
- 2024Towards Self-Improvement of LLMs via MCTS: Leveraging Stepwise Knowledge with Curriculum Preference Learningcited by 30
- 2025Scaling Synthetic Task Generation for Agents via Explorationcited by 23
- 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 21
- 2026Trajectory2Task: Training Robust Tool-Calling Agents with Synthesized Yet Verifiable Data for Complex User Intentscited by 14
- 2025Automated Skill Discovery for Language Agents through Exploration and Iterative Feedbackcited by 12
- 2025MCP-Flow: Facilitating LLM Agents to Master Real-World, Diverse and Scaling MCP Toolscited by 11
- 2026ASTRA: Automated Synthesis of agentic Trajectories and Reinforcement Arenascited by 8
- 2026Synthesize and Reward -- Reinforcement Learning for Multi-Step Tool Use in Live Environmentscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
- 2026ToolPRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agents
- 2026Maintaining Benchmarks Against Increasingly Capable Agents: Detection and Remediation of Unearned Passes
- 2026daVinci-Dev: Agent-native Mid-training for Software Engineering
- 2026Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIs
- 2026DIVE: Scaling Diversity in Agentic Task Synthesis for Generalizable Tool Use
- 2026Long-Horizon-Terminal-Bench 2.0: Automating Diverse Task Construction and Measuring Sustained Agent Progress
- 2026Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability