mlsanityData to 14 Oct 2026

Davinci-Tool: Scaling Agentic Tool-Use Supervision with Verifiable Executable Environments

arXiv 2610.16867 ↗First posted 12 Oct 2026cs.LG cs.AI cs.CLcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Reliable agentic tool use requires training data that pair diverse multi-step workflows with executable evidence that the requested outcomes were achieved. Scaling either trajectory coverage or verification alone is insufficient as new environments introduce distinct states, rules, and dependencies that must also be reflected in the success criteria. To address this challenge, we introduce Davinci-Tool, a 30B tool-use model, and Davinci-ToolData, an execution-grounded dataset designed to scale environment coverage and outcome verification together. Davinci-ToolData preserves restorable states, execution traces, outcomes, and verifiers as a unified substrate for supervision. Two complementary pipelines populate this substrate: Execution-Grounded Task Synthesis (EGTS) derives verified demonstrations from independently authored systems, and Executable Environment Synthesis (EES) synthesizes auditable environments, state-grounded tasks, and executable verifiers across single and coordinated domains. These pipelines yield 30,395 verified trajectories spanning 2,260 invoked tool names. We first train on these demonstrations with supervised fine-tuning, then reuse EES states and verifiers to compare alternative actions and construct outcome-grounded preferences for Direct Preference Optimization. Davinci-Tool improves Qwen3-Coder-30B-A3B-Instruct from 52.4 to 88.2 on τ2-bench, from 30.4 to 62.8 on BFCL v4 multi-turn, and from 16.9 to 56.2 on MCP-Atlas, outperforming Qwen3-Coder-480B-A35B-Instruct on all three benchmarks with only 1/16 of its total parameters. Code is available at https://github.com/MassLab-SII/Davinci-Tool.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 45 of its 49 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

45 of 49 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026Execution-First Synthetic Tool-Use Trace Generation for LLM Agents31 Jul
  2. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents26 Jul
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May

Other references · 42

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  7. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  8. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  9. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  10. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  11. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  12. 2016Training Deep Nets with Sublinear Memory Costcited by 848
30 more
  1. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  2. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
  3. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  4. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  5. 2025Kimi K2: Open Agentic Intelligencecited by 567
  6. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  7. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
  8. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
  9. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
  10. 2024Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learningcited by 241
  11. 2024ToolACE: Winning the Points of LLM Function Callingcited by 216
  12. 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agentscited by 208
  13. 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 197
  14. 2024StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Modelscited by 132
  15. 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 130
  16. 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 100
  17. 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Executioncited by 85
  18. 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 85
  19. 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 69
  20. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  21. 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Serverscited by 53
  22. 2025MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Usecited by 39
  23. 2024Towards Self-Improvement of LLMs via MCTS: Leveraging Stepwise Knowledge with Curriculum Preference Learningcited by 30
  24. 2025Scaling Synthetic Task Generation for Agents via Explorationcited by 23
  25. 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 21
  26. 2026Trajectory2Task: Training Robust Tool-Calling Agents with Synthesized Yet Verifiable Data for Complex User Intentscited by 14
  27. 2025Automated Skill Discovery for Language Agents through Exploration and Iterative Feedbackcited by 12
  28. 2025MCP-Flow: Facilitating LLM Agents to Master Real-World, Diverse and Scaling MCP Toolscited by 11
  29. 2026ASTRA: Automated Synthesis of agentic Trajectories and Reinforcement Arenascited by 8
  30. 2026Synthesize and Reward -- Reinforcement Learning for Multi-Step Tool Use in Live Environmentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
  2. 2026ToolPRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agents
  3. 2026Maintaining Benchmarks Against Increasingly Capable Agents: Detection and Remediation of Unearned Passes
  4. 2026daVinci-Dev: Agent-native Mid-training for Software Engineering
  5. 2026Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIs
  6. 2026DIVE: Scaling Diversity in Agentic Task Synthesis for Generalizable Tool Use
  7. 2026Long-Horizon-Terminal-Bench 2.0: Automating Diverse Task Construction and Measuring Sustained Agent Progress
  8. 2026Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability