daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
While Large Language Models (LLMs) excel at short-term tasks, scaling them to long-horizon agentic workflows remains challenging. The core bottleneck lies in the scarcity of training data that captures authentic long-dependency structures and cross-stage evolutionary dynamics--existing synthesis methods either confine to single-feature scenarios constrained by model distribution, or incur prohibitive human annotation costs, failing to provide scalable, high-quality supervision. We address this by reconceptualizing data synthesis through the lens of real-world software evolution. Our key insight: Pull Request (PR) sequences naturally embody the supervision signals for long-horizon learning. They decompose complex objectives into verifiable submission units, maintain functional coherence across iterations, and encode authentic refinement patterns through bug-fix histories. Building on this, we propose daVinci-Agency, which systematically mines structured supervision from chain-of-PRs through three interlocking mechanisms: (1) progressive task decomposition via continuous commits, (2) long-term consistency enforcement through unified functional objectives, and (3) verifiable refinement from authentic bug-fix trajectories. Unlike synthetic trajectories that treat each step independently, daVinci-Agency's PR-grounded structure inherently preserves the causal dependencies and iterative refinements essential for teaching persistent goal-directed behavior and enables natural alignment with project-level, full-cycle task modeling. The resulting trajectories are substantial--averaging 85k tokens and 116 tool calls--yet remarkably data-efficient: fine-tuning GLM-4.6 on 239 daVinci-Agency samples yields broad improvements across benchmarks, notably achieving a 47% relative gain on Toolathlon. Beyond benchmark performance, our analysis confirms...
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 22 of its 31 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
22 of 31 references.
Closest ancestors · 9
Same direction, newest first
- 2026AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts16 Jan
- 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skills18 Dec
- 2025Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Construction4 Dec
- 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution29 Oct
- 2025UltraHorizon: Benchmarking Agent Capabilities in Ultra Long-Horizon Scenarios26 Sep
- 2025LIMI: Less is More for Agency22 Sep
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
- 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RL6 Aug
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
Other references · 13
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 442
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 214
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agentscited by 127
- 2023Question Decomposition Improves the Faithfulness of Model-Generated Reasoningcited by 107
- 2025InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Researchcited by 18
- 2025A Practitioner's Guide to Multi-turn Agentic Reinforcement Learningcited by 16
- 2026daVinci-Dev: Agent-native Mid-training for Software Engineeringcited by 15
1 more
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks
- 2026CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agents
- 2026BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents
- 2026Trained Agentic Context Management
- 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research
- 2026ADE: Agentic Data Evolution Framework for Human-Centered Objectives
- 2026TrajLong: Co-Designing Agentic and Long-Context Supervision for Mid-Training
- 2026FlowEvo: Self-Evolving Agents through the Co-Evolution of Workflows and Executable Skills