Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Public research results on large-scale supervised finetuning of AI agents remain relatively rare, since the collection of agent training data presents unique challenges. In this work, we argue that the bottleneck is not a lack of underlying data sources, but that a large variety of data is fragmented across heterogeneous formats, tools, and interfaces. To this end, we introduce the agent data protocol (ADP), a light-weight representation language that serves as an "interlingua" between agent datasets in diverse formats and unified agent training pipelines downstream. The design of ADP is expressive enough to capture a large variety of tasks, including API/tool use, browsing, coding, software engineering, and general agentic workflows, while remaining simple to parse and train on without engineering at a per-dataset level. In experiments, we unified a broad collection of 13 existing agent training datasets into ADP format, and converted the standardized ADP data into training-ready formats for multiple agent frameworks. We performed SFT on these data, and demonstrated an average performance gain of ~20% over corresponding base models, and delivers state-of-the-art or near-SOTA performance on standard coding, browsing, tool use, and research benchmarks, without domain-specific tuning. All code and data are released publicly, in the hope that ADP could help lower the barrier to standardized, scalable, and reproducible agent training.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 49 of its 59 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
49 of 59 references.
Closest ancestors · 10
Same direction, newest first
- 2025Evaluation and Benchmarking of LLM Agents: A Survey29 Jul
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar
- 2024AgentBank: Towards Generalized LLM Agents via Fine-Tuning on 50000+ Interaction Trajectories10 Oct
- 2024xLAM: A Family of Large Action Models to Empower AI Agent Systems5 Sep
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey17 Apr
- 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models19 Mar
- 2024AgentOhana: Design Unified Data and Training Pipeline for Effective Agent Learning23 Feb
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs19 Oct
- 2023AgentBench: Evaluating LLMs as Agents7 Aug
Other references · 39
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
27 more
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 876
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
- 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 242
- 2023Data-centric Artificial Intelligence: A Surveycited by 202
- 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 188
- 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 177
- 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 156
- 2024The BrowserGym Ecosystem for Web Agent Researchcited by 152
- 2023Understanding Catastrophic Forgetting in Language Models via Implicit Inferencecited by 138
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 123
- 2024Revisiting Catastrophic Forgetting in Large Language Model Tuningcited by 93
- 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 88
- 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
- 2024NNetNav: Unsupervised Learning of Browser Agents Through Environment Interaction in the Wildcited by 55
- 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
- 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
- 2024Tur[k]ingBench: A Challenge Benchmark for Web Agentscited by 18
- 2024Machine Learning Data Practices through a Data Curation Lens: An Evaluation Frameworkcited by 18
Built on by
Citing papers per year: 2025: 1; 2026: 15.
16 papers.
Sort:
By area:
- 2026SWE-chat: Coding Agent Interactions From Real Users in the Wildcited by 36
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 35
- 2025Step-DeepResearch Technical Reportcited by 12
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?cited by 11
- 2026SERA: Soft-Verified Efficient Repository Agentscited by 10
- 2026Safe and Scalable Web Agent Learning via Recreated Websitescited by 9
- 2026What Do Agents Learn from Trajectory-SFT: Semantics or Interfaces?cited by 4
- 2026SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Taskscited by 4
- 2026TRACE: Capability-Targeted Agentic Trainingcited by 2
- 2026Agents Learn Their Runtime: Interpreter Persistence as Training-Time Semanticscited by 0
- 2026GRC: Unifying Reasoning-Driven Generation, Retrieval and Compressioncited by 0
- 2026Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learningcited by 0
4 more
- 2026CurateEvo: Data-Curation Evolving for Agentic Post-Trainingcited by 0
- 2026Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replaycited by 0
- 2026LandingAgent: A Reference-Annotated Dataset and Agentic Generation Framework for Landing Pagescited by 0
- 2026Efficient Test-Time Adaptation through Human-AI Interactioncited by 0
- 2026Efficient Test-Time Adaptation through Human-AI Interaction3 Sep 2026
- 2026LandingAgent: A Reference-Annotated Dataset and Agentic Generation Framework for Landing Pages28 Aug 2026
- 2026Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replay6 Aug 2026
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?10 Jul 2026
- 2026CurateEvo: Data-Curation Evolving for Agentic Post-Training7 Jul 2026
- 2026Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learning21 May 2026
- 2026GRC: Unifying Reasoning-Driven Generation, Retrieval and Compression9 May 2026
- 2026SWE-chat: Coding Agent Interactions From Real Users in the Wild22 Apr 2026
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr 2026
- 2026TRACE: Capability-Targeted Agentic Training7 Apr 2026
- 2026Safe and Scalable Web Agent Learning via Recreated Websites11 Mar 2026
- 2026Agents Learn Their Runtime: Interpreter Persistence as Training-Time Semantics1 Mar 2026
4 more
- 2026SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Tasks28 Feb 2026
- 2026What Do Agents Learn from Trajectory-SFT: Semantics or Interfaces?2 Feb 2026
- 2026SERA: Soft-Verified Efficient Repository Agents28 Jan 2026
- 2025Step-DeepResearch Technical Report23 Dec 2025
- 2026SWE-chat: Coding Agent Interactions From Real Users in the Wildcited by 36
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 35
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?cited by 11
- 2026SERA: Soft-Verified Efficient Repository Agentscited by 10
- 2026Safe and Scalable Web Agent Learning via Recreated Websitescited by 9
- 2026What Do Agents Learn from Trajectory-SFT: Semantics or Interfaces?cited by 4
- 2026SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Taskscited by 4
- 2026TRACE: Capability-Targeted Agentic Trainingcited by 2
- 2026Agents Learn Their Runtime: Interpreter Persistence as Training-Time Semanticscited by 0
- 2026Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learningcited by 0
- 2026CurateEvo: Data-Curation Evolving for Agentic Post-Trainingcited by 0
- 2026Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replaycited by 0
12 most cited of 13 All 13 (JSON)
- 2026LandingAgent: A Reference-Annotated Dataset and Agentic Generation Framework for Landing Pages28 Aug 2026
- 2026Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replay6 Aug 2026
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?10 Jul 2026
- 2026CurateEvo: Data-Curation Evolving for Agentic Post-Training7 Jul 2026
- 2026Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learning21 May 2026
- 2026SWE-chat: Coding Agent Interactions From Real Users in the Wild22 Apr 2026
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr 2026
- 2026TRACE: Capability-Targeted Agentic Training7 Apr 2026
- 2026Safe and Scalable Web Agent Learning via Recreated Websites11 Mar 2026
- 2026Agents Learn Their Runtime: Interpreter Persistence as Training-Time Semantics1 Mar 2026
- 2026SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Tasks28 Feb 2026
- 2026What Do Agents Learn from Trajectory-SFT: Semantics or Interfaces?2 Feb 2026
12 newest of 13 All 13 (JSON)
- 2025Step-DeepResearch Technical Reportcited by 12
- 2026Efficient Test-Time Adaptation through Human-AI Interactioncited by 0
- 2026Efficient Test-Time Adaptation through Human-AI Interaction3 Sep 2026
- 2025Step-DeepResearch Technical Report23 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026OpenThoughts-Agent: Data Recipes for Agentic Models
- 2026Exploring Autonomous Agentic Data Engineering for Model Specialization
- 2026AgenticDataBench: A Comprehensive Benchmark for Data Agents
- 2025A Survey of AI Agent Protocols
- 2025AgentFrontier: Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis
- 2026Can Generalist Agents Automate Data Curation?
- 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworks
- 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments