mlsanityData to 7 Oct 2026

Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents

arXiv 2510.24702 ↗First posted 28 Oct 2025cs.CL cs.AIcited by 16

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Public research results on large-scale supervised finetuning of AI agents remain relatively rare, since the collection of agent training data presents unique challenges. In this work, we argue that the bottleneck is not a lack of underlying data sources, but that a large variety of data is fragmented across heterogeneous formats, tools, and interfaces. To this end, we introduce the agent data protocol (ADP), a light-weight representation language that serves as an "interlingua" between agent datasets in diverse formats and unified agent training pipelines downstream. The design of ADP is expressive enough to capture a large variety of tasks, including API/tool use, browsing, coding, software engineering, and general agentic workflows, while remaining simple to parse and train on without engineering at a per-dataset level. In experiments, we unified a broad collection of 13 existing agent training datasets into ADP format, and converted the standardized ADP data into training-ready formats for multiple agent frameworks. We performed SFT on these data, and demonstrated an average performance gain of ~20% over corresponding base models, and delivers state-of-the-art or near-SOTA performance on standard coding, browsing, tool use, and research benchmarks, without domain-specific tuning. All code and data are released publicly, in the hope that ADP could help lower the barrier to standardized, scalable, and reproducible agent training.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 49 of its 59 references that are in the map. First posted on arXiv 28 Oct 2025.

Builds on

49 of 59 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Evaluation and Benchmarking of LLM Agents: A Survey29 Jul
  2. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
  3. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar
  4. 2024AgentBank: Towards Generalized LLM Agents via Fine-Tuning on 50000+ Interaction Trajectories10 Oct
  5. 2024xLAM: A Family of Large Action Models to Empower AI Agent Systems5 Sep
  6. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey17 Apr
  7. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models19 Mar
  8. 2024AgentOhana: Design Unified Data and Training Pipeline for Effective Agent Learning23 Feb
  9. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs19 Oct
  10. 2023AgentBench: Evaluating LLMs as Agents7 Aug

Other references · 39

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  8. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  9. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  10. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  11. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  12. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
27 more
  1. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  2. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  3. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  4. 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 876
  5. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
  6. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  7. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  8. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 314
  9. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  10. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
  11. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
  12. 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 242
  13. 2023Data-centric Artificial Intelligence: A Surveycited by 202
  14. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 188
  15. 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 177
  16. 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 156
  17. 2024The BrowserGym Ecosystem for Web Agent Researchcited by 152
  18. 2023Understanding Catastrophic Forgetting in Language Models via Implicit Inferencecited by 138
  19. 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 123
  20. 2024Revisiting Catastrophic Forgetting in Large Language Model Tuningcited by 93
  21. 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 88
  22. 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
  23. 2024NNetNav: Unsupervised Learning of Browser Agents Through Environment Interaction in the Wildcited by 55
  24. 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
  25. 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
  26. 2024Tur[k]ingBench: A Challenge Benchmark for Web Agentscited by 18
  27. 2024Machine Learning Data Practices through a Data Curation Lens: An Evaluation Frameworkcited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 15.

16 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026OpenThoughts-Agent: Data Recipes for Agentic Models
  2. 2026Exploring Autonomous Agentic Data Engineering for Model Specialization
  3. 2026AgenticDataBench: A Comprehensive Benchmark for Data Agents
  4. 2025A Survey of AI Agent Protocols
  5. 2025AgentFrontier: Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis
  6. 2026Can Generalist Agents Automate Data Curation?
  7. 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworks
  8. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments