AgentTune: A Unified Training Lifecycle for Tool-Using LLM Agents
On the map: LLM agents and tool use → Software engineering coding agents also fits: Agent skill learning and evolution
Abstract (arXiv)
Tool-using agents increasingly require a common substrate for building, training, evaluating, distilling, and maintaining agentic systems, yet existing tooling typically addresses these stages in isolation. We present AgentTune, a source-available Python library that provides a unified framework for developing and optimizing tool-using agents. At its core, AgentTune introduces a two-tier EventLog representation that preserves agent trajectories while supporting consistent projections for training, evaluation, and auditing. Building on this substrate, the library provides a shared agent runtime, tool-calling reinforcement learning, agentic distillation, retrieval-augmented generation, decision workflows, evaluation utilities, and a designed path toward self-healing agents. These components are exposed through composable interfaces so that agent strategies, training methods, evaluation procedures, and recovery mechanisms can be combined without requiring separate representations or pipelines. We demonstrate the framework across agentic tasks including legal contract search and domain-specific applications, illustrating its use for trajectory-based optimization, tool-use evaluation, and cross-task agent development. AgentTune is released as a source-available library at https://github.com/Lexsi-Labs/AgentTune
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 46 of its 73 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
46 of 73 references.
References · 46
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
34 more
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 418
- 2022Unnatural Instructions: Tuning Language Models with (Almost) No Human Laborcited by 397
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 310
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 238
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
- 2024Lessons from the Trenches on Reproducible Evaluation of Language Modelscited by 179
- 2021ContractNLI: A Dataset for Document-level Natural Language Inference for Contractscited by 148
- 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 122
- 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domaincited by 118
- 2019Compositional Questions Do Not Necessitate Multi-hop Reasoningcited by 88
- 2019Question Answering for Privacy Policies: Combining Computational and Legal Perspectivescited by 67
- 2025DeepRetrieval: Hacking Real Search Engines and Retrievers with Large Language Models via Reinforcement Learningcited by 66
- 2024Binary Classifier Optimization for Large Language Model Alignmentcited by 45
- 2023MAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understandingcited by 33
- 2025Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agentcited by 30
- 2025Large Language Models Meet Legal Artificial Intelligence: A Surveycited by 10
- 2025GRADE: Generating multi-hop QA and fine-gRAined Difficulty matrix for RAG Evaluationcited by 8
- 2025FrugalRAG: Less is More in RL Finetuning for Multi-Hop Question Answeringcited by 4
- 2026Search, Do not Guess: Teaching Small Language Models to Be Effective Search Agentscited by 2
- 2026Can LLMs Time Travel? Enhancing Temporal Consistency in Legal Agentic Search through Reinforcement Learningcited by 2
- 2026CuratorKIT : Data Curation and Synthetic Data Generation for LLM Post-Trainingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ToolBrain: A Flexible Reinforcement Learning Framework for Agentic Tools
- 2026SkillCraft: Can LLM Agents Learn to Use Tools Skillfully?
- 2026AgentEscapeBench: Evaluating Out-of-Domain Tool-Grounded Reasoning in LLM Agents
- 2026ToolPRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agents
- 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectories
- 2026UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agents
- 2024Learning to Use Tools via Cooperative and Interactive Agents
- 2026Learning to Construct Practical Agentic Systems