ToolSelf: Unifying Task Execution and Self-Reconfiguration via Tool-Driven Emergent Adaptation
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
LLM-powered agentic systems excel at complex long-horizon tasks, but remain constrained by static configurations fixed before execution. Such rigidity forces a trade-off between domain-specific performance and cross-task generalization: strong priors and compact tool spaces aid specialization but weaken transfer, while task-agnostic workflows and broad action spaces expand coverage but dilute guidance. Existing pre-execution optimization, planner-worker orchestration, and configuration patching fall short of resolving this tension, as they decouple adaptation from execution, causing information loss, fragmented optimization, and ambiguous credit assignment. We propose ToolSelf, a tool-driven runtime self-reconfiguration paradigm that abstracts configuration updates as a standardized tool interface and unifies execution and adaptation within one policy's action space. The execution agent can dynamically update sub-goals, strategies, toolboxes, context, and context-management modes based on task progress and feedback. We further introduce Configuration-Aware Two-stage Training (CAT), which combines rejection sampling fine-tuning with trajectory-level KTO reinforcement learning to internalize self-reconfiguration. Across diverse benchmarks, zero-shot ToolSelf rivals task-specialized agents; after CAT training, ToolSelf gains 28.8 points over the static-configuration baseline on average, illuminating a path toward emergent adaptivity that obviates manually injected guidance. The code is available at https://github.com/lian-tian-mo-zun/ToolSelf.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 30 of its 52 references that are in the map. First posted on arXiv 8 Feb 2026.
Builds on
30 of 52 references.
References · 30
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2024AFlow: Automating Agentic Workflow Generationcited by 395
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 226
18 more
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
- 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
- 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 158
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 132
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 129
- 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinementcited by 124
- 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 118
- 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Toolscited by 106
- 2025OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoningcited by 69
- 2025WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learningcited by 59
- 2025AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agentscited by 49
- 2025The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agentscited by 39
- 2025OAgents: An Empirical Study of Building Effective Agentscited by 28
- 2024AppBench: Planning of Multiple APIs from Various APPs for Complex User Instructioncited by 24
- 2025Co-Sight: Enhancing LLM-Based Agents via Conflict-Aware Meta-Verification and Trustworthy Reasoning with Structured Factscited by 12
- 2026AgenTRIM: Tool Risk Mitigation for Agentic AIcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnesses
- 2026EvoTool: Self-Evolving Tool-Use Policy Optimization in LLM Agents via Blame-Aware Mutation and Diversity-Aware Selection
- 2026Scaling Agentic Capabilities, Not Context: Efficient Reinforcement Finetuning for Large Toolspaces
- 2026Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streams
- 2026When Successful Strategies Fail: Adaptation to Environmental Novelty in Terminal Agents
- 2026Tool-Aware Optimization with Entropy Guidance for Efficient Agentic Reinforcement Learning
- 2026EASy: Towards Efficient LLM-Based Agentic System
- 2026Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents