mlsanityData to 7 Oct 2026

Reasoning and Tool-use Compete in Agentic RL:From Quantifying Interference to Disentangled Tuning

arXiv 2602.00994 ↗First posted 1 Feb 2026cs.AIcited by 15

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Agentic Reinforcement Learning (ARL) trains large language models to interleave reasoning with external tool execution to solve complex tasks. Most existing ARL methods train a single set of parameters to support both reasoning and tool-use behaviors, implicitly assuming that joint training leads to improved overall agent performance. Despite its widespread adoption, this assumption has rarely been examined empirically. In this paper, we systematically examine this assumption by introducing Capability Effect Attribution (CEA), which provides quantitative evidence of interference between reasoning and tool-use behaviors. Through an in-depth analysis, we show that these two capabilities often induce misaligned gradient directions, leading to training interference that undermines the effectiveness of joint optimization and challenges the prevailing ARL paradigm. To address this issue, we propose Disentangled Action--Reasoning Tuning (DART), a simple and efficient framework that explicitly decouples parameter updates for reasoning and tool use via separate low-rank adaptation modules. With this simple change alone, DART outperforms all joint-optimization baselines and approaches the 2-Agent upper bound across thirteen benchmarks on retrieval-augmented QA and NL2SQL, further supporting our finding of capability interference under shared optimization.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 23 of its 66 references that are in the map. First posted on arXiv 1 Feb 2026.

Builds on

23 of 66 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Use1 Sep
  2. 2025AutoTIR: Autonomous Tools Integrated Reasoning via Reinforcement Learning29 Jul
  3. 2025Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learning22 May
  4. 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learning28 Apr
  5. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMs15 Apr

Other references · 18

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  4. 2024Qwen2 Technical Reportcited by 2,076
  5. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  6. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  7. 2025ToolRL: Reward is All Tool Learning Needscited by 342
  8. 2024MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Expertscited by 144
  9. 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 66
  10. 2025WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learningcited by 59
  11. 2024MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Modelscited by 54
  12. 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 49
6 more
  1. 2023SiRA: Sparse Mixture of Low Rank Adaptationcited by 32
  2. 2025Reward-SQL: Boosting Text-to-SQL via Stepwise Execution-Aware Reasoning and Process-Supervised Rewardscited by 25
  3. 2025MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capabilitycited by 22
  4. 2025RLFactory: A Plug-and-Play Reinforcement Learning Post-Training Framework for LLM Multi-Turn Tool-Usecited by 17
  5. 2026Automated Optimization Modeling via a Localizable Error-Driven Perspectivecited by 14
  6. 2026Towards a Theoretical Understanding to the Generalization of RLHFcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Spurious Tool Use: When RL Agents Learn the Wrong Reason to Act
  2. 2026ASTER: Agentic Scaling with Tool-integrated Extended Reasoning
  3. 2026Does RL Expand the Capability Boundary of LLM Agents? A PASS@(k,T) Analysis
  4. 2025Demystifying Reinforcement Learning in Agentic Reasoning
  5. 2025AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning
  6. 2026Tool-Aware Optimization with Entropy Guidance for Efficient Agentic Reinforcement Learning
  7. 2026On Effectiveness and Efficiency of Agentic Tool-calling and RL Training
  8. 2026Efficient Agentic Reinforcement Learning with On-Policy Intrinsic Knowledge Boundary Enhancement