mlsanityData to 7 Oct 2026

Advancing SLM Tool-Use Capability using Reinforcement Learning

arXiv 2509.04518 ↗First posted 3 Sep 2025cs.CLcited by 1

On the map: LLM reasoning → Reinforcement learning for reasoning

also in 1 more
Abstract (arXiv)

In an era where tool-augmented AI agents are becoming increasingly vital, our findings highlight the ability of Group Relative Policy Optimization (GRPO) to empower SLMs, which are traditionally constrained in tool use. The ability to use tools effectively has become a defining feature of Large Language Models (LLMs), allowing them to access external data and internal resources. As AI agents grow more sophisticated, tool-use capabilities have become indispensable. While LLMs have made significant progress in this area, Small Language Models (SLMs) still face challenges in accurately integrating tool use, especially in resource-constrained settings. This study investigates how Reinforcement Learning, specifically Group Relative Policy Optimization (GRPO), can enhance the tool-use accuracy of SLMs. By designing a well-defined reward system that reinforces structured JSON output, correct tool selection, and precise parameter usage, we demonstrate that GRPO enables SLMs to achieve significant improvements in tool-use capabilities (function calling/JSON output). Our approach provides a computationally efficient training method that enhances SLMs practical deployment in real-world AI applications.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 21 references that are in the map. First posted on arXiv 3 Sep 2025.

Builds on

18 of 21 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan
  2. 2017Proximal Policy Optimization Algorithms20 Jul

Other references · 16

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2024Qwen2.5 Technical Reportcited by 4,713
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  7. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  8. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  9. 2024AI Agents That Mattercited by 199
  10. 2024A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthinesscited by 125
  11. 2024Small Language Models: Survey, Measurements, and Insightscited by 109
  12. 2024xLAM: A Family of Large Action Models to Empower AI Agent Systemscited by 108
4 more
  1. 2024TinyAgent: Function Calling at the Edgecited by 55
  2. 2024A Survey of Small Language Modelscited by 31
  3. 2024Improving Small-Scale Large Language Models Function Calling for Reasoning Taskscited by 7
  4. 2019'Alexa, Do You Know Anything?' The Impact of an Intelligent Assistant on Team Interactions and Creative Performance Under Time Scarcitycited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ToolExpander: Extending the Frontiers of Tool-Using Reinforcement Learning to Weak LLMs
  2. 2025Composing Policy Gradients and Prompt Optimization for Language Model Programs
  3. 2025Training-Free Group Relative Policy Optimization
  4. 2026Enhancing LLM-based Search Agents via Contribution Weighted Group Relative Policy Optimization
  5. 2025Stronger-MAS: Multi-Agent Reinforcement Learning for Collaborative LLMs
  6. 2025Group-Relative REINFORCE Is Secretly an Off-Policy Algorithm: Demystifying Some Myths About GRPO and Its Friends
  7. 2026CoDistill-GRPO: A Co-Distillation Recipe for Efficient Group Relative Policy Optimization
  8. 2026GRPO Training Dynamics for Small Language Models