mlsanityData to 14 Oct 2026

Small Reasoning Models are Instruction Followers in Function Calling

arXiv 2608.22472 ↗First posted 23 Aug 2026cs.AI cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Function calling represents the core capability of agentic large language models (LLMs). Existing research has focused on enhancing LLMs function-calling accuracy through fine-tuning, reinforcement learning (RL), and multi-agent frameworks, particularly for native function-calling LLMs. This work demonstrates that LLMs achieve superior accuracy in function calling in instruction-following contexts (i.e., standard user-assistant interactions) rather than a tool calling context. We introduce Instruction-Followed Function Calling (IFFC), a novel framework that decouples function-calling logic from the primary LLM and delegates it to a dedicated smaller model operating within the instruction-following paradigm. Our method consistently outperforms both native function calling (NFC) and prompt-based function calling (PFC) baselines, with particularly strong gains on reasoning-oriented LLMs. Furthermore, we demonstrate that IFFC maintains robust performance under aggressive quantization, enabling efficient on-device deployment without significant accuracy degradation. This work establishes a new paradigm for reliable, resource-efficient function calling in edge-computing scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 19 of its 29 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

19 of 29 references.

References · 19

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2025Gemma 3 Technical Reportcited by 1,824
  4. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  5. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  6. 2025Small Language Models are the Future of Agentic AIcited by 270
  7. 2024From Exploration to Mastery: Enabling LLMs to Master Tools via Self-Driven Interactionscited by 46
  8. 2025AgentDistill: Training-Free Agent Distillation with Generalizable MCP Boxescited by 30
  9. 2025Small Language Models for Agentic Systems: A Survey of Architectures, Capabilities, and Deployment Trade offscited by 11
  10. 2025Routine: A Structural Planning Framework for LLM Agent System in Enterprisecited by 9
  11. 2025Small Language Models for Efficient Agentic Tool Calling: Outperforming Large Models with Targeted Fine-tuningcited by 7
  12. 2024Achieving Tool Calling Functionality in LLMs Using Only Prompt Engineering Without Fine-Tuningcited by 6
7 more
  1. 2025Beyond Scale: Small Language Models are Comparable to GPT-4 in Mental Health Understandingcited by 6
  2. 2025Optimizing Small Language Models for In-Vehicle Function-Callingcited by 5
  3. 2025Factored Agents: Decoupling In-Context Learning and Memorization for Robust Tool Usecited by 3
  4. 2025Enhancing Reasoning Capabilities of Small Language Models with Blueprints and Prompt Template Searchcited by 3
  5. 2025Domain-Adaptive Small Language Models for Structured Tax Code Predictioncited by 3
  6. 2025Natural Language Tools: A Natural Language Approach to Tool Calling In Large Language Agentscited by 3
  7. 2025SLM-Based Agentic AI with P-C-G: Optimized for Korean Tool Usecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Think-Augmented Function Calling: Improving LLM Parameter Accuracy Through Embedded Reasoning
  2. 2024TinyAgent: Function Calling at the Edge
  3. 2025On the Robustness of Agentic Function Calling
  4. 2024Granite-Function Calling Model: Introducing Function Calling Abilities via Multi-task Learning of Granular Tasks
  5. 2025Instruction-Following Evaluation in Function Calling for Large Language Models
  6. 2025Improving Large Language Models Function Calling and Interpretability via Guided-Structured Templates
  7. 2024Facilitating Multi-turn Function Calling for LLMs via Compositional Instruction Tuning
  8. 2024Improving Small-Scale Large Language Models Function Calling for Reasoning Tasks