Salesforce Koa: An Enterprise Language Model for Agentic Tool Use
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
We present Salesforce Koa, an enterprise language model built by post-training the open-weight Nemotron-3-Super-120B foundation model with reinforcement learning using Group Relative Policy Optimization (GRPO), and deployed in FP8 for production. Koa is trained only on public and synthetically generated data, and specialized for the agentic tool use that enterprise workflows demand: routing a request to the correct action, invoking the right tool with valid arguments, and completing multi-turn business tasks. The distinctive component of our pipeline is specification-driven task construction: declarative Agent Script specifications are expanded into persona-conditioned multi-turn environments whose rewards are grounded in successful tool use. Applied to enterprise CRM specifications, the same pipeline produces the in-domain training distribution on which Koa is specialized. On CRMAgentBench and the human-labeled production tool-calling set, Koa outperforms both its untuned open-weight base and GPT-4.1 and is competitive with the strongest frontier models. It reaches 87% Task Success Rate on CRMAgentBench (vs. GPT-4.1 at 82% and the base at 79%), is at or near the top of every metric on the human-labeled portion of an internal production benchmark, and preserves the base model's general capability on public benchmarks (Tau2Bench, BFCL). A controlled comparison with architecture and RL recipe held fixed shows that the additional in-domain RL stage improves argument accuracy and full tool-call success on the human-labeled enterprise benchmark.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 14 of its 18 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
14 of 18 references.
References · 14
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2024Qwen2 Technical Reportcited by 2,120
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
- 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 167
- 2024Nemotron-4 340B Technical Reportcited by 144
- 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environmentscited by 71
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating LLMs as Agentic Workflow Executors in Real-World Customer Support Skills
- 2026Beyond Next-Token Prediction: An RLVR Proof of Concept for Tool-Use Agents on Atlassian Workflows
- 2026On Effectiveness and Efficiency of Agentic Tool-calling and RL Training
- 2026KARL: Knowledge Agents via Reinforcement Learning
- 2025Natural Language Tools: A Natural Language Approach to Tool Calling In Large Language Agents
- 2026Workflow-R1: Group Sub-sequence Policy Optimization for Multi-turn Workflow Construction
- 2025MindFlow+: A Self-Evolving Agent for E-Commerce Customer Service
- 2025Close the Loop: Synthesizing Infinite Tool-Use Data via Multi-Agent Role-Playing