mlsanityData to 14 Oct 2026

Salesforce Koa: An Enterprise Language Model for Agentic Tool Use

arXiv 2609.15066 ↗First posted 14 Sep 2026cs.CL cs.AI cs.LGcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

We present Salesforce Koa, an enterprise language model built by post-training the open-weight Nemotron-3-Super-120B foundation model with reinforcement learning using Group Relative Policy Optimization (GRPO), and deployed in FP8 for production. Koa is trained only on public and synthetically generated data, and specialized for the agentic tool use that enterprise workflows demand: routing a request to the correct action, invoking the right tool with valid arguments, and completing multi-turn business tasks. The distinctive component of our pipeline is specification-driven task construction: declarative Agent Script specifications are expanded into persona-conditioned multi-turn environments whose rewards are grounded in successful tool use. Applied to enterprise CRM specifications, the same pipeline produces the in-domain training distribution on which Koa is specialized. On CRMAgentBench and the human-labeled production tool-calling set, Koa outperforms both its untuned open-weight base and GPT-4.1 and is competitive with the strongest frontier models. It reaches 87% Task Success Rate on CRMAgentBench (vs. GPT-4.1 at 82% and the base at 79%), is at or near the top of every metric on the human-labeled portion of an internal production benchmark, and preserves the base model's general capability on public benchmarks (Tau2Bench, BFCL). A controlled comparison with architecture and RL recipe held fixed shows that the additional in-domain RL stage improves argument accuracy and full tool-call success on the human-labeled enterprise benchmark.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 14 of its 18 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

14 of 18 references.

References · 14

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2024Qwen2 Technical Reportcited by 2,120
  5. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  6. 2025Gemma 3 Technical Reportcited by 1,824
  7. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  8. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  9. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
  10. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 167
  11. 2024Nemotron-4 340B Technical Reportcited by 144
  12. 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environmentscited by 71
2 more
  1. 2026PivotRL: High Accuracy Agentic Post-Training at Low Compute Costcited by 14
  2. 2026On the Non-decoupling of Supervised Fine-tuning and Reinforcement Learning in Post-trainingcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating LLMs as Agentic Workflow Executors in Real-World Customer Support Skills
  2. 2026Beyond Next-Token Prediction: An RLVR Proof of Concept for Tool-Use Agents on Atlassian Workflows
  3. 2026On Effectiveness and Efficiency of Agentic Tool-calling and RL Training
  4. 2026KARL: Knowledge Agents via Reinforcement Learning
  5. 2025Natural Language Tools: A Natural Language Approach to Tool Calling In Large Language Agents
  6. 2026Workflow-R1: Group Sub-sequence Policy Optimization for Multi-turn Workflow Construction
  7. 2025MindFlow+: A Self-Evolving Agent for E-Commerce Customer Service
  8. 2025Close the Loop: Synthesizing Infinite Tool-Use Data via Multi-Agent Role-Playing