mlsanityData to 14 Oct 2026

When the API Speaks the Wrong Language: Revisiting Post-Training for Multilingual Tool Use

arXiv 2608.11715 ↗First posted 12 Aug 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The reliability of Large Language Models (LLMs) for API calling degrades in multilingual settings. A common failure occurs when a model selects the correct tool but generates argument values in an inconsistent language, which we term Argument Language Mismatch (ALM). Although semantically correct, such outputs are operationally invalid and not captured by standard API-calling metrics. We revisit post-training strategies for mitigating ALM and find that, in our benchmark, supervised fine-tuning (SFT) provides a strong baseline, substantially improving argument language consistency and end-to-end function call accuracy. Under consistent model selection, SFT achieves performance comparable to, and sometimes exceeding more complex reinforcement learning (RL) approaches. We further examine whether RL with structured, argument-aware rewards offers additional benefits. While methods such as Group Relative Policy Optimization (GRPO) can improve language consistency and better preserve general reasoning ability, these gains are incremental and most pronounced in generalization and multi-objective trade-offs. Overall, our results suggest that much of the performance in multilingual API grounding can be achieved through careful supervised training, with RL providing targeted rather than fundamental improvements.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 20 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

15 of 20 references.

References · 15

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  7. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  8. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
  9. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  10. 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
  11. 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 204
  12. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
3 more
  1. 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 151
  2. 2021BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modelingcited by 56
  3. 2023Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systemscited by 16

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Lost in Execution: On the Multilingual Robustness of Tool Calling in Large Language Models
  2. 2026TLPO: Token-Level Policy Optimization for Mitigating Language Confusion in Large Language Models
  3. 2026Supervised Fine-Tuning versus Reinforcement Learning: A Study of Post-Training Methods for Large Language Models
  4. 2026LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
  5. 2026Scaling Multilingual Safety and Reasoning Evaluation through Reasoning-Guided Translation
  6. 2025A Sober Look at Progress in Language Model Reasoning: Pitfalls and Paths to Reproducibility
  7. 2025Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments
  8. 2024TL-Training: A Task-Feature-Based Framework for Training Large Language Models in Tool Use