No One Fits All: From Fixed Prompting to Learned Routing in Multilingual LLMs
Not on the map. Why?
Abstract (arXiv)
Translation-based prompting is widely used in multilingual LLMs, yet its effectiveness varies across languages and tasks. We evaluate prompting strategies across ten languages of different resource levels and four benchmarks. Our analysis shows that no single strategy is universally optimal. Translation strongly benefits low-resource languages even when translation quality is imperfect, high-resource languages gain little, and prompt-based self-routing underperforms explicit translation. Motivated by these findings, we formulate prompting strategy selection as a learned decision problem and introduce lightweight classifiers that predict whether native or translation-based prompting is optimal for each instance. The classifiers achieve statistically significant improvements over fixed strategies across four benchmarks and generalize to unseen task formats not observed during training. Further analysis reveals that language resource level, rather than translation quality alone, determines when translation is beneficial.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 21 of its 33 references that are in the map. First posted on arXiv 18 Apr 2026.
Builds on
21 of 33 references.
References · 21
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,143
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,472
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,200
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 720
- 2020Language-agnostic BERT Sentence Embeddingcited by 622
- 2019On the Cross-lingual Transferability of Monolingual Representationscited by 577
- 2017Six Challenges for Neural Machine Translationcited by 335
- 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 332
- 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 182
- 2024Multilingual Instruction Tuning With Just a Pinch of Multilingualitycited by 71
- 2024Question Translation Training for Better Multilingual Reasoningcited by 42
- 2024Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languagescited by 38
9 more
- 2024mCoT: Multilingual Instruction Tuning for Reasoning Consistency in Language Modelscited by 32
- 2024Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Modelscited by 31
- 2025Beyond English: The Impact of Prompt Translation Strategies across Languages and Tasks in Multilingual LLMscited by 22
- 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitationcited by 19
- 2024Breaking the Language Barrier: Can Direct Inference Outperform Pre-Translation in Multilingual LLM Applications?cited by 12
- 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translationcited by 12
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
- 2024Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languagescited by 5
- 2025Aligning Large Language Models to Low-Resource Languages through LLM-Based Selective Translation: A Systematic Studycited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Discovering Translation-Worthy Languages with E-Valuescited by 0
- 2026Discovering Translation-Worthy Languages with E-Values6 Sep 2026