mlsanityData to 7 Oct 2026

Multilingual Reasoning Cascades Need More Context

arXiv 2606.27306 ↗First posted 25 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Translation cascades for reasoning translate the query from another language to English, reason in English, and translate the answer back to the original language. This is a competitive approach to multilingual reasoning, but structurally lossy, since each stage discards information later stages may need, including cues for cultural grounding, register, and disambiguation. We examine the benefits of a simple and training-free intervention: a context-aware translation cascade, which additionally provides the original question, the English translated question, and the reasoning trace to the context of the final translation module. We evaluate gains across nine multilingual benchmarks including various task types, three backbone models, and 285 high-, mid-, and low-resource languages, and demonstrate strong gains for open-ended generation across models and resource regimes. We show that the original language question carries most of the beneficial context. Our study emphasizes the need to better design information flow in machine translation cascades for mitigating error propagation, and provides a simple and actionable default strategy: preserve the original user question until the end of the pipeline.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

13 of 27 references.

References · 13

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 486
  3. 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 181
  4. 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 171
  5. 2020MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answeringcited by 151
  6. 2019NCLS: Neural Cross-Lingual Summarizationcited by 64
  7. 2021Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?cited by 54
  8. 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
  9. 2024Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Modelscited by 31
  10. 2025How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmarkcited by 26
  11. 2021A Survey on Low-Resource Neural Machine Translationcited by 16
  12. 2025MMATH: A Multilingual Benchmark for Mathematical Reasoningcited by 16
1 more
  1. 2025The Translation Barrier Hypothesis: Multilingual Generation with Large Language Models Suffers from Implicit Translation Failurecited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insights
  2. 2026Learning When to Translate for Multilingual Reasoning
  3. 2025Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?
  4. 2024Question Translation Training for Better Multilingual Reasoning
  5. 2025New Trends for Modern Machine Translation with Large Reasoning Models
  6. 2026Rethinking the Multilingual Reasoning Gap with Layer Swap
  7. 2025Chain-of-Thought Reasoning Improves Context-Aware Translation with Large Language Models
  8. 2024Eliciting Better Multilingual Structured Reasoning from LLMs through Code