Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphs
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Large reasoning models (LRMs) achieve strong mathematical reasoning performance in English, but remain much less reliable in many low- and medium-resource languages. This gap is often explained as a failure to understand non-English problem statements. We show that this view is incomplete: even when the problem is given in English, controlling the model's reasoning language can substantially reduce accuracy, suggesting that language also affects reasoning execution itself. To study this effect, we introduce DATG, a Directed Acyclic Trace Graph framework that maps reasoning traces to language-independent mathematical anchors and dependencies. This allows us to align target-language traces with reference DAGs and measure whether they cover required mathematical nodes, respect dependency edges, and avoid harmful mathematical actions. Experiments on the Qwen3 series across 12 languages show that non-English reasoning often suffers from reduced anchor coverage and weaker dependency fidelity, especially in low-resource languages. Motivated by this diagnosis, we propose Loop-Retry and Formula-Retry, two simple test-time controls targeting DATG-exposed failure modes, and show that they consistently improve target-language reasoning performance in low-resource languages.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 42 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
13 of 42 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 129
- 2025Crosslingual Reasoning through Test-Time Scalingcited by 46
- 2025Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?cited by 20
- 2025Long Chain-of-Thought Reasoning Across Languagescited by 19
- 2025Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learningcited by 18
- 2025ReasoningFlow: Semantic Structure of Complex Reasoning Tracescited by 12
- 2025Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?cited by 12
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoningcited by 10
- 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasonerscited by 9
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Featurescited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap
- 2025EfficientXLang: Towards Improving Token Efficiency Through Cross-Lingual Reasoning
- 2025Catch Me If You Can: How Smaller Reasoning Models Pretend to Reason with Mathematical Fidelity
- 2025MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
- 2025Large Language Models and Mathematical Reasoning Failures
- 2025DAG-Math: Graph-of-Thought Guided Mathematical Reasoning in LLMs
- 2022Language Models are Multilingual Chain-of-Thought Reasoners
- 2026The Missing Primitive: Diagnosing and Repairing Mathematical Reasoning in Large Language Models