mlsanityData to 7 Oct 2026

Tool-Augmented Hybrid Ensemble Reasoning with Distillation for Bilingual Mathematical Problem Solving

arXiv 2512.19093 ↗First posted 22 Dec 2025cs.AIcited by 0

On the map: LLM reasoning → Mathematical reasoning

also in 1 more
Abstract (arXiv)

Bilingual mathematical problem solving needs a clear link between language reasoning and symbolic calculation. Large language models often handle language well but are weak in accurate computation. This paper presents HERALD (Hybrid Ensemble Reasoning with Adaptive Learning and Distillation), a framework that joins reasoning and calculation using NuminaMath-7B-TIR, GPT-4o, and Mistral-7B. HERALD uses adaptive routing, tool-based reinforcement learning, and knowledge distillation to connect different reasoning paths. Confidence calibration keeps weighting stable, and dual-path checking keeps results correct. Reinforcement learning controls tool use to cut redundancy, and distillation lowers delay without hurting accuracy. The system shows that combining symbolic checking, adaptive ensembles, and bilingual fine-tuning helps achieve both fluent reasoning and precise calculation. HERALD offers a practical solution for multilingual mathematical reasoning with better accuracy, stability, and clarity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 18 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

5 of 18 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Multilingual Mathematical Reasoning: Advancing Open-Source LLMs in Hindi and English24 Dec
  2. 2023Evaluating and Improving Tool-Augmented Computation-Intensive Math Reasoning4 Jun

Other references · 3

  1. 2025Advancing Tool-Augmented Large Language Models via Meta-Verification and Reflection Learningcited by 22
  2. 2025Reasoning Beyond Limits: Advances and Open Problems for LLMscited by 16
  3. 2024Improving Math Problem Solving in Large Language Models Through Categorization and Strategy Tailoringcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning to Use Tools: Reinforcement Learning for Tool-Integrated Mathematical Reasoning
  2. 2026IRIS: Interleaved Reinforcement with Incremental Staged Curriculum for Cross-Lingual Mathematical Reasoning
  3. 2026LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
  4. 2026On-Policy Delta Distillation for Multilingual Math Reasoning
  5. 2025Let's Reason Formally: Natural-Formal Hybrid Reasoning Enhances LLM's Math Capability
  6. 2025A Survey on Mathematical Reasoning and Optimization with Large Language Models
  7. 2026TAPO: Translation Augmented Policy Optimization for Multilingual Mathematical Reasoning
  8. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap