mlsanityData to 7 Oct 2026

LangBridge: Multilingual Reasoning Without Multilingual Supervision

arXiv 2401.10695 ↗First posted 19 Jan 2024cs.CLcited by 22

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

We introduce LangBridge, a zero-shot approach to adapt language models for multilingual reasoning tasks without multilingual supervision. LangBridge operates by bridging two models, each specialized in different aspects: (1) one specialized in understanding multiple languages (e.g., mT5 encoder) and (2) one specialized in reasoning (e.g., MetaMath). LangBridge connects the two models by introducing minimal trainable parameters between them. Despite utilizing only English data for training, LangBridge considerably enhances the performance of language models on low-resource languages across mathematical reasoning, code completion, logical reasoning, and commonsense reasoning. Our analysis suggests that the efficacy of LangBridge stems from the language-agnostic characteristics of multilingual representations. We publicly release our code and models.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 27 of its 67 references that are in the map. First posted on arXiv 19 Jan 2024.

Builds on

27 of 67 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Code Llama: Open Foundation Models for Code24 Aug
  2. 2023LLaMA: Open and Efficient Foundation Language Models27 Feb

Other references · 25

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  7. 2023Mistral 7Bcited by 3,065
  8. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  9. 2017Decoupled Weight Decay Regularizationcited by 1,722
  10. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  11. 2023StarCoder: may the source be with you!cited by 790
  12. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
13 more
  1. 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 452
  2. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
  3. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
  4. 2021Few-shot Learning with Multilingual Language Modelscited by 278
  5. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 226
  6. 2023Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedbackcited by 189
  7. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
  8. 2023Orca 2: Teaching Small Language Models How to Reasoncited by 157
  9. 2023OpenWebMath: An Open Dataset of High-Quality Mathematical Web Textcited by 151
  10. 2022Linearly Mapping from Image to Text Spacecited by 139
  11. 2023Extrapolating Large Language Models to Non-English by Aligning Languagescited by 69
  12. 2023Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observationscited by 58
  13. 2023Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?cited by 39

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 9; 2026: 5.

22 papers.

Sort:

By area:

  1. 2024The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Modelscited by 89
  2. 2025Crosslingual Reasoning through Test-Time Scalingcited by 46
  3. 2024MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Modelscited by 34
  4. 2024LLMs are Also Effective Embedding Models: An In-depth Overviewcited by 32
  5. 2024MindMerger: Efficient Boosting LLM Reasoning in non-English Languagescited by 21
  6. 2025Language-Specific Latent Process Hinders Cross-Lingual Performancecited by 20
  7. 2024Multilingual Large Language Models: A Systematic Surveycited by 18
  8. 2025SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignmentcited by 17
  9. 2025Improving Multilingual Language Models by Aligning Representations through Steeringcited by 11
  10. 2025Cross-lingual Collapse: How Language-Centric Foundation Models Shape Reasoning in Large Language Modelscited by 11
  11. 2025When Life Gives You Samples: The Benefits of Scaling up Inference Compute for Multilingual LLMscited by 9
  12. 2024The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insightscited by 7
10 more
  1. 2024Thanos: Enhancing Conversational Agents with Skill-of-Mind-Infused Large Language Modelcited by 2
  2. 2025LUSIFER: Language Universal Space Integration for Enhanced Multilingual Embeddings with Large Language Modelscited by 1
  3. 2024Teaching LLMs at Charles University: Assignments and Activitiescited by 0
  4. 2025Utilizing Multilingual Encoders to Improve Large Language Models for Low-Resource Languagescited by 0
  5. 2025Languages are Modalities: Cross-Lingual Alignment via Encoder Injectioncited by 0
  6. 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modescited by 0
  7. 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoningcited by 0
  8. 2026Bridging the English-Arabic Medical Knowledge Gap: Targeted Low-Rank Adaptation via Causal Layer Selectioncited by 0
  9. 2026Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoningcited by 0
  10. 2026Cross-Lingual Alignment for Decoder-Only Models using MoE Routerscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking the Multilingual Reasoning Gap with Layer Swap
  2. 2025A Survey of Multilingual Reasoning in Language Models
  3. 2026Is continuous CoT better suited for multi-lingual reasoning?
  4. 2022Language Models are Multilingual Chain-of-Thought Reasoners
  5. 2025Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering
  6. 2024Eliciting Better Multilingual Structured Reasoning from LLMs through Code
  7. 2025When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners
  8. 2024LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Reasoning