RoMath: A Mathematical Reasoning Benchmark in Romanian
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Mathematics has long been conveyed through natural language, primarily for human understanding. With the rise of mechanized mathematics and proof assistants, there is a growing need to understand informal mathematical text, yet most existing benchmarks focus solely on English, overlooking other languages. This paper introduces RoMath, a Romanian mathematical reasoning benchmark suite comprising three subsets: Baccalaureate, Competitions and Synthetic, which cover a range of mathematical domains and difficulty levels, aiming to improve non-English language models and promote multilingual AI development. By focusing on Romanian, a low-resource language with unique linguistic features, RoMath addresses the limitations of Anglo-centric models and emphasizes the need for dedicated resources beyond simple automatic translation. We benchmark several open-weight language models, highlighting the importance of creating resources for underrepresented languages. Code and datasets are be made available.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 54 references that are in the map. First posted on arXiv 17 Sep 2024.
Builds on
28 of 54 references.
Closest ancestors · 7
Same direction, newest first
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challenges31 Jan
- 2023Llemma: An Open Language Model For Mathematics16 Oct
- 2023OpenWebMath: An Open Dataset of High-Quality Mathematical Web Text10 Oct
- 2023ARB: Advanced Reasoning Benchmark for Large Language Models25 Jul
- 2023A Symbolic Framework for Evaluating Mathematical Reasoning and Generalisation with Transformers21 May
- 2022Language Models are Multilingual Chain-of-Thought Reasoners6 Oct
Other references · 21
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Let's Verify Step by Stepcited by 3,598
- 2024Qwen2 Technical Reportcited by 2,076
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2024Mixtral of Expertscited by 1,785
- 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
- 2019Analysing Mathematical Reasoning Abilities of Neural Modelscited by 331
- 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 275
- 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
9 more
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2023CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?cited by 89
- 2020Ape210K: A Large-Scale and Template-Rich Dataset of Math Word Problemscited by 60
- 2021MathBERT: A Pre-Trained Model for Mathematical Formula Understandingcited by 58
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2024MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Datacited by 51
- 2023Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Modelscited by 42
- 2023Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayingscited by 32
- 2022Extracting Mathematical Concepts from Textcited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025AI4Math: A Native Spanish Benchmark for University-Level Mathematical Reasoning in Large Language Models
- 2025MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
- 2025MMATH: A Multilingual Benchmark for Mathematical Reasoning
- 2025PolyMath: Evaluating Mathematical Reasoning in Multilingual Contexts
- 2026MATH-PT: A Math Reasoning Benchmark for European and Brazilian Portuguese
- 2024Mathador-LM: A Dynamic Benchmark for Mathematical Reasoning on Large Language Models
- 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models
- 2026Large Language Models for Math Education in Low-Resource Languages: A Study in Sinhala and Tamil