RoMathExam: A Longitudinal Dataset of Romanian Math Exams (1895-2025) with a Seven-Decade Core (1957-2025)
Not on the map. Why?
Abstract (arXiv)
AI in Education research increasingly relies on authentic, curriculum-grounded assessment data, yet large, well-structured exam corpora remain scarce for many languages and educational systems. We introduce RoMathExam, a longitudinal dataset of Romanian high-school mathematics exams spanning 1895-2025, with a robust standardized core for 1957-2025. The dataset contains 10,592 mathematics problems organized into 600+ complete exam sets across multiple tracks (M1-M4), covering both official national examination sessions and ministry-published training variants. Beyond high-fidelity digitization and a unified JSON schema with traceable provenance, RoMathExam is enriched with curriculum-aligned topic tags and dense text embeddings, enabling variant detection, deduplication, and similarity-based retrieval. To overcome the lack of historical psychometric data, we propose and validate a solution complexity metric as a scalable intrinsic proxy for difficulty. Our evaluation across three frontier reasoning models (GPT-5-mini, DeepSeek-R1, and Qwen3-235B-Thinking) reveals high cross-model synchronization (r > 0.72), confirming the metric's ability to isolate intrinsic mathematical depth from stochastic generation noise. We demonstrate the dataset's utility through a longitudinal analysis that quantifies a "regime shift" from volatile historical formats to a standardized, algebra-dominant modern curriculum. RoMathExam provides a foundation for reproducible research in difficulty modeling, curriculum analytics, and LLM evaluation in low-resource linguistic contexts.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 28 Mar 2026.
Builds on
15 of 32 references.
References · 15
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
- 2024A Careful Examination of Large Language Model Performance on Grade School Arithmeticcited by 188
- 2023Evaluating the Performance of Large Language Models on GAOKAO Benchmarkcited by 182
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
- 2020We Need to Talk About Random Splitscited by 70
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
- 2025A Survey on Data Contamination for Large Language Modelscited by 33
- 2024Automated Generation and Tagging of Knowledge Components from Multiple-Choice Questionscited by 13
- 2025Text-Based Approaches to Item Difficulty Modeling in Large-Scale Assessments: A Systematic Reviewcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024RoMath: A Mathematical Reasoning Benchmark in Romanian
- 2025MathRobust-LV: Evaluation of Large Language Models' Robustness to Linguistic Variations in Mathematical Reasoning
- 2025SCP-116K: A High-Quality Problem-Solution Dataset and a Generalized Pipeline for Automated Extraction in the Higher Education Science Domain
- 2026MATH-PT: A Math Reasoning Benchmark for European and Brazilian Portuguese
- 2024MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval
- 2024MathScale: Scaling Instruction Tuning for Mathematical Reasoning
- 2025Evaluation of LLMs for mathematical problem solving