mlsanityData to 7 Oct 2026

RoMathExam: A Longitudinal Dataset of Romanian Math Exams (1895-2025) with a Seven-Decade Core (1957-2025)

arXiv 2604.16392 ↗First posted 28 Mar 2026cs.CY cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

AI in Education research increasingly relies on authentic, curriculum-grounded assessment data, yet large, well-structured exam corpora remain scarce for many languages and educational systems. We introduce RoMathExam, a longitudinal dataset of Romanian high-school mathematics exams spanning 1895-2025, with a robust standardized core for 1957-2025. The dataset contains 10,592 mathematics problems organized into 600+ complete exam sets across multiple tracks (M1-M4), covering both official national examination sessions and ministry-published training variants. Beyond high-fidelity digitization and a unified JSON schema with traceable provenance, RoMathExam is enriched with curriculum-aligned topic tags and dense text embeddings, enabling variant detection, deduplication, and similarity-based retrieval. To overcome the lack of historical psychometric data, we propose and validate a solution complexity metric as a scalable intrinsic proxy for difficulty. Our evaluation across three frontier reasoning models (GPT-5-mini, DeepSeek-R1, and Qwen3-235B-Thinking) reveals high cross-model synchronization (r > 0.72), confirming the metric's ability to isolate intrinsic mathematical depth from stochastic generation noise. We demonstrate the dataset's utility through a longitudinal analysis that quantifies a "regime shift" from volatile historical formats to a standardized, algebra-dominant modern curriculum. RoMathExam provides a foundation for reproducible research in difficulty modeling, curriculum analytics, and LLM evaluation in low-resource linguistic contexts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 28 Mar 2026.

Builds on

15 of 32 references.

References · 15

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  3. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  4. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
  5. 2024A Careful Examination of Large Language Model Performance on Grade School Arithmeticcited by 188
  6. 2023Evaluating the Performance of Large Language Models on GAOKAO Benchmarkcited by 182
  7. 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
  8. 2020We Need to Talk About Random Splitscited by 70
  9. 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
  10. 2025A Survey on Data Contamination for Large Language Modelscited by 33
  11. 2024Automated Generation and Tagging of Knowledge Components from Multiple-Choice Questionscited by 13
  12. 2025Text-Based Approaches to Item Difficulty Modeling in Large-Scale Assessments: A Systematic Reviewcited by 10
3 more
  1. 2024Foundation Models for Low-Resource Language Education (Vision Paper)cited by 5
  2. 2025KCluster: An LLM-based Clustering Approach to Knowledge Component Discoverycited by 5
  3. 2025AlgoSimBench: Identifying Algorithmically Similar Problems for Competitive Programmingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024RoMath: A Mathematical Reasoning Benchmark in Romanian
  2. 2025MathRobust-LV: Evaluation of Large Language Models' Robustness to Linguistic Variations in Mathematical Reasoning
  3. 2025SCP-116K: A High-Quality Problem-Solution Dataset and a Generalized Pipeline for Automated Extraction in the Higher Education Science Domain
  4. 2026MATH-PT: A Math Reasoning Benchmark for European and Brazilian Portuguese
  5. 2024MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data
  6. 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval
  7. 2024MathScale: Scaling Instruction Tuning for Mathematical Reasoning
  8. 2025Evaluation of LLMs for mathematical problem solving