DOoM: Difficult Olympiads of Math
Not on the map. Why?
Abstract (arXiv)
This paper introduces DOoM, a new open-source benchmark designed to assess the capabilities of language models in solving mathematics and physics problems in Russian. The benchmark includes problems of varying difficulty, ranging from school-level tasks to university Olympiad and entrance exam questions. In this paper we discuss the motivation behind its creation, describe dataset's structure and evaluation methodology, and present initial results from testing various models. Analysis of the results shows a correlation between model performance and the number of tokens used, and highlights differences in performance between mathematics and physics tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
10 of 17 references.
References · 10
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 59
- 2020RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmarkcited by 53
- 2025PhyX: Does Your Model Have the "Wits" for Physical Reasoning?cited by 38
- 2025Physics: Benchmarking Foundation Models on University-Level Physics Problem Solvingcited by 31
- 2024U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in LLMscited by 24
- 2025CHECK-MAT: Checking Hand-Written Mathematical Answers for the Russian Unified State Examcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.