mlsanityData to 14 Oct 2026

MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval

arXiv 2604.18584 ↗First posted 20 Apr 2026cs.AI cs.DL cs.IRcited by 6

On the map: LLM reasoning → Mathematical reasoning

also in 1 more
Abstract (arXiv)

Mathematical problem solving remains a challenging test of reasoning for large language and multimodal models, yet existing benchmarks are limited in size, language coverage, and task diversity. We introduce MathNet, a high-quality, large-scale, multimodal, and multilingual dataset of Olympiad-level math problems together with a benchmark for evaluating mathematical reasoning in generative models and mathematical retrieval in embedding-based systems. MathNet spans 47 countries, 17 languages, and two decades of competitions, comprising 30,676 expert-authored problems with solutions across diverse domains. In addition to the core dataset, we construct a retrieval benchmark consisting of mathematically equivalent and structurally similar problem pairs curated by human experts. MathNet supports three tasks: (i) Problem Solving, (ii) Math-Aware Retrieval, and (iii) Retrieval-Augmented Problem Solving. Experimental results show that even state-of-the-art reasoning models (78.4% for Gemini-3.1-Pro and 69.3% for GPT-5) remain challenged, while embedding models struggle to retrieve equivalent problems. We further show that retrieval-augmented generation performance is highly sensitive to retrieval quality; for example, DeepSeek-V3.2-Speciale achieves gains of up to 12%, obtaining the highest scores on the benchmark. MathNet provides the largest high-quality Olympiad dataset together with the first benchmark for evaluating mathematical problem retrieval, and we publicly release both the dataset and benchmark at https://mathnet.mit.edu.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 51 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

30 of 51 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoning27 Nov
  2. 2025Towards Robust Mathematical Reasoning3 Nov
  3. 2025Solving Inequality Proofs with Large Language Models9 Jun
  4. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitions29 May
  5. 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models27 Mar
  6. 2025Leveraging Online Olympiad-Level Math Problems for LLMs Training and Contamination-Resistant Evaluation24 Jan
  7. 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models10 Oct
  8. 2024OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI18 Jun
  9. 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models24 May

Other references · 21

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  6. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  7. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  8. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  9. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  10. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  11. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  12. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
9 more
  1. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  2. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
  3. 2021SPLADE v2: Sparse Lexical and Expansion Model for Information Retrievalcited by 127
  4. 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelscited by 109
  5. 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 47
  6. 2025RaDeR: Reasoning-aware Dense Retrieval Modelscited by 27
  7. 2025UQ: Assessing Language Models on Unsolved Questionscited by 9
  8. 2025G"odel Test: Can Large Language Models Solve Easy Conjectures?cited by 5
  9. 2024Mathematical Information Retrieval: Search and Question Answeringcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
  2. 2025MathRobust-LV: Evaluation of Large Language Models' Robustness to Linguistic Variations in Mathematical Reasoning
  3. 2026M3Kang: Evaluating Multilingual Multimodal Mathematical Reasoning in Vision-Language Models
  4. 2024Benchmarking Large Language Models for Math Reasoning Tasks
  5. 2024MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoning
  6. 2024Can Language Models Rival Mathematics Students? Evaluating Mathematical Reasoning through Textual Manipulation and Human Experiments
  7. 2024MathScape: Benchmarking Multimodal Large Language Models in Real-World Mathematical Contexts
  8. 2024MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data