MMTutorBench: The First Multimodal Benchmark for AI Math Tutoring
Not on the map. Why?
Abstract (arXiv)
Effective math tutoring requires not only solving problems but also diagnosing students' difficulties and guiding them step by step. While multimodal large language models (MLLMs) show promise, existing benchmarks largely overlook these tutoring skills. We introduce MMTutorBench, the first benchmark for AI math tutoring, consisting of 685 problems built around pedagogically significant key-steps. Each problem is paired with problem-specific rubrics that enable fine-grained evaluation across six dimensions, and structured into three tasks-Insight Discovery, Operation Formulation, and Operation Execution. We evaluate 12 leading MLLMs and find clear performance gaps between proprietary and open-source systems, substantial room compared to human tutors, and consistent trends across input variants: OCR pipelines degrade tutoring quality, few-shot prompting yields limited gains, and our rubric-based LLM-as-a-Judge proves highly reliable. These results highlight both the difficulty and diagnostic value of MMTutorBench for advancing AI tutoring.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 10 of its 28 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
10 of 28 references.
References · 10
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
- 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 117
- 2025MathTutorBench: A Benchmark for Measuring Open-ended Pedagogical Capabilities of LLM Tutorscited by 47
- 2025Beyond Final Answers: Evaluating Large Language Models for Math Tutoringcited by 23
- 2025Leveraging LLMs to Assess Tutor Moves in Real-Life Dialogues: A Feasibility Studycited by 3
- 2025Exploring LLMs for Predicting Tutor Strategy and Student Outcomes in Dialoguescited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data
- 2024Benchmarking Large Language Models for Math Reasoning Tasks
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval
- 2024MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification
- 2024MathScape: Benchmarking Multimodal Large Language Models in Real-World Mathematical Contexts
- 2026LessonBench-V1: A Benchmark Dataset for Evaluating AI Lesson Generation Agents
- 2024MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn Interactions
- 2024OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data