Is your multimodal large language model a good science tutor?
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Multimodal large language models (MLLMs) demonstrate impressive performance on scientific reasoning tasks (e.g., ScienceQA). However, most existing benchmarks focus narrowly on the accuracy of the final answer while ignoring other metrics. In particular, when applying MLLMs to educational contexts, the goal is not only correctness but also the ability to teach. In this paper, we propose a framework that evaluates MLLMs as science tutors using a comprehensive educational rubric and a simulated student model that judges the teaching performance of the tutors. Given a list of candidate MLLM science tutors, we use rubric-based student judgments to produce a range of tutor performance scores, identifying both strong and weak tutors. Using the training section of the ScienceQA dataset, we then construct a data set of pairwise comparisons between the outputs of strong and weak tutors. This enables us to apply multiple preference optimization methods to fine-tune an underperforming tutor model (Qwen2-VL-2B) into more effective ones. Our results also show that strong problem-solving skills do not guarantee high-quality tutoring and that performance optimization-guided refinements can yield more educationally aligned tutor models. This approach opens avenues for building MLLMs that serve not only as problem solvers, but as genuinely helpful educational assistants.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 44 references that are in the map. First posted on arXiv 9 May 2025.
Builds on
26 of 44 references.
Closest ancestors · 2
Same direction, newest first
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
Other references · 24
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
12 more
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 264
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
- 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 131
- 2024Direct Preference Optimization with an Offsetcited by 122
- 2024IsoBench: Benchmarking Multimodal Foundation Models on Isomorphic Representationscited by 38
- 2024MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Educationcited by 37
- 2024Language Models as Science Tutorscited by 17
- 2024Social Skill Training with Large Language Modelscited by 15
- 2023Curriculum-Driven Edubot: A Framework for Developing Language Learning Chatbots Through Synthesizing Conversational Datacited by 9
- 2025On Fairness of Unified Multimodal Large Language Model for Image Generationcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models
- 2024VisScience: An Extensive Benchmark for Evaluating K12 Educational Multi-modal Scientific Reasoning
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
- 2026SciMIF: Understanding Multimodal Instruction Following in Scientific Domains
- 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning
- 2026Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confident
- 2025Scientific Reasoning: Assessment of Multimodal Generative LLMs
- 2025MDK12-Bench: A Comprehensive Evaluation of Multimodal Large Language Models on Multidisciplinary Exams