Closing the Gap: Data-Centric Fine-Tuning of Vision Language Models for the Standardized Exam Questions
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal reasoning has become a cornerstone of modern AI research. Standardized exam questions offer a uniquely rigorous testbed for such reasoning, providing structured visual contexts and verifiable answers. While recent progress has largely focused on algorithmic advances such as reinforcement learning (e.g., GRPO, DPO), the data centric foundations of vision language reasoning remain less explored. We show that supervised fine-tuning (SFT) with high-quality data can rival proprietary approaches. To this end, we compile a 161.4 million token multimodal dataset combining textbook question-solution pairs, curriculum aligned diagrams, and contextual materials, and fine-tune Qwen-2.5VL-32B using an optimized reasoning syntax (QMSA). The resulting model achieves 78.6% accuracy, only 1.0% below Gemini 2.0 Flash, on our newly released benchmark YKSUniform, which standardizes 1,854 multimodal exam questions across 309 curriculum topics. Our results reveal that data composition and representational syntax play a decisive role in multimodal reasoning. This work establishes a data centric framework for advancing open weight vision language models, demonstrating that carefully curated and curriculum-grounded multimodal data can elevate supervised fine-tuning to near state-of-the-art performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 41 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
26 of 41 references.
Closest ancestors · 5
Same direction, newest first
- 2025HoneyBee: Data Recipes for Vision-Language Reasoners14 Oct
- 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning23 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 21
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2024Qwen2 Technical Reportcited by 2,120
- 2025s1: Simple test-time scalingcited by 1,341
- 2024OpenAI o1 System Cardcited by 1,244
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
9 more
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2024Phi-4 Technical Reportcited by 711
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2025Seed1.5-VL Technical Reportcited by 373
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
- 2024Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Modelscited by 20
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Long Grounded Thoughts: Synthesizing Visual Problems and Reasoning Chains at Scale
- 2026Balanced Thinking: Improving Chain of Thought Training in Vision Language Models
- 2024EXAMS-V: A Multi-Discipline Multilingual Multimodal Exam Benchmark for Evaluating Vision Language Models
- 2024Question Aware Vision Transformer for Multimodal Reasoning
- 2025All-in-one: Understanding and Generation in Multimodal Reasoning with the MAIA Benchmark
- 2025VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search
- 2025MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models
- 2025Instruction-tuned Self-Questioning Framework for Multimodal Reasoning