MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Open multimodal reasoning models have benefited from large-scale reasoning supervision, yet reliable post-training remains challenging due to uneven data quality, inefficient supervision construction, imbalanced difficulty, and cross-domain interference. We introduce MMVistaReason (MVR), an open-data post-training recipe with three components: (1) broader capability coverage across complementary Analytical and Real-World reasoning groups, emphasizing structured reasoning versus visual perception and spatial grounding; (2) efficient SFT and RL data construction, standardizing heterogeneous open data through staged cleaning and annotation, combining difficulty-aware cascaded teacher distillation with answer-likelihood-based trajectory selection to construct MVR-SFT-528K, and applying scale-specific frontier filtering for MVR-RL-63K; and (3) specialize-then-integrate training, which trains complementary RL experts and consolidates their capabilities through multi-teacher on-policy distillation (MOPD). Our analyses reveal a capacity-dependent interaction between supervision difficulty, trajectory quality, and model capacity: smaller students benefit more from selected supervision, while larger students are robust to trajectory variation and mixed-domain interference. Mixed-domain RL introduces benchmark-level negative transfer, whereas MOPD provides consistent capability integration, with the preferred KL direction varying across model scales. Across 15 multimodal benchmarks, MVR-4B achieves an average score of 72.8, outperforming Qwen3.5-9B (Instruct) and MMFineReason-8B while using about 70% fewer samples than MMFineReason. Scaling to 9B improves the average to 74.4, surpassing Qwen3.5-35B-A3B (Instruct). Overall, MMVistaReason demonstrates that systematic open-data construction and capacity-aware post-training provide a practical and scalable path toward reliable multimodal reasoning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 71 of its 79 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
71 of 79 references.
Closest ancestors · 29
Same direction, newest first
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr
- 2026Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning7 Apr
- 2026Vero: An Open RL Recipe for General Visual Reasoning6 Apr
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoning18 Feb
- 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods29 Jan
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov
- 2025VOLD: Reasoning Transfer from LLMs to Vision-Language Models via On-Policy Distillation27 Oct
- 2025HoneyBee: Data Recipes for Vision-Language Reasoners14 Oct
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoning14 Aug
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
17 more
- 2025BMMR: A Large-Scale Bilingual Multimodal Multi-Discipline Reasoning Dataset4 Jul
- 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoning12 Jun
- 2025VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL29 May
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start28 May
- 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale6 Dec
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
- 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models25 Jun
- 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns20 Mar
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 42
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023Visual Instruction Tuningcited by 7,792
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2025Group Sequence Policy Optimizationcited by 788
- 2016Sequence-Level Knowledge Distillationcited by 761
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
30 more
- 2025LIMO: Less is More for Reasoningcited by 488
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 276
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
- 2023Teaching CLIP to Count to Tencited by 194
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
- 2026Scaling Reasoning Efficiently via Relaxed On-Policy Distillationcited by 71
- 2026MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Trainingcited by 60
- 2026Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillationcited by 53
- 2025FineVision: Open Data Is All You Needcited by 51
- 2026Fast and Effective On-policy Distillation from Reasoning Prefixescited by 43
- 2025CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Rewardcited by 39
- 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 38
- 2026Visual-Advantage On-Policy Distillation for Vision-Language Modelscited by 22
- 2025OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Valuecited by 15
- 2026LongRLVR: Long-Context Reinforcement Learning Requires Verifiable Context Rewardscited by 13
- 2026Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillationcited by 12
- 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Taskscited by 11
- 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RLcited by 8
- 2025AdaSTaR: Adaptive Data Sampling for Training Self-Taught Reasonerscited by 6
- 2025Making, not Taking, the Best of Ncited by 4
- 2026OmniScience: A Large-scale Multi-modal Dataset for Scientific Image Understandingcited by 4
- 2026Mach-Mind-4-Flash Technical Reportcited by 4
- 2026KAT-Coder-V2.5 Technical Reportcited by 3
- 2025Understanding Task Transfer in Vision-Language Modelscited by 2
- 2026OPOD: On-Policy Omni Distillationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Models
- 2025MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models
- 2025MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervision
- 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking
- 2026Learn to Think: Improving Multimodal Reasoning through Vision-Aware Self-Improvement Training
- 2026H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillation
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
- 2026Data-Efficient Curation for Multimodal Reasoning under Fixed Training Protocols