mlsanityData to 7 Oct 2026

MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning

arXiv 2610.01352 ↗First posted 1 Oct 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Open multimodal reasoning models have benefited from large-scale reasoning supervision, yet reliable post-training remains challenging due to uneven data quality, inefficient supervision construction, imbalanced difficulty, and cross-domain interference. We introduce MMVistaReason (MVR), an open-data post-training recipe with three components: (1) broader capability coverage across complementary Analytical and Real-World reasoning groups, emphasizing structured reasoning versus visual perception and spatial grounding; (2) efficient SFT and RL data construction, standardizing heterogeneous open data through staged cleaning and annotation, combining difficulty-aware cascaded teacher distillation with answer-likelihood-based trajectory selection to construct MVR-SFT-528K, and applying scale-specific frontier filtering for MVR-RL-63K; and (3) specialize-then-integrate training, which trains complementary RL experts and consolidates their capabilities through multi-teacher on-policy distillation (MOPD). Our analyses reveal a capacity-dependent interaction between supervision difficulty, trajectory quality, and model capacity: smaller students benefit more from selected supervision, while larger students are robust to trajectory variation and mixed-domain interference. Mixed-domain RL introduces benchmark-level negative transfer, whereas MOPD provides consistent capability integration, with the preferred KL direction varying across model scales. Across 15 multimodal benchmarks, MVR-4B achieves an average score of 72.8, outperforming Qwen3.5-9B (Instruct) and MMFineReason-8B while using about 70% fewer samples than MMFineReason. Scaling to 9B improves the average to 74.4, surpassing Qwen3.5-35B-A3B (Instruct). Overall, MMVistaReason demonstrates that systematic open-data construction and capacity-aware post-training provide a practical and scalable path toward reliable multimodal reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 71 of its 79 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

71 of 79 references.

Closest ancestors · 29

Same direction, newest first

  1. 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr
  2. 2026Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning7 Apr
  3. 2026Vero: An Open RL Recipe for General Visual Reasoning6 Apr
  4. 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoning18 Feb
  5. 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods29 Jan
  6. 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov
  7. 2025VOLD: Reasoning Transfer from LLMs to Vision-Language Models via On-Policy Distillation27 Oct
  8. 2025HoneyBee: Data Recipes for Vision-Language Reasoners14 Oct
  9. 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
  10. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  11. 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoning14 Aug
  12. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
17 more
  1. 2025BMMR: A Large-Scale Bilingual Multimodal Multi-Discipline Reasoning Dataset4 Jul
  2. 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoning12 Jun
  3. 2025VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL29 May
  4. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start28 May
  5. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
  6. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  7. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  8. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  9. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale6 Dec
  10. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  11. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  12. 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models25 Jun
  13. 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns20 Mar
  14. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  15. 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
  16. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
  17. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 42

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  7. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
  8. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  9. 2025Group Sequence Policy Optimizationcited by 788
  10. 2016Sequence-Level Knowledge Distillationcited by 761
  11. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  12. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
30 more
  1. 2025LIMO: Less is More for Reasoningcited by 488
  2. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  3. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
  4. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
  5. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  6. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
  7. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 276
  8. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
  9. 2023Teaching CLIP to Count to Tencited by 194
  10. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
  11. 2026Scaling Reasoning Efficiently via Relaxed On-Policy Distillationcited by 71
  12. 2026MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Trainingcited by 60
  13. 2026Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillationcited by 53
  14. 2025FineVision: Open Data Is All You Needcited by 51
  15. 2026Fast and Effective On-policy Distillation from Reasoning Prefixescited by 43
  16. 2025CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Rewardcited by 39
  17. 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 38
  18. 2026Visual-Advantage On-Policy Distillation for Vision-Language Modelscited by 22
  19. 2025OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Valuecited by 15
  20. 2026LongRLVR: Long-Context Reinforcement Learning Requires Verifiable Context Rewardscited by 13
  21. 2026Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillationcited by 12
  22. 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Taskscited by 11
  23. 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RLcited by 8
  24. 2025AdaSTaR: Adaptive Data Sampling for Training Self-Taught Reasonerscited by 6
  25. 2025Making, not Taking, the Best of Ncited by 4
  26. 2026OmniScience: A Large-scale Multi-modal Dataset for Scientific Image Understandingcited by 4
  27. 2026Mach-Mind-4-Flash Technical Reportcited by 4
  28. 2026KAT-Coder-V2.5 Technical Reportcited by 3
  29. 2025Understanding Task Transfer in Vision-Language Modelscited by 2
  30. 2026OPOD: On-Policy Omni Distillationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Models
  2. 2025MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models
  3. 2025MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervision
  4. 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking
  5. 2026Learn to Think: Improving Multimodal Reasoning through Vision-Aware Self-Improvement Training
  6. 2026H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillation
  7. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
  8. 2026Data-Efficient Curation for Multimodal Reasoning under Fixed Training Protocols