mlsanityData to 7 Oct 2026

MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods

arXiv 2601.21821 ↗First posted 29 Jan 2026cs.CVcited by 27

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent advances in Vision Language Models (VLMs) have driven significant progress in visual reasoning. However, open-source VLMs still lag behind proprietary systems, largely due to the lack of high-quality reasoning data. Existing datasets offer limited coverage of challenging domains such as STEM diagrams and visual puzzles, and lack consistent, long-form Chain-of-Thought (CoT) annotations essential for eliciting strong reasoning capabilities. To bridge this gap, we introduce MMFineReason, a large-scale multimodal reasoning dataset comprising 1.8M samples and 5.1B solution tokens, featuring high-quality reasoning annotations distilled from Qwen3-VL-235B-A22B-Thinking. The dataset is established via a systematic three-stage pipeline: (1) large-scale data collection and standardization, (2) CoT rationale generation, and (3) comprehensive selection based on reasoning quality and difficulty awareness. The resulting dataset spans STEM problems, visual puzzles, games, and complex diagrams, with each sample annotated with visually grounded reasoning traces. We fine-tune Qwen3-VL-Instruct on MMFineReason to develop MMFineReason-2B/4B/8B versions. Our models establish new state-of-the-art results for their size class. Notably, MMFineReason-4B succesfully surpasses Qwen3-VL-8B-Thinking, and MMFineReason-8B even outperforms Qwen3-VL-30B-A3B-Thinking while approaching Qwen3-VL-32B-Thinking, demonstrating remarkable parameter efficiency. Crucially, we uncover a "less is more" phenomenon via our difficulty-aware filtering strategy: a subset of just 7% (123K samples) achieves performance comparable to the full dataset. Notably, we reveal a synergistic effect where reasoning-oriented data composition simultaneously boosts general capabilities.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 63 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

39 of 63 references.

Closest ancestors · 18

Same direction, newest first

  1. 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch20 Jan
  2. 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility17 Jan
  3. 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov
  4. 2025HoneyBee: Data Recipes for Vision-Language Reasoners14 Oct
  5. 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
  6. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
  7. 2025BMMR: A Large-Scale Bilingual Multimodal Multi-Discipline Reasoning Dataset4 Jul
  8. 2025VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL29 May
  9. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start28 May
  10. 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning20 May
  11. 2025Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoning20 May
  12. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
6 more
  1. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
  2. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  3. 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
  4. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  5. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
  6. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 21

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  7. 2025Group Sequence Policy Optimizationcited by 788
  8. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  9. 2025LIMO: Less is More for Reasoningcited by 488
  10. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  11. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  12. 2025General-Reasoner: Advancing LLM Reasoning Across All Domainscited by 132
9 more
  1. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
  2. 2025FineVision: Open Data Is All You Needcited by 51
  3. 2025CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Rewardcited by 39
  4. 2025AM-Thinking-v1: Advancing the Frontier of Reasoning at 32B Scalecited by 29
  5. 2025OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Valuecited by 15
  6. 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Taskscited by 11
  7. 2025Scaling Code-Assisted Chain-of-Thoughts and Instructions for Model Reasoningcited by 10
  8. 2024SynthVLM: Towards High-Quality and Efficient Synthesis of Image-Caption Datasets for Vision-Language Modelscited by 6
  9. 2025FLARE: Fully Integration of Vision-Language Representations for Deep Cross-Modal Understandingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 27.

27 papers.

Sort:

By area:

  1. 2026Self-Distilled RLVRcited by 109
  2. 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 47
  3. 2026Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrievalcited by 17
  4. 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 15
  5. 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 13
  6. 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolutioncited by 12
  7. 2026Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RLcited by 8
  8. 2026H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillationcited by 7
  9. 2026Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learningcited by 6
  10. 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
  11. 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoningcited by 4
  12. 2026Co-Evolving Policy Distillationcited by 4
15 more
  1. 2026Learning from the Near Future: Temporal Self-Distillation for RLVRcited by 3
  2. 2026NuNext: Reframing Nucleus Detection as Next-Point Detectioncited by 2
  3. 2026Agent Explorative Policy Optimization for Multimodal Agentic Reasoningcited by 2
  4. 2026Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to Systemcited by 2
  5. 2026Scaling DoRA: High-Rank Adaptation via Factored Norms and Fused Kernelscited by 1
  6. 2026Learning to Solve, Forgetting to Retain: Correct-Set Turnover in RLVRcited by 1
  7. 2026DeltaPrompts: Escaping the Zero-Delta Trap in Multimodal Distillationcited by 0
  8. 2026VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instructcited by 0
  9. 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
  10. 2026Causal Evidence Extraction and Triangulation in Crisis Reports using Large Language Models: A ReliefWeb-based Studycited by 0
  11. 2026When Prompts Become Pixels: Prompt-Region Grounding for Multimodal Reasoningcited by 0
  12. 2026Look Before You Select: Rethinking Vocabulary Sparsification in On-Policy Distillationcited by 0
  13. 2026LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillationcited by 0
  14. 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoningcited by 0
  15. 2026REMORY: Learning Residual Memory for Context Compactioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
  2. 2025VGR: Visual Grounded Reasoning
  3. 2025VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning
  4. 2026Reasoning or Pattern Matching? Probing Large Vision-Language Models with Visual Puzzles
  5. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs
  6. 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns
  7. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models
  8. 2025Long Grounded Thoughts: Synthesizing Visual Problems and Reasoning Chains at Scale