Dual Tuning for Reasoning Efficacy-Driven Data Curation in Multimodal LLM Training
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Reasoning post-training improves Large Language Models (LLMs) on complex tasks such as mathematics and coding, but its benefits across diverse multimodal tasks remains uncertain. The trend of releasing parallel "Instruct" and "Thinking" models by leading teams is both resource-intensive and user-unfriendly. Prior work finds that the gains from reasoning training are influenced by multiple factors, such as base model capabilities, task characteristics, and Chain-of-Thought (CoT) data quality. However, principled criteria for determining when reasoning post-training is beneficial and which data should support it are still lacking. In this paper, we propose Dual Tuning, a reasoning efficacy-driven data curation framework for multimodal LLMs training. Given a target task and a base model, Dual Tuning jointly evaluates whether the training data is beneficial and whether reasoning training with current CoT content yields positive gains over non-reasoning alternatives. We apply Dual Tuning across spatial, mathematical, and multi-disciplinary tasks, and further analyze how reinforcement learning and thinking patterns affect reasoning efficacy. The Dual Tuning results guide data curation by identifying data that benefit reasoning training, data better suited to direct-answer training, and data that are detrimental under both training modes. Our work provides quantitative criteria for selecting appropriate training data and matching post-training strategies.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 27 of its 37 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
27 of 37 references.
Closest ancestors · 1
Same direction, newest first
- 2025Qwen3 Technical Report14 May
Other references · 26
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
- 2025Qwen3-Omni Technical Reportcited by 451
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
14 more
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 176
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 105
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 89
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 84
- 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 52
- 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucinationcited by 29
- 2025MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLMcited by 17
- 2025M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoningcited by 16
- 2025CVBench: Benchmarking Cross-Video Synergies for Complex Multimodal Reasoningcited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Front-Loading Reasoning: The Synergy between Pretraining and Post-Training Data
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2025How and Why LLMs Generalize: A Fine-Grained Analysis of LLM Reasoning from Cognitive Behaviors to Low-Level Patterns
- 2025Unleashing the Reasoning Potential of Pre-trained LLMs by Critique Fine-Tuning on One Problem
- 2026Dual-Phase LLM Reasoning: Self-Evolved Mathematical Frameworks
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
- 2024Training-Free Mitigation of Language Reasoning Degradation After Multimodal Instruction Tuning