mlsanityData to 14 Oct 2026

Truth in the Few: High-Value Data Selection for Efficient Multi-Modal Reasoning

arXiv 2506.04755 ↗First posted 5 Jun 2025cs.CV cs.AI cs.MMcited by 11

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

While multi-modal large language models (MLLMs) have made significant progress in complex reasoning tasks via reinforcement learning, it is commonly believed that extensive training data is necessary for improving multi-modal reasoning ability, inevitably leading to data redundancy and substantial computational costs. However, can smaller high-value datasets match or outperform full corpora for multi-modal reasoning in MLLMs? In this work, we challenge this assumption through a key observation: meaningful multi-modal reasoning is triggered by only a sparse subset of training samples, termed cognitive samples, whereas the majority contribute marginally. Building on this insight, we propose a novel data selection paradigm termed Reasoning Activation Potential (RAP)}, which identifies cognitive samples by estimating each sample's potential to stimulate genuine multi-modal reasoning by two complementary estimators: 1) Causal Discrepancy Estimator (CDE) based on the potential outcome model principle, eliminates samples that overly rely on language priors by comparing outputs between multi-modal and text-only inputs; 2) Attention Confidence Estimator (ACE), which exploits token-level self-attention to discard samples dominated by irrelevant but over-emphasized tokens in intermediate reasoning stages. Moreover, we introduce a Difficulty-aware Replacement Module (DRM) to substitute trivial instances with cognitively challenging ones, thereby ensuring complexity for robust multi-modal reasoning. Experiments on six datasets show that our RAP method consistently achieves superior performance using only 9.3% of the training data, while reducing computational costs by over 43%.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 7 of its 55 references that are in the map. First posted on arXiv 5 Jun 2025.

Builds on

7 of 55 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  2. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov

Other references · 5

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  4. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  5. 2024OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Frameworkcited by 73

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 8.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Dual Tuning for Reasoning Efficacy-Driven Data Curation in Multimodal LLM Training
  2. 2025Training Multimodal Large Reasoning Models Needs Better Thoughts: A Three-Stage Framework for Long Chain-of-Thought Synthesis and Selection
  3. 2025MMLU-Reason: Benchmarking Multi-Task Multi-modal Language Understanding and Reasoning
  4. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
  5. 2025First SFT, Second RL, Third UPT: Continual Improving Multi-Modal LLM Reasoning via Unsupervised Post-Training
  6. 2025MMhops-R1: Multimodal Multi-hop Reasoning
  7. 2025MIND: Multi-rationale INtegrated Discriminative Reasoning Framework for Multi-modal Large Models
  8. 2025Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning