Truth in the Few: High-Value Data Selection for Efficient Multi-Modal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
While multi-modal large language models (MLLMs) have made significant progress in complex reasoning tasks via reinforcement learning, it is commonly believed that extensive training data is necessary for improving multi-modal reasoning ability, inevitably leading to data redundancy and substantial computational costs. However, can smaller high-value datasets match or outperform full corpora for multi-modal reasoning in MLLMs? In this work, we challenge this assumption through a key observation: meaningful multi-modal reasoning is triggered by only a sparse subset of training samples, termed cognitive samples, whereas the majority contribute marginally. Building on this insight, we propose a novel data selection paradigm termed Reasoning Activation Potential (RAP)}, which identifies cognitive samples by estimating each sample's potential to stimulate genuine multi-modal reasoning by two complementary estimators: 1) Causal Discrepancy Estimator (CDE) based on the potential outcome model principle, eliminates samples that overly rely on language priors by comparing outputs between multi-modal and text-only inputs; 2) Attention Confidence Estimator (ACE), which exploits token-level self-attention to discard samples dominated by irrelevant but over-emphasized tokens in intermediate reasoning stages. Moreover, we introduce a Difficulty-aware Replacement Module (DRM) to substitute trivial instances with cognitively challenging ones, thereby ensuring complexity for robust multi-modal reasoning. Experiments on six datasets show that our RAP method consistently achieves superior performance using only 9.3% of the training data, while reducing computational costs by over 43%.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 7 of its 55 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
7 of 55 references.
Closest ancestors · 2
Same direction, newest first
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
Other references · 5
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Frameworkcited by 73
Built on by
Citing papers per year: 2025: 3; 2026: 8.
11 papers.
- 2025Perception-Aware Policy Optimization for Multimodal Reasoningcited by 99
- 2025Spotlight on Token Perception for Multimodal Reinforcement Learningcited by 39
- 2025ADHint: Adaptive Hints with Difficulty Priors for Reinforcement Learningcited by 12
- 2026Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoningcited by 9
- 2026Not All Tokens See Equally: Perception-Grounded Policy Optimization for Large Vision-Language Modelscited by 7
- 2026PRPO: Perception-Reinforced Policy Optimization via Token-Level Dynamic Advantage Reshapingcited by 5
- 2026APPO: Attention-guided Perception Policy Optimization for Video Reasoningcited by 3
- 2026Bridging Visual Representation and Reinforcement Learning from Verifiable Rewards in Large Vision-Language Modelscited by 2
- 2026Smart Picks in the Dark: Towards Efficient RLVR for Reasoning via Tracing Metacognitive Pivotscited by 1
- 2026Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoningcited by 1
- 2026CAST: Collapse-Aware multi-Scale Topology Fusion for Multimodal Coreset Selectioncited by 0
- 2026Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoning22 Jul 2026
- 2026PRPO: Perception-Reinforced Policy Optimization via Token-Level Dynamic Advantage Reshaping7 Jun 2026
- 2026Smart Picks in the Dark: Towards Efficient RLVR for Reasoning via Tracing Metacognitive Pivots3 Jun 2026
- 2026CAST: Collapse-Aware multi-Scale Topology Fusion for Multimodal Coreset Selection12 May 2026
- 2026Not All Tokens See Equally: Perception-Grounded Policy Optimization for Large Vision-Language Models2 Apr 2026
- 2026Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoning30 Mar 2026
- 2026Bridging Visual Representation and Reinforcement Learning from Verifiable Rewards in Large Vision-Language Models28 Mar 2026
- 2026APPO: Attention-guided Perception Policy Optimization for Video Reasoning27 Feb 2026
- 2025ADHint: Adaptive Hints with Difficulty Priors for Reinforcement Learning15 Dec 2025
- 2025Spotlight on Token Perception for Multimodal Reinforcement Learning10 Oct 2025
- 2025Perception-Aware Policy Optimization for Multimodal Reasoning8 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2026Dual Tuning for Reasoning Efficacy-Driven Data Curation in Multimodal LLM Training
- 2025Training Multimodal Large Reasoning Models Needs Better Thoughts: A Three-Stage Framework for Long Chain-of-Thought Synthesis and Selection
- 2025MMLU-Reason: Benchmarking Multi-Task Multi-modal Language Understanding and Reasoning
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2025First SFT, Second RL, Third UPT: Continual Improving Multi-Modal LLM Reasoning via Unsupervised Post-Training
- 2025MMhops-R1: Multimodal Multi-hop Reasoning
- 2025MIND: Multi-rationale INtegrated Discriminative Reasoning Framework for Multi-modal Large Models
- 2025Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning