Mimic Human Cognition, Master Multi-Image Reasoning: A Meta-Action Framework for Enhanced Visual Understanding
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
While Multimodal Large Language Models (MLLMs) excel at single-image understanding, they exhibit significantly degraded performance in multi-image reasoning scenarios. Multi-image reasoning presents fundamental challenges including complex inter-relationships between images and scattered critical information across image sets. Inspired by human cognitive processes, we propose a Cognition-Inspired Meta-Action Framework (CINEMA), which decomposes multi-image reasoning into five structured meta-actions: Global, Focus, Hint, Think, and Answer, explicitly modeling the sequential cognitive steps humans naturally employ. For cold-start training, we introduce a Retrieval-Based Tree Sampling strategy that generates high-quality meta-action trajectories to bootstrap the model with reasoning patterns. During reinforcement learning, we adopt a two-stage paradigm: an exploration phase with Diversity-Preserving Strategy to avoid entropy collapse, followed by an annealed exploitation phase with DAPO to gradually strengthen exploitation. To train our model, we construct a dataset of 56k cold-start and 58k reinforcement learning instances spanning multi-image, multi-frame, and single-image tasks. We conduct extensive evaluations on multi-image reasoning benchmarks, video understanding benchmarks, and single-image benchmarks, achieving competitive state-of-the-art performance on several key benchmarks. Our model surpasses GPT-4o on the MUIR and MVMath benchmarks and notably outperforms specialized video reasoning models on video understanding benchmarks, demonstrating the effectiveness and generalizability of our human cognition-inspired reasoning framework.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 53 of its 99 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
53 of 99 references.
Closest ancestors · 15
Same direction, newest first
- 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoning2 Jul
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
- 2025Reinforcing Video Reasoning with Focused Thinking30 May
- 2025Mixed-R1: Unified Reward Perspective For Reasoning Capability in Multimodal Large Language Models30 May
- 2025R1-ShareVL: Incentivizing Reasoning Capability of Multimodal Large Language Models via Share-GRPO22 May
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
3 more
- 2025CMMCoT: Enhancing Complex Multi-Image Comprehension via Multi-Modal Chain-of-Thought and Memory Augmentation7 Mar
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning18 Jun
Other references · 38
- 2023GPT-4 Technical Reportcited by 18,396
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 565
26 more
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 559
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 485
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
- 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 459
- 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 445
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2025Learning to Reason under Off-Policy Guidancecited by 281
- 2025Reasoning with Exploration: An Entropy Perspectivecited by 281
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
- 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Modelscited by 194
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2025Skywork Open Reasoner 1 Technical Reportcited by 165
- 2018Learning to Describe Differences Between Pairs of Similar Imagescited by 114
- 2025SEED-GRPO: Semantic Entropy Enhanced GRPO for Uncertainty-Aware Policy Optimizationcited by 89
- 2024A Survey on Benchmarks of Multimodal Large Language Modelscited by 82
- 2024A Comprehensive Review of Multimodal Large Language Models: Performance and Challenges Across Different Taskscited by 57
- 2025NFT: Bridging Supervised Learning and Reinforcement Learning in Math Reasoningcited by 38
- 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 32
- 2025DRA-GRPO: Your GRPO Needs to Know Diverse Reasoning Paths for Mathematical Reasoningcited by 18
- 2025CURE: Critical-Token-Guided Re-Concatenation for Entropy-Collapse Preventioncited by 18
- 2025Weaving Context Across Images: Improving Vision-Language Models through Focus-Centric Visual Chainscited by 12
- 2025Unleashing Foundation Vision Models: Adaptive Transfer for Diverse Data-Limited Scientific Domainscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback
- 2026Walk the Talk: Bridging the Reasoning-Action Gap for Thinking with Images via Multimodal Agentic Policy Optimization
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
- 2025OneThinker: All-in-one Reasoning Model for Image and Video
- 2025MiCo: Multi-image Contrast for Reinforcement Visual Reasoning
- 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models
- 2026SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning
- 2026MetaphorStar: Image Metaphor Understanding and Reasoning with End-to-End Visual Reinforcement Learning