MIND: Multi-rationale INtegrated Discriminative Reasoning Framework for Multi-modal Large Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recently, multimodal large language models (MLLMs) have been widely applied to reasoning tasks. However, they suffer from limited multi-rationale semantic modeling, insufficient logical robustness, and susceptibility to misleading cues. Therefore, we propose a Multi-rationale INtegrated Discriminative (MIND) reasoning framework, which is designed to endow MLLMs with human-like cognitive abilities of "Understand -> Rethink -> Correct", and achieves a paradigm evolution from passive imitation-based reasoning to active discriminative reasoning. Specifically, we introduce a Rationale Augmentation and Discrimination (RAD) paradigm, which provides a unified and extensible data foundation. Meanwhile, we design a Progressive Two-stage Correction Learning (P2CL) strategy. The first phase enhances multi-rationale positive learning, while the second phase enables active logic discrimination and correction. In addition, to mitigate representation entanglement in the multi-rationale semantic space, we propose a Multi-rationale Contrastive Alignment (MCA) optimization strategy. Extensive experiments show that our MIND achieves SOTA performance on multiple public datasets. Our data and code are available at https://github.com/YuChuang1205/MIND
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 74 of its 80 references that are in the map. First posted on arXiv 5 Dec 2025.
Builds on
74 of 80 references.
Closest ancestors · 24
Same direction, newest first
- 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoning17 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2024CoMT: A Novel Benchmark for Chain of Multi-modal Thought on Large Vision-Language Models17 Dec
- 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models21 Nov
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024Multimodal Reasoning with Multimodal Knowledge Graph4 Jun
- 2024Retrieval Meets Reasoning: Even High-school Textbook Knowledge Benefits Multimodal Reasoning31 May
- 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought26 May
- 2024Cantor: Inspiring Multimodal Chain-of-Thought of MLLM24 Apr
- 2024CoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs5 Jan
- 2023Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Models14 Dec
- 2023Assessing GPT4-V on Structured Reasoning Tasks13 Dec
12 more
- 2023Retrieval-augmented Multi-modal Chain-of-Thoughts Reasoning for Large Language Models4 Dec
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
- 2023Boosting the Power of Small Multimodal Reasoning Models to Match Larger Models with Self-Consistency Training23 Nov
- 2023The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task15 Nov
- 2023Chain of Images for Intuitively Reasoning9 Nov
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models25 Oct
- 2023IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language Models24 May
- 2023T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning via Mixed Large Language Model Signals for Science Question Answering5 May
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models8 Mar
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
- 2023See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning12 Jan
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
Other references · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
38 more
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
- 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2021ClipCap: CLIP Prefix for Image Captioningcited by 559
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 476
- 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
- 2019Deep Modular Co-Attention Networks for Visual Question Answeringcited by 339
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
- 2021An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQAcited by 301
- 2018Bilinear Attention Networkscited by 280
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
- 2023Generating Images with Multimodal Language Modelscited by 260
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 137
- 2020KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQAcited by 125
- 2018Dynamic Fusion with Intra- and Inter- Modality Attention Flow for Visual Question Answeringcited by 114
- 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Modelscited by 113
- 2023Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Modelscited by 101
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?cited by 81
- 2024Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Modelscited by 66
- 2018Pythia v0.1: the Winning Entry to the VQA Challenge 2018cited by 62
- 2023Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generationcited by 56
- 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLMcited by 46
- 2022Webly Supervised Concept Expansion for General Purpose Vision Modelscited by 45
- 2024VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelscited by 43
- 2025MemVerse: Multimodal Memory for Lifelong Learning Agentscited by 35
- 2024Towards a Multimodal Large Language Model with Pixel-Level Insight for Biomedicinecited by 28
- 2025MAGIC-VQA: Multimodal And Grounded Inference with Commonsense Knowledge for Visual Question Answeringcited by 19
- 2024PKRD-CoT: A Unified Chain-of-thought Prompting for Multi-Modal Large Language Models in Autonomous Drivingcited by 17
- 2023Studying and improving reasoning in humans and machinescited by 14
- 2024Ranked from Within: Ranking Large Multimodal Models Without Labelscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026From Stages to States: Unified Iterative Reasoning for MLLMs11 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2025Truth in the Few: High-Value Data Selection for Efficient Multi-Modal Reasoning
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoning
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2024Look Before You Decide: Prompting Active Deduction of MLLMs for Assumptive Reasoning
- 2025Observe-R1: Unlocking Reasoning Abilities of MLLMs with Dynamic Progressive Reinforcement Learning
- 2025Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning
- 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning