From Stages to States: Unified Iterative Reasoning for MLLMs
On the map: LLM reasoning → Prompting and chain-of-thought reasoning also fits: Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
Multimodal Chain-of-Thought (MCoT) substantially enhances the complex reasoning capabilities of Multimodal Large Language Models (MLLMs) by explicitly modeling intermediate reasoning processes. However, most learning-based MCoT methods follow a stage-centric paradigm, where different reasoning behaviors are assigned to predefined stages and optimized separately. This results in fragmented reasoning and a training-inference reasoning-state gap. To address these limitations, we propose ReState, a unified iterative reasoning framework that reformulates multimodal reasoning from a stage-driven pipeline into a state-driven dynamic process. It comprises two complementary components: Unified Reasoning State Modeling (URSM) and Closed-Loop Reasoning-State Learning (CRSL). URSM unifies reasoning construction, correct reasoning preservation, and erroneous reasoning correction as reasoning-state transitions within a shared state space, enabling these heterogeneous reasoning behaviors to be learned jointly. CRSL further incorporates self-generated historical reasoning states during training and recursively updates the current state during inference, thereby mitigating the reasoning-state gap and enabling iterative self-refinement without requiring an additional reflection module, critic, or independent correction stage. Furthermore, we construct VersaCoT-10K, a high-quality CoT dataset spanning eight visual reasoning domains, which provides diverse supervision for multi-domain reasoning and reasoning-state refinement. Extensive experiments demonstrate that ReState exhibits strong adaptability across different MLLM backbones and achieves strong performance on multiple public reasoning benchmarks, supporting the shift from stage-centric reasoning toward state-centric reasoning. Our data and code are available at https://github.com/YuChuang1205/ReState
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 64 of its 79 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
64 of 79 references.
Closest ancestors · 2
Same direction, newest first
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan
Other references · 62
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
38 more
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 476
- 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
- 2019Deep Modular Co-Attention Networks for Visual Question Answeringcited by 339
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
- 2015Visual7W: Grounded Question Answering in Imagescited by 318
- 2018Bilinear Attention Networkscited by 280
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 268
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
- 2023Looped Transformers as Programmable Computerscited by 237
- 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 129
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 128
- 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thoughtcited by 121
- 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 116
- 2018Dynamic Fusion with Intra- and Inter- Modality Attention Flow for Visual Question Answeringcited by 114
- 2024MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Enginecited by 113
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
- 2023Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Modelscited by 101
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Modelscited by 99
- 2024Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Modelscited by 66
- 2023T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning via Mixed Large Language Model Signals for Science Question Answeringcited by 60
- 2023See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoningcited by 51
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoningcited by 49
- 2023IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language Modelscited by 47
- 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLMcited by 46
- 2024ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understandingcited by 46
- 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 44
- 2024VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelscited by 43
- 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thoughtcited by 35
50 most cited of 62 All 62 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models
- 2025Can Atomic Step Decomposition Enhance the Self-structured Reasoning of Multimodal Large Models?
- 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scaling
- 2025MMC: Iterative Refinement of VLM Reasoning via MCTS-based Multimodal Critique
- 2025Towards Efficient Multimodal Unified Reasoning Model via Model Merging
- 2024Progressive Multimodal Reasoning via Active Retrieval
- 2025Will Pre-Training Ever End? A First Step Toward Next-Generation Foundation MLLMs via Self-Improving Systematic Cognition