mlsanityData to 14 Oct 2026

Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models

arXiv 2603.18118 ↗First posted 18 Mar 2026cs.CV cs.AI cs.LGcited by 2

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) have achieved remarkable reliability and advanced capabilities through extended test-time reasoning. However, extending these capabilities to Multi-modal Large Language Models (MLLMs) remains a significant challenge due to a critical scarcity of high-quality, long-chain reasoning data and optimized training pipelines. To bridge this gap, we present a unified multi-agent visual reasoning framework that systematically evolves from our foundational image-centric model, Insight-V, into a generalized spatial-temporal architecture, Insight-V++. We first propose a scalable data generation pipeline equipped with multi-granularity assessment that autonomously synthesizes structured, complex reasoning trajectories across image and video domains without human intervention. Recognizing that directly supervising MLLMs with such intricate data yields sub-optimal results, we design a dual-agent architecture comprising a reasoning agent to execute extensive analytical chains, and a summary agent to critically evaluate and distill final outcomes. While our initial framework utilized Direct Preference Optimization (DPO), its off-policy nature fundamentally constrained reinforcement learning potential. To overcome these limitations, particularly for long-horizon video understanding, Insight-V++ introduces two novel algorithms, ST-GRPO and J-GRPO, which enhance spatial-temporal reasoning and improve evaluative robustness. Crucially, by leveraging reliable feedback from the summary agent, we guide an iterative reasoning path generation process, retraining the entire multi-agent system in a continuous, self-improving loop. Extensive experiments on base models like LLaVA-NeXT and Qwen2.5-VL demonstrate significant performance gains across challenging image and video reasoning benchmarks while preserving strong capabilities on traditional perception-focused tasks.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 82 of its 140 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

82 of 140 references.

Closest ancestors · 28

Same direction, newest first

  1. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov
  2. 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov
  3. 2025Visual Document Understanding and Reasoning: A Multi-Agent Collaboration Framework with Agent-Wise Adaptive Test-Time Scaling5 Aug
  4. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
  5. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
  6. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
  7. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  8. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  9. 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning10 Apr
  10. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  11. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  12. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
16 more
  1. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  2. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  3. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  4. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  5. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  6. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  7. 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
  8. 2024Improve Vision Language Model Chain-of-thought Reasoning21 Oct
  9. 2024MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Engine11 Jul
  10. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  11. 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Models19 Mar
  12. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  13. 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
  14. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar
  15. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
  16. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 54

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024GPT-4o System Cardcited by 4,588
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  9. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  10. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  11. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  12. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
38 more
  1. 2024Qwen2 Technical Reportcited by 2,120
  2. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  4. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  5. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  6. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  7. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
  8. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  9. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  10. 2025Group Sequence Policy Optimizationcited by 835
  11. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  12. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
  13. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  14. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 557
  15. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  16. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
  17. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  18. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  19. 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
  20. 2024What matters when building vision-language models?cited by 326
  21. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  22. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
  23. 2024V-STaR: Training Verifiers for Self-Taught Reasonerscited by 217
  24. 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 210
  25. 2024LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Imagescited by 195
  26. 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
  27. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
  28. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
  29. 2024Building and better understanding vision-language models: insights and future directionscited by 173
  30. 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Modelcited by 169
  31. 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 159
  32. 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 131
  33. 2023Dolphins: Multimodal Language Model for Drivingcited by 124
  34. 2024Efficient Multimodal Learning from Data-centric Perspectivecited by 122
  35. 2025ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learningcited by 79
  36. 2024MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuningcited by 76
  37. 2023Octopus: Embodied Vision-Language Programmer from Environmental Feedbackcited by 73
  38. 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 68

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  2. 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
  3. 2025Latent Visual Reasoning
  4. 2025Multi-Step Visual Reasoning with Visual Tokens Scaling and Verification
  5. 2026Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought
  6. 2025SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learning
  7. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models
  8. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback