mlsanityData to 7 Oct 2026

Visual Para-Thinker++: A Single-Policy Multi-Agent Framework for Visual Reasoning

arXiv 2606.09290 ↗First posted 8 Jun 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Visual reasoning requires integrating evidence distributed across regions, attributes, and relations, making single-chain reasoning prone to early perceptual commitment and hallucination. We propose Visual Para-Thinker++, a single-policy multi-agent framework in which one shared MLLM policy is instantiated as role-conditioned Main, Worker, and Summary Agents. The Main Agent decomposes the task with fixed allocation patterns; Worker Agents reason in parallel under context isolation; and the Summary Agent reconciles full Worker reasoning traces rather than majority-voting on final labels. The shared policy is trained by Multi-Agent Capability Injection and Role-Decoupled Multi-Agent Optimization, which assign role-specific rewards and advantages to corresponding token segments to reduce gradient conflict among collaborative roles. A native inference engine enables efficient multi-agent rollout through shared visual prefix and KV cache reuse. Across V*, CountBench, the RefCOCO family, and HallusionBench, Visual Para-Thinker++ consistently outperforms single-trajectory and inference-time parallel baselines, with especially strong gains on hallucination-sensitive visual reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 25 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

24 of 25 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  2. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
  3. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 21

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  8. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  9. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  10. 2024OpenAI o1 System Cardcited by 1,220
  11. 2016Modeling Context in Referring Expressionscited by 1,054
  12. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
9 more
  1. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  2. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
  3. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  4. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
  5. 2023Teaching CLIP to Count to Tencited by 194
  6. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
  7. 2025ParaThinker: Native Parallel Thinking as a New Paradigm to Scale LLM Test-time Computecited by 36
  8. 2025KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systemscited by 35
  9. 2025Efficient Reasoning Through Suppression of Self-Affirmation Reflections in Large Reasoning Modelscited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MATA: A Trainable Hierarchical Automaton System for Multi-Agent Visual Reasoning
  2. 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models
  3. 2026Visual Para-Thinker: Divide-and-Conquer Reasoning for Visual Comprehension
  4. 2026VLM-in-Sandbox: Visual Workspaces for Agentic Visual Reasoning
  5. 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
  6. 2026Collaborative Memory for Multi-Agent VLM Systems
  7. 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoning
  8. 2025Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks