Visual Para-Thinker++: A Single-Policy Multi-Agent Framework for Visual Reasoning
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Visual reasoning requires integrating evidence distributed across regions, attributes, and relations, making single-chain reasoning prone to early perceptual commitment and hallucination. We propose Visual Para-Thinker++, a single-policy multi-agent framework in which one shared MLLM policy is instantiated as role-conditioned Main, Worker, and Summary Agents. The Main Agent decomposes the task with fixed allocation patterns; Worker Agents reason in parallel under context isolation; and the Summary Agent reconciles full Worker reasoning traces rather than majority-voting on final labels. The shared policy is trained by Multi-Agent Capability Injection and Role-Decoupled Multi-Agent Optimization, which assign role-specific rewards and advantages to corresponding token segments to reduce gradient conflict among collaborative roles. A native inference engine enables efficient multi-agent rollout through shared visual prefix and KV cache reuse. Across V*, CountBench, the RefCOCO family, and HallusionBench, Visual Para-Thinker++ consistently outperforms single-trajectory and inference-time parallel baselines, with especially strong gains on hallucination-sensitive visual reasoning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 25 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
24 of 25 references.
Closest ancestors · 3
Same direction, newest first
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
Other references · 21
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Visual Instruction Tuningcited by 7,792
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2024OpenAI o1 System Cardcited by 1,220
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
9 more
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
- 2023Teaching CLIP to Count to Tencited by 194
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
- 2025ParaThinker: Native Parallel Thinking as a New Paradigm to Scale LLM Test-time Computecited by 36
- 2025KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systemscited by 35
- 2025Efficient Reasoning Through Suppression of Self-Affirmation Reflections in Large Reasoning Modelscited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MATA: A Trainable Hierarchical Automaton System for Multi-Agent Visual Reasoning
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models
- 2026Visual Para-Thinker: Divide-and-Conquer Reasoning for Visual Comprehension
- 2026VLM-in-Sandbox: Visual Workspaces for Agentic Visual Reasoning
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
- 2026Collaborative Memory for Multi-Agent VLM Systems
- 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoning
- 2025Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks