MindWatcher: Toward Smarter Multimodal Tool-Integrated Reasoning
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Traditional workflow-based agents exhibit limited intelligence when addressing real-world problems requiring tool invocation. Tool-integrated reasoning (TIR) agents capable of autonomous reasoning and tool invocation are rapidly emerging as a powerful approach for complex decision-making tasks involving multi-step interactions with external environments. In this work, we introduce MindWatcher, a TIR agent integrating interleaved thinking and multimodal chain-of-thought (CoT) reasoning. MindWatcher can autonomously decide whether and how to invoke diverse tools and coordinate their use, without relying on human prompts or workflows. The interleaved thinking paradigm enables the model to switch between thinking and tool calling at any intermediate stage, while its multimodal CoT capability allows manipulation of images during reasoning to yield more precise search results. We implement automated data auditing and evaluation pipelines, complemented by manually curated high-quality datasets for training, and we construct a benchmark, called MindWatcher-Evaluate Bench (MWE-Bench), to evaluate its performance. MindWatcher is equipped with a comprehensive suite of auxiliary reasoning tools, enabling it to address broad-domain multimodal problems. A large-scale, high-quality local image retrieval database, covering eight categories including cars, animals, and plants, endows model with robust object recognition despite its small size. Finally, we design a more efficient training infrastructure for MindWatcher, enhancing training speed and hardware utilization. Experiments not only demonstrate that MindWatcher matches or exceeds the performance of larger or more recent models through superior tool invocation, but also uncover critical insights for agent training, such as the genetic inheritance phenomenon in agentic RL.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 36 of its 42 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
36 of 42 references.
Closest ancestors · 2
Same direction, newest first
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent7 Aug
- 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation5 May
Other references · 34
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
22 more
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 212
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2025Agentic Reinforced Policy Optimizationcited by 172
- 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 68
- 2025SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Modelscited by 66
- 2024Detecting and Evaluating Medical Hallucinations in Large Vision Language Modelscited by 57
- 2025SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesiscited by 55
- 2025rStar2-Agent: Agentic Reasoning Technical Reportcited by 54
- 2025WebWeaver: Structuring Web-Scale Evidence with Dynamic Outlines for Open-Ended Deep Researchcited by 46
- 2025Scaling Agents via Continual Pre-trainingcited by 40
- 2024CoMT: Chain-of-Medical-Thought Reduces Hallucination in Medical Report Generationcited by 25
- 2025FlowAgent: Achieving Compliance and Flexibility for Workflow Agentscited by 19
- 2025On Group Relative Policy Optimization Collapse in Agent Search: The Lazy Likelihood-Displacementcited by 15
- 2024Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Modelscited by 11
- 2025MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigmcited by 9
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026AgentVista: Evaluating Multimodal Agents in Ultra-Challenging Realistic Visual Scenarioscited by 23
- 2026Evolving from Tool User to Creator via Training-Free Experience Reuse in Multimodal Reasoningcited by 7
- 2026Agentic-MME: What Agentic Capability Really Brings to Multimodal Intelligence?cited by 5
- 2026StreamingClaw Technical Reportcited by 4
- 2026Evaluating the Search Agent in a Parallel Worldcited by 2
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrievalcited by 0
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrieval19 Sep 2026
- 2026Agentic-MME: What Agentic Capability Really Brings to Multimodal Intelligence?3 Apr 2026
- 2026StreamingClaw Technical Report23 Mar 2026
- 2026Evaluating the Search Agent in a Parallel World5 Mar 2026
- 2026AgentVista: Evaluating Multimodal Agents in Ultra-Challenging Realistic Visual Scenarios26 Feb 2026
- 2026Evolving from Tool User to Creator via Training-Free Experience Reuse in Multimodal Reasoning2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026AdaReasoner: Dynamic Tool Orchestration for Iterative Visual Reasoning
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
- 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoning
- 2026Do Multimodal Agents Really Benefit from Tool Use? A Systematic Study of Capability Gains
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
- 2025Octopus: Agentic Multimodal Reasoning with Six-Capability Orchestration
- 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearch
- 2026Diversity Over Frequency: Rethinking Tool Use in Visual Chain-of-Thought Agents