mlsanityData to 14 Oct 2026

MindWatcher: Toward Smarter Multimodal Tool-Integrated Reasoning

arXiv 2512.23412 ↗First posted 29 Dec 2025cs.AIcited by 6

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Traditional workflow-based agents exhibit limited intelligence when addressing real-world problems requiring tool invocation. Tool-integrated reasoning (TIR) agents capable of autonomous reasoning and tool invocation are rapidly emerging as a powerful approach for complex decision-making tasks involving multi-step interactions with external environments. In this work, we introduce MindWatcher, a TIR agent integrating interleaved thinking and multimodal chain-of-thought (CoT) reasoning. MindWatcher can autonomously decide whether and how to invoke diverse tools and coordinate their use, without relying on human prompts or workflows. The interleaved thinking paradigm enables the model to switch between thinking and tool calling at any intermediate stage, while its multimodal CoT capability allows manipulation of images during reasoning to yield more precise search results. We implement automated data auditing and evaluation pipelines, complemented by manually curated high-quality datasets for training, and we construct a benchmark, called MindWatcher-Evaluate Bench (MWE-Bench), to evaluate its performance. MindWatcher is equipped with a comprehensive suite of auxiliary reasoning tools, enabling it to address broad-domain multimodal problems. A large-scale, high-quality local image retrieval database, covering eight categories including cars, animals, and plants, endows model with robust object recognition despite its small size. Finally, we design a more efficient training infrastructure for MindWatcher, enhancing training speed and hardware utilization. Experiments not only demonstrate that MindWatcher matches or exceeds the performance of larger or more recent models through superior tool invocation, but also uncover critical insights for agent training, such as the genetic inheritance phenomenon in agentic RL.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 36 of its 42 references that are in the map. First posted on arXiv 29 Dec 2025.

Builds on

36 of 42 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent7 Aug
  2. 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation5 May

Other references · 34

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  7. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  8. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  9. 2025Qwen2.5-VL Technical Reportcited by 5,587
  10. 2024Qwen2.5 Technical Reportcited by 4,942
  11. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  12. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
22 more
  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  2. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  3. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
  4. 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
  5. 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
  6. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 212
  7. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
  8. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
  9. 2025Agentic Reinforced Policy Optimizationcited by 172
  10. 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
  11. 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 68
  12. 2025SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Modelscited by 66
  13. 2024Detecting and Evaluating Medical Hallucinations in Large Vision Language Modelscited by 57
  14. 2025SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesiscited by 55
  15. 2025rStar2-Agent: Agentic Reasoning Technical Reportcited by 54
  16. 2025WebWeaver: Structuring Web-Scale Evidence with Dynamic Outlines for Open-Ended Deep Researchcited by 46
  17. 2025Scaling Agents via Continual Pre-trainingcited by 40
  18. 2024CoMT: Chain-of-Medical-Thought Reduces Hallucination in Medical Report Generationcited by 25
  19. 2025FlowAgent: Achieving Compliance and Flexibility for Workflow Agentscited by 19
  20. 2025On Group Relative Policy Optimization Collapse in Agent Search: The Lazy Likelihood-Displacementcited by 15
  21. 2024Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Modelscited by 11
  22. 2025MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigmcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AdaReasoner: Dynamic Tool Orchestration for Iterative Visual Reasoning
  2. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
  3. 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoning
  4. 2026Do Multimodal Agents Really Benefit from Tool Use? A Systematic Study of Capability Gains
  5. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
  6. 2025Octopus: Agentic Multimodal Reasoning with Six-Capability Orchestration
  7. 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearch
  8. 2026Diversity Over Frequency: Rethinking Tool Use in Visual Chain-of-Thought Agents