MC-Search: Evaluating and Enhancing Multimodal Agentic Search with Structured Long Reasoning Chains
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 3 more
Abstract (arXiv)
With the increasing demand for step-wise, cross-modal, and knowledge-grounded reasoning, multimodal large language models (MLLMs) are evolving beyond the traditional fixed retrieve-then-generate paradigm toward more sophisticated agentic multimodal retrieval-augmented generation (MM-RAG). Existing benchmarks, however, mainly focus on simplified QA with short retrieval chains, leaving adaptive planning and multimodal reasoning underexplored. We present MC-Search, the first benchmark for agentic MM-RAG with long, step-wise annotated reasoning chains spanning five representative reasoning structures. Each example specifies sub-questions, retrieval modalities, supporting facts, and intermediate answers, with fidelity ensured by HAVE (Hop-wise Attribution and Verification of Evidence), resulting in 3,333 high-quality examples averaging 3.7 hops. Beyond answer accuracy, MC-Search introduces new process-level metrics for reasoning quality, stepwise retrieval and planning accuracy. By developing a unified agentic MM-RAG pipeline, we benchmark six leading MLLMs and reveal systematic issues such as over- and under-retrieval and modality-misaligned planning. Finally, we introduce Search-Align, a process-supervised fine-tuning framework leveraging verified reasoning chains, showing that our data not only enables faithful evaluation but also improves planning and retrieval fidelity in open-source MLLMs.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 46 references that are in the map. First posted on arXiv 1 Mar 2026.
Builds on
30 of 46 references.
Closest ancestors · 5
Same direction, newest first
- 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning25 Mar
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning12 Mar
- 2025Learning to Retrieve and Reason on Knowledge Graph through Active Self-Reflection20 Feb
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Models9 Jan
- 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec
Other references · 25
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
13 more
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
- 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systemscited by 117
- 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
- 2022Retrieval Augmented Visual Question Answering with Outside Knowledgecited by 94
- 2024MegaPairs: Massive Data Synthesis For Universal Multimodal Retrievalcited by 84
- 2023Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question Answeringcited by 51
- 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlookcited by 32
- 2025RAG-RL: Advancing Retrieval-Augmented Generation via RL and Curriculum Learningcited by 30
- 2024Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Modelscited by 27
- 2024GeAR: Graph-enhanced Agent for Retrieval-augmented Generationcited by 17
- 2025Benchmarking Retrieval-Augmented Generation in Multi-Modal Contextscited by 12
- 2025Evaluating the Robustness of Retrieval-Augmented Generation to Adversarial Evidence in the Health Domaincited by 6
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026LEDGERMIND: Provenance-Constrained Multimodal Agentic Reasoning with a Structured Evidence Ledgercited by 5
- 2026PaperMind: Benchmarking Agentic Reasoning and Critique over Scientific Papers in Multimodal LLMscited by 4
- 2026VistaHop: Benchmarking Long-Horizon Visual DeepSearchcited by 3
- 2026Harnessing Generalist Agents for Contextualized Time Seriescited by 3
- 2026Heterogeneous Scientific Foundation Model Collaborationcited by 1
- 2026Toward Agentic RAG for Ukrainiancited by 0
- 2026Silent Failures in Multimodal Agentic Search:A Diagnostic Taxonomy and Cross-Judge Evaluationcited by 0
- 2026MMShopBench: A Real-Log Benchmark for Multimodal, Multi-Turn Shopping Agentscited by 0
- 2026Tracking the Moving Frontier: Long-Short Term Advantage Estimatorcited by 0
- 2026Benchmarking Hybrid Deep Research Across Database Querying and Web Searchcited by 0
- 2026Sci-MMR: Benchmarking Multi-Step Evidence-Grounded Scientific Reasoning in Multimodal Agentscited by 0
- 2026Mr.LHDR: A Benchmark for Multimodal Real-World Long-Horizon Deep Research Agentscited by 0
- 2026Mr.LHDR: A Benchmark for Multimodal Real-World Long-Horizon Deep Research Agents10 Sep 2026
- 2026Sci-MMR: Benchmarking Multi-Step Evidence-Grounded Scientific Reasoning in Multimodal Agents10 Sep 2026
- 2026Benchmarking Hybrid Deep Research Across Database Querying and Web Search8 Sep 2026
- 2026Tracking the Moving Frontier: Long-Short Term Advantage Estimator6 Sep 2026
- 2026MMShopBench: A Real-Log Benchmark for Multimodal, Multi-Turn Shopping Agents31 Jul 2026
- 2026LEDGERMIND: Provenance-Constrained Multimodal Agentic Reasoning with a Structured Evidence Ledger30 Jul 2026
- 2026Silent Failures in Multimodal Agentic Search:A Diagnostic Taxonomy and Cross-Judge Evaluation22 Jul 2026
- 2026Harnessing Generalist Agents for Contextualized Time Series3 Jun 2026
- 2026VistaHop: Benchmarking Long-Horizon Visual DeepSearch2 Jun 2026
- 2026Heterogeneous Scientific Foundation Model Collaboration30 Apr 2026
- 2026PaperMind: Benchmarking Agentic Reasoning and Critique over Scientific Papers in Multimodal LLMs23 Apr 2026
- 2026Toward Agentic RAG for Ukrainian16 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025RAGCap-Bench: Benchmarking Capabilities of LLMs in Agentic Retrieval Augmented Generation Systems
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
- 2025HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generation
- 2025Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges
- 2025MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoning
- 2026Do We Still Need GraphRAG? Benchmarking RAG and GraphRAG for Agentic Search Systems
- 2026AgenticRAGTracer: A Hop-Aware Benchmark for Diagnosing Multi-Step Retrieval Reasoning in Agentic RAG
- 2024Progressive Multimodal Reasoning via Active Retrieval