mlsanityData to 14 Oct 2026

MC-Search: Evaluating and Enhancing Multimodal Agentic Search with Structured Long Reasoning Chains

arXiv 2603.00873 ↗First posted 1 Mar 2026cs.AIcited by 12

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 3 more
Abstract (arXiv)

With the increasing demand for step-wise, cross-modal, and knowledge-grounded reasoning, multimodal large language models (MLLMs) are evolving beyond the traditional fixed retrieve-then-generate paradigm toward more sophisticated agentic multimodal retrieval-augmented generation (MM-RAG). Existing benchmarks, however, mainly focus on simplified QA with short retrieval chains, leaving adaptive planning and multimodal reasoning underexplored. We present MC-Search, the first benchmark for agentic MM-RAG with long, step-wise annotated reasoning chains spanning five representative reasoning structures. Each example specifies sub-questions, retrieval modalities, supporting facts, and intermediate answers, with fidelity ensured by HAVE (Hop-wise Attribution and Verification of Evidence), resulting in 3,333 high-quality examples averaging 3.7 hops. Beyond answer accuracy, MC-Search introduces new process-level metrics for reasoning quality, stepwise retrieval and planning accuracy. By developing a unified agentic MM-RAG pipeline, we benchmark six leading MLLMs and reveal systematic issues such as over- and under-retrieval and modality-misaligned planning. Finally, we introduce Search-Align, a process-supervised fine-tuning framework leveraging verified reasoning chains, showing that our data not only enables faithful evaluation but also improves planning and retrieval fidelity in open-source MLLMs.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 46 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

30 of 46 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning25 Mar
  2. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning12 Mar
  3. 2025Learning to Retrieve and Reason on Knowledge Graph through Active Self-Reflection20 Feb
  4. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Models9 Jan
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec

Other references · 25

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  5. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  6. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  7. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  8. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  9. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
  10. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
  11. 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
  12. 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
13 more
  1. 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
  2. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  3. 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systemscited by 117
  4. 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
  5. 2022Retrieval Augmented Visual Question Answering with Outside Knowledgecited by 94
  6. 2024MegaPairs: Massive Data Synthesis For Universal Multimodal Retrievalcited by 84
  7. 2023Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question Answeringcited by 51
  8. 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlookcited by 32
  9. 2025RAG-RL: Advancing Retrieval-Augmented Generation via RL and Curriculum Learningcited by 30
  10. 2024Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Modelscited by 27
  11. 2024GeAR: Graph-enhanced Agent for Retrieval-augmented Generationcited by 17
  12. 2025Benchmarking Retrieval-Augmented Generation in Multi-Modal Contextscited by 12
  13. 2025Evaluating the Robustness of Retrieval-Augmented Generation to Adversarial Evidence in the Health Domaincited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025RAGCap-Bench: Benchmarking Capabilities of LLMs in Agentic Retrieval Augmented Generation Systems
  2. 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
  3. 2025HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generation
  4. 2025Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges
  5. 2025MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoning
  6. 2026Do We Still Need GraphRAG? Benchmarking RAG and GraphRAG for Agentic Search Systems
  7. 2026AgenticRAGTracer: A Hop-Aware Benchmark for Diagnosing Multi-Step Retrieval Reasoning in Agentic RAG
  8. 2024Progressive Multimodal Reasoning via Active Retrieval