mlsanityData to 7 Oct 2026

EpiBench: Benchmarking Multi-turn Research Workflows for Multimodal Agents

arXiv 2604.05557 ↗First posted 7 Apr 2026cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Scientific research follows multi-turn, multi-step workflows that require proactively searching the literature, consulting figures and tables, and integrating evidence across papers to align experimental settings and support reproducible conclusions. This joint capability is not systematically assessed in existing benchmarks, which largely under-evaluate proactive search, multi-evidence integration and sustained evidence use over time. In this work, we introduce EpiBench, an episodic multi-turn multimodal benchmark that instantiates short research workflows. Given a research task, agents must navigate across papers over multiple turns, align evidence from figures and tables, and use the accumulated evidence in the memory to answer objective questions that require cross paper comparisons and multi-figure integration. EpiBench introduces a process-level evaluation framework for fine-grained testing and diagnosis of research agents. Our experiments show that even the leading model achieves an accuracy of only 29.23% on the hard split, indicating substantial room for improvement in multi-turn, multi-evidence research workflows, providing an evaluation platform for verifiable and reproducible research agents.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

25 of 33 references.

References · 25

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  5. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  6. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
  7. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
  8. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
  9. 2024MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMscited by 89
  10. 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
  11. 2023SciGraphQA: A Large-Scale Synthetic Multi-Turn Question-Answering Dataset for Scientific Graphscited by 66
  12. 2025MMSearch-Plus: Benchmarking Provenance-Aware Search for Multimodal Browsing Agentscited by 35
13 more
  1. 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 30
  2. 2026MMDeepResearch-Bench: A Benchmark for Multimodal Deep Research Agentscited by 21
  3. 2024LiveXiv -- A Multi-Modal Live Benchmark Based on Arxiv Papers Contentcited by 17
  4. 2025MMCR: Advancing Visual Language Model in Multimodal Multi-Turn Contextual Reasoningcited by 16
  5. 2025PaperArena: An Evaluation Benchmark for Tool-Augmented Agentic Reasoning on Scientific Literaturecited by 15
  6. 2025Memory-QA: Answering Recall Questions Based on Multimodal Memoriescited by 10
  7. 2025MultiVerse: A Multi-Turn Conversation Benchmark for Evaluating Large Vision and Language Modelscited by 10
  8. 2025am-ELO: A Stable Framework for Arena-based LLM Evaluationcited by 8
  9. 2025VisChainBench: A Benchmark for Multi-Turn, Multi-Image Visual Reasoning Beyond Language Priorscited by 3
  10. 2026SIN-Bench: Tracing Native Evidence Chains in Long-Context Multimodal Scientific Interleaved Literaturecited by 3
  11. 2025Enhancing Scientific Visual Question Answering through Multimodal Reasoning and Ensemble Modelingcited by 2
  12. 2026Efficient Multimodal Planning Agent for Visual Question-Answeringcited by 2
  13. 2025AEGIS: An Agent for Extraction and Geographic Identification in Scholarly Proceedingscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EviGraph: Evidence-Guided Autonomous Research Agents
  2. 2026ArcticSwarm: Deferring Early Consensus in Long-Horizon Multi-Agent Research
  3. 2026Sci-MMR: Benchmarking Multi-Step Evidence-Grounded Scientific Reasoning in Multimodal Agents
  4. 2026MiroEval: Benchmarking Multimodal Deep Research Agents in Process and Outcome
  5. 2026SciForge: An AI-Native, Multimodal Workbench for Scientific Discovery
  6. 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite
  7. 2026Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
  8. 2024CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark