Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1)
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
Retrieval over visually-rich documents, pages that interleave text with figures, tables, and charts, is essential for multimodal retrieval-augmented generation, yet most retrievers still discard the visual channel. The Multimodal Document Retrieval Challenge, Track~1 of the MIR Challenge at the first EReL@MIR workshop, co-located with The Web Conference 2025, asks participants to build a single retrieval system that handles two complementary regimes: closed-set document page retrieval within long documents from a text query (MMDocIR), and open-domain retrieval of Wikipedia-style passages from an image or image-plus-text query (M2KR). Systems are ranked by the macro-average of mean Recall@1,3,5 over the two tasks. The challenge drew 455 entrants and 586 submissions across 22 teams. This report describes the challenge design, datasets, and evaluation protocol; reports the final standings; and analyses the three winning teams' systems. All three build on decoder-based Multimodal-LLM embedders from the Qwen2-VL family rather than on CLIP-style encoders, and differ chiefly in whether they reach the top through fine-tuned ensembles, training-free multi-route fusion with a strong vision-language re-ranker, or zero-shot late interaction. The training-free system finished within 0.1 point of the fine-tuned winner.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 13 of its 26 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
13 of 26 references.
Closest ancestors · 2
Same direction, newest first
- 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understanding7 Nov
- 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categories15 Jun
Other references · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2021WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learningcited by 287
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
- 2023Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entitiescited by 113
- 2024Unifying Multimodal Retrieval via Document Screenshot Embeddingcited by 110
- 2024VISTA: Visualized Text Embedding For Universal Multi-Modal Retrievalcited by 67
- 2024PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrieverscited by 42
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documents
- 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval
- 2025Roles of MLLMs in Visually Rich Document Retrieval for RAG: A Survey
- 2025Towards Text-Image Interleaved Retrieval
- 2025Docopilot: Improving Multimodal Models for Document-Level Understanding
- 2026IRPAPERS: A Visual Document Benchmark for Scientific Retrieval and Question Answering
- 2024Unified Multimodal Interleaved Document Representation for Retrieval
- 2025DocMMIR: A Framework for Document Multi-modal Information Retrieval