mlsanityData to 14 Oct 2026

Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1)

arXiv 2606.04240 ↗First posted 2 Jun 2026cs.CV cs.AI cs.CLcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

Retrieval over visually-rich documents, pages that interleave text with figures, tables, and charts, is essential for multimodal retrieval-augmented generation, yet most retrievers still discard the visual channel. The Multimodal Document Retrieval Challenge, Track~1 of the MIR Challenge at the first EReL@MIR workshop, co-located with The Web Conference 2025, asks participants to build a single retrieval system that handles two complementary regimes: closed-set document page retrieval within long documents from a text query (MMDocIR), and open-domain retrieval of Wikipedia-style passages from an image or image-plus-text query (M2KR). Systems are ranked by the macro-average of mean Recall@1,3,5 over the two tasks. The challenge drew 455 entrants and 586 submissions across 22 teams. This report describes the challenge design, datasets, and evaluation protocol; reports the final standings; and analyses the three winning teams' systems. All three build on decoder-based Multimodal-LLM embedders from the Qwen2-VL family rather than on CLIP-style encoders, and differ chiefly in whether they reach the top through fine-tuned ensembles, training-free multi-route fusion with a strong vision-language re-ranker, or zero-shot late interaction. The training-free system finished within 0.1 point of the fine-tuned winner.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 13 of its 26 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

13 of 26 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understanding7 Nov
  2. 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categories15 Jun

Other references · 11

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  4. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  5. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  6. 2021WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learningcited by 287
  7. 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
  8. 2023Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entitiescited by 113
  9. 2024Unifying Multimodal Retrieval via Document Screenshot Embeddingcited by 110
  10. 2024VISTA: Visualized Text Embedding For Universal Multi-Modal Retrievalcited by 67
  11. 2024PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrieverscited by 42

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documents
  2. 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval
  3. 2025Roles of MLLMs in Visually Rich Document Retrieval for RAG: A Survey
  4. 2025Towards Text-Image Interleaved Retrieval
  5. 2025Docopilot: Improving Multimodal Models for Document-Level Understanding
  6. 2026IRPAPERS: A Visual Document Benchmark for Scientific Retrieval and Question Answering
  7. 2024Unified Multimodal Interleaved Document Representation for Retrieval
  8. 2025DocMMIR: A Framework for Document Multi-modal Information Retrieval