mlsanityData to 7 Oct 2026

ViDoRe Benchmark V2: Raising the Bar for Visual Retrieval

arXiv 2505.17166 ↗First posted 22 May 2025cs.IRcited by 58

Not on the map. Why?

Abstract (arXiv)

The ViDoRe Benchmark V1 was approaching saturation with top models exceeding 90% nDCG@5, limiting its ability to discern improvements. ViDoRe Benchmark V2 introduces realistic, challenging retrieval scenarios via blind contextual querying, long and cross-document queries, and a hybrid synthetic and human-in-the-loop query generation process. It comprises four diverse, multilingual datasets and provides clear evaluation instructions. Initial results demonstrate substantial room for advancement and highlight insights on model generalization and multilingual capability. This benchmark is designed as a living resource, inviting community contributions to maintain relevance through future evaluations.

Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 13; 2026: 45.

58 papers.

Sort:

By area:

  1. 2025VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documentscited by 110
  2. 2025MetaEmbed: Scaling Multimodal Retrieval at Test-Time with Flexible Late Interactioncited by 36
  3. 2025Llama Nemoretriever Colembed: Top-Performing Text-Image Retrieval Modelcited by 24
  4. 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarioscited by 22
  5. 2025DocPruner: A Storage-Efficient Framework for Multi-Vector Visual Document Retrieval via Adaptive Patch-Level Embedding Pruningcited by 19
  6. 2025ModernVBERT: Towards Smaller Visual Document Retrieverscited by 19
  7. 2025MRMR: A Realistic and Expert-Level Multidisciplinary Benchmark for Reasoning-Intensive Multimodal Retrievalcited by 12
  8. 2025Guided Query Refinement: Multimodal Hybrid Retrieval with Test-Time Optimizationcited by 10
  9. 2026Nemotron ColEmbed V2: Top-Performing Late Interaction Embedding Models for Visual Document Retrievalcited by 8
  10. 2026Sculpting the Vector Space: Towards Efficient Multi-Vector Visual Document Retrieval via Prune-then-Merge Frameworkcited by 8
  11. 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrievalcited by 8
  12. 2026Multi-Vector Index Compression in Any Modalitycited by 8
38 more
  1. 2025Supervised Fine-Tuning or Contrastive Learning? Towards Better Multimodal LLM Rerankingcited by 6
  2. 2026Structural Anchor Pruning: Training-Free Multi-Vector Compression for Visual Document Retrievalcited by 6
  3. 2026CausalEmbed: Auto-Regressive Multi-Vector Generation in Latent Space for Visual Document Embeddingcited by 6
  4. 2026LMEB: Long-horizon Memory Embedding Benchmarkcited by 6
  5. 2026Visual Late Chunking: An Empirical Study of Contextual Chunking for Efficient Visual Document Retrievalcited by 6
  6. 2025Are We on the Right Way for Assessing Document Retrieval-Augmented Generation?cited by 5
  7. 2026Gemini Embedding 2: A Native Multimodal Embedding Model from Geminicited by 5
  8. 2026jina-embeddings-v5-omni: Geometry-preserving Embeddings via Locked Aligned Towerscited by 4
  9. 2026WeMM-Embedding: WeChat Multi-Modal Embedding Technical Reportcited by 4
  10. 2025Annotation-Free Reinforcement Learning Query Rewriting via Verifiable Search Rewardcited by 3
  11. 2025Attention Grounded Enhancement for Visual Document Retrievalcited by 3
  12. 2026Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMscited by 3
  13. 2026Beyond the Grid: Layout-Informed Multi-Vector Retrieval with Parsed Visual Document Representationscited by 3
  14. 2026ReAlign: Optimizing the Visual Document Retriever with Reasoning-Guided Fine-Grained Alignmentcited by 3
  15. 2025M3DR: Towards Universal Multilingual Multimodal Document Retrievalcited by 2
  16. 2026IRPAPERS: A Visual Document Benchmark for Scientific Retrieval and Question Answeringcited by 2
  17. 2026NanoVDR: Distilling a 2B Vision-Language Retriever into a 70M Text-Only Encoder for Visual Document Retrievalcited by 2
  18. 2026MINER: Mining Multimodal Internal Representation for Efficient Retrievalcited by 2
  19. 2026MM-Matryoshka: Towards Budget-Elastic Visual Document Retrieval via a 2D Multimodal Matryoshka Training Frameworkcited by 2
  20. 2026PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generationcited by 2
  21. 2026EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrievalcited by 2
  22. 2026MURE: Hierarchical Multi-Resolution Encoding via Vision-Language Models for Visual Document Retrievalcited by 1
  23. 2026Document Optimization for Black-Box Retrieval via Reinforcement Learningcited by 1
  24. 2026Document-as-Image Representations Fall Short for Scientific Retrievalcited by 1
  25. 2026MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&Acited by 1
  26. 2026AnchorFold: A Focus-Then-Fold Framework via Recursive Attention Propagation for Efficient Multi-Vector Visual Document Retrievalcited by 1
  27. 2025Exploration of Augmentation Strategies in Multi-modal Retrieval-Augmented Generation for the Biomedical Domain: A Case Study Evaluating Question Answering in Glycobiologycited by 0
  28. 2026Visual RAG Toolkit: Scaling Multi-Vector Visual Retrieval with Training-Free Pooling and Multi-Stage Searchcited by 0
  29. 2026Evo-Retriever: LLM-Guided Curriculum Evolution with Viewpoint-Pathway Collaboration for Multimodal Document Retrievalcited by 0
  30. 2026Spike Hijacking in Late-Interaction Retrievalcited by 0
  31. 2026Beyond Bag-of-Patches: Learning Global Layout via Textual Supervision for Late-Interaction Visual Document Retrievalcited by 0
  32. 2026LFRAG: Layout-oriented Fine-grained Retrieval-Augmented Generation on Multimodal Document Understandingcited by 0
  33. 2026DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmarkcited by 0
  34. 2026Inference-Free Multimodal Learned Sparse Retrieval for Production-Scale Visual Document Searchcited by 0
  35. 2026CMDR: Contextual Multimodal Document Retrievalcited by 0
  36. 2026VaRS-Doc: Interpretation-Aware Variant Representations via Latent Self-Probing for Visual Document Retrievalcited by 0
  37. 2026KoVRE: Training an Efficient Embedding Model for Korean Visual Document Retrievalcited by 0
  38. 2026DocAtlas: Long-Document Understanding as Mutable-State Interactioncited by 0

50 most cited of 58 All 58 (JSON)