mlsanityData to 14 Oct 2026

mRobust04: A Multilingual Version of the TREC Robust 2004 Benchmark

arXiv 2209.13738 ↗First posted 27 Sep 2022cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Robust 2004 is an information retrieval benchmark whose large number of judgments per query make it a reliable evaluation dataset. In this paper, we present mRobust04, a multilingual version of Robust04 that was translated to 8 languages using Google Translate. We also provide results of three different multilingual retrievers on this dataset. The dataset is available at https://huggingface.co/datasets/unicamp-dl/mrobust

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 8 of its 22 references that are in the map. First posted on arXiv 27 Sep 2022.

Builds on

8 of 22 references.

References · 8

  1. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
  2. 2020Pretrained Transformers for Text Ranking: BERT and Beyondcited by 267
  3. 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 119
  4. 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
  5. 2021TREC Deep Learning Track: Reusable Test Collections in the Large Data Regimecited by 23
  6. 2022No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrievalcited by 17
  7. 2022HC4: A New Suite of Test Collections for Ad Hoc CLIRcited by 10
  8. 2022Can Old TREC Collections Reliably Evaluate Modern Neural Retrieval Models?cited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 2.

3 papers.