mRobust04: A Multilingual Version of the TREC Robust 2004 Benchmark
Not on the map. Why?
Abstract (arXiv)
Robust 2004 is an information retrieval benchmark whose large number of judgments per query make it a reliable evaluation dataset. In this paper, we present mRobust04, a multilingual version of Robust04 that was translated to 8 languages using Google Translate. We also provide results of three different multilingual retrievers on this dataset. The dataset is available at https://huggingface.co/datasets/unicamp-dl/mrobust
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 8 of its 22 references that are in the map. First posted on arXiv 27 Sep 2022.
Builds on
8 of 22 references.
References · 8
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2020Pretrained Transformers for Text Ranking: BERT and Beyondcited by 267
- 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 119
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2021TREC Deep Learning Track: Reusable Test Collections in the Large Data Regimecited by 23
- 2022No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrievalcited by 17
- 2022HC4: A New Suite of Test Collections for Ad Hoc CLIRcited by 10
- 2022Can Old TREC Collections Reliably Evaluate Modern Neural Retrieval Models?cited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.
- 2024ptt5-v2: A Closer Look at Continued Pretraining of T5 Models for the Portuguese Languagecited by 8
- 2026Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Modelscited by 0
- 2026moBERTo: A Modern Encoder for Portuguese via Continued Pretraining of ModernBERTcited by 0
- 2026moBERTo: A Modern Encoder for Portuguese via Continued Pretraining of ModernBERT21 Jun 2026
- 2026Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models27 Apr 2026
- 2024ptt5-v2: A Closer Look at Continued Pretraining of T5 Models for the Portuguese Language16 Jun 2024