L"etzCross: A Cross-Lingual Page-Level Benchmark for Multimodal Retrieval over Luxembourgish Documents
Not on the map. Why?
Abstract (arXiv)
Recent page-image retrievers such as ColPali have improved retrieval over visually rich documents, yet little is known about how they behave in cross-lingual, low-resource settings. We introduce L"etzCross, a benchmark for cross-lingual page-level retrieval over Luxembourgish PDF documents, with document pages indexed as images and queries provided in English, French, German, and Luxembourgish. The benchmark combines text-focused QA pairs with visually grounded QA pairs, covering both textual and visual retrieval needs in PDF-based RAG. We use L"etzCross to compare OCR-based text-only retrievers with ColPali-style page-image retrievers and find that the latter perform better across query languages in this system-level comparison. We also examine single-language and multilingual fine-tuning. Fine-tuning transfers across query languages, with French yielding the highest mean performance on Luxembourgish queries among the single-language settings. In the multilingual setting, including Luxembourgish gives the strongest results and substantially improves retrieval for Luxembourgish queries.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
10 of 20 references.
References · 10
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
- 2024Unifying Multimodal Retrieval via Document Screenshot Embeddingcited by 107
- 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarioscited by 22
- 2024LuxBank: The First Universal Dependency Treebank for Luxembourgishcited by 9
- 2024Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labelingcited by 3
- 2024Forget NLI, Use a Dictionary: Zero-Shot Topic Classification for Low-Resource Languages with Application to Luxembourgishcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025VisR-Bench: An Empirical Study on Visual Retrieval-Augmented Generation for Multilingual Long Document Understanding
- 2026MIDR: Enrichment-Augmented Indexing for Multimodal Document Retrieval
- 2025Roles of MLLMs in Visually Rich Document Retrieval for RAG: A Survey
- 2026Retrieval or Representation? Reassessing Benchmark Gaps in Multilingual and Visually Rich RAG
- 2025MIRACL-VISION: A Large, multilingual, visual document retrieval benchmark
- 2025Are We on the Right Way for Assessing Document Retrieval-Augmented Generation?
- 2025UNIDOC-BENCH: A Unified Benchmark for Document-Centric Multimodal RAG
- 2024SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding