LAReQA: Language-agnostic answer retrieval from a multilingual pool
Not on the map. Why?
Abstract (arXiv)
We present LAReQA, a challenging new benchmark for language-agnostic answer retrieval from a multilingual candidate pool. Unlike previous cross-lingual tasks, LAReQA tests for "strong" cross-lingual alignment, requiring semantically related cross-language pairs to be closer in representation space than unrelated same-language pairs. Building on multilingual BERT (mBERT), we study different strategies for achieving strong alignment. We find that augmenting training data via machine translation is effective, and improves significantly over using mBERT out-of-the-box. Interestingly, the embedding baseline that performs the best on LAReQA falls short of competing baselines on zero-shot variants of our task that only target "weak" alignment. This finding underscores our claim that languageagnostic retrieval is a substantively new kind of cross-lingual evaluation.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 3; 2023: 10; 2024: 11; 2025: 3; 2026: 6.
41 papers.
Sort:
By area:
- 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 233
- 2021XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluationcited by 167
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021A Primer on Pretrained Multilingual Language Modelscited by 49
- 2021Revisiting the Primacy of English in Zero-shot Cross-lingual Transfercited by 47
- 2024Understanding Cross-Lingual Alignment -- A Surveycited by 34
- 2023Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrievalcited by 24
- 2021Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglotscited by 23
- 2023Dolphin: A Challenging and Diverse Benchmark for Arabic NLGcited by 22
- 2022Multi Task Learning For Zero Shot Performance Prediction of Multilingual Modelscited by 20
- 2023Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformerscited by 18
- 2024Discovering Low-rank Subspaces for Language-agnostic Multilingual Representationscited by 18
29 more
- 2021A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representationscited by 16
- 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainabilitycited by 15
- 2022Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languagescited by 10
- 2023Soft Prompt Decoding for Multilingual Dense Retrievalcited by 10
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
- 2025XRAG: Cross-lingual Retrieval-Augmented Generationcited by 9
- 2021From Philosophy to Interfaces: an Explanatory Method and a Tool Inspired by Achinstein's Theory of Explanationcited by 8
- 2024How Transliterations Improve Crosslingual Alignmentcited by 6
- 2024Analysis of Multi-Source Language Training in Cross-Lingual Transfercited by 5
- 2024TIGQA:An Expert Annotated Question Answering Dataset in Tigrinyacited by 5
- 2022Multilingual Transformer Encoders: a Word-Level Task-Agnostic Evaluationcited by 4
- 2023Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Datacited by 4
- 2025On the Entity-Level Alignment in Crosslingual Consistencycited by 4
- 2023Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrievalcited by 3
- 2024What is "Typological Diversity" in NLP?cited by 3
- 2024Learning Job Title Representation from Job Description Aggregation Networkcited by 3
- 2023Language Agnostic Code Embeddingscited by 2
- 2024Modular Sentence Encoders: Separating Language Specialization from Cross-Lingual Alignmentcited by 2
- 2023Multilingual Sentence-Level Semantic Search using Meta-Distillation Learningcited by 1
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillationcited by 1
- 2023EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learningcited by 1
- 2024Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrievalcited by 1
- 2025Generative Query Expansion with Multilingual LLMs for Cross-Lingual Information Retrievalcited by 0
- 2026One Instruction Does Not Fit All: How Well Do Embeddings Align Personas and Instructions in Low-Resource Indian Languages?cited by 0
- 2026Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoderscited by 0
- 2026AfrIFact: Cultural Information Retrieval, Evidence Extraction and Fact Checking for African Languagescited by 0
- 2026MIMO: Multilingual Information Retrieval via Monolingual Objectivescited by 0
- 2026SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrievalcited by 0
- 2026There is No Theoretical Curse of Multilinguality For Embedding Space Structurecited by 0
- 2026There is No Theoretical Curse of Multilinguality For Embedding Space Structure17 Aug 2026
- 2026SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrieval17 Jun 2026
- 2026MIMO: Multilingual Information Retrieval via Monolingual Objectives29 May 2026
- 2026AfrIFact: Cultural Information Retrieval, Evidence Extraction and Fact Checking for African Languages1 Apr 2026
- 2026Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders19 Mar 2026
- 2026One Instruction Does Not Fit All: How Well Do Embeddings Align Personas and Instructions in Low-Resource Indian Languages?15 Jan 2026
- 2025Generative Query Expansion with Multilingual LLMs for Cross-Lingual Information Retrieval24 Nov 2025
- 2025On the Entity-Level Alignment in Crosslingual Consistency11 Oct 2025
- 2025XRAG: Cross-lingual Retrieval-Augmented Generation15 May 2025
- 2024How Transliterations Improve Crosslingual Alignment25 Sep 2024
- 2024Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrieval20 Aug 2024
- 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval29 Jul 2024
29 more
- 2024Modular Sentence Encoders: Separating Language Specialization from Cross-Lingual Alignment20 Jul 2024
- 2024Learning Job Title Representation from Job Description Aggregation Network12 Jun 2024
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans6 Jun 2024
- 2024TIGQA:An Expert Annotated Question Answering Dataset in Tigrinya26 Apr 2024
- 2024Understanding Cross-Lingual Alignment -- A Survey9 Apr 2024
- 2024Analysis of Multi-Source Language Training in Cross-Lingual Transfer21 Feb 2024
- 2024What is "Typological Diversity" in NLP?6 Feb 2024
- 2024Discovering Low-rank Subspaces for Language-agnostic Multilingual Representations11 Jan 2024
- 2023Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval10 Nov 2023
- 2023EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning26 Oct 2023
- 2023Language Agnostic Code Embeddings25 Oct 2023
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillation29 Sep 2023
- 2023Multilingual Sentence-Level Semantic Search using Meta-Distillation Learning15 Sep 2023
- 2023Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers5 Jun 2023
- 2023Dolphin: A Challenging and Diverse Benchmark for Arabic NLG24 May 2023
- 2023Soft Prompt Decoding for Multilingual Dense Retrieval15 May 2023
- 2023Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Data9 May 2023
- 2023Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval3 Feb 2023
- 2022Multilingual Transformer Encoders: a Word-Level Task-Agnostic Evaluation19 Jul 2022
- 2022Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages12 May 2022
- 2022Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models12 May 2022
- 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainability11 Sep 2021
- 2021A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations10 Sep 2021
- 2021From Philosophy to Interfaces: an Explanatory Method and a Tool Inspired by Achinstein's Theory of Explanation9 Sep 2021
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension27 Jul 2021
- 2021A Primer on Pretrained Multilingual Language Models1 Jul 2021
- 2021Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer30 Jun 2021
- 2021XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation15 Apr 2021
- 2021Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots17 Mar 2021
- 2025XRAG: Cross-lingual Retrieval-Augmented Generationcited by 9
- 2025XRAG: Cross-lingual Retrieval-Augmented Generation15 May 2025
- 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 233
- 2021XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluationcited by 167
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021A Primer on Pretrained Multilingual Language Modelscited by 49
- 2021Revisiting the Primacy of English in Zero-shot Cross-lingual Transfercited by 47
- 2024Understanding Cross-Lingual Alignment -- A Surveycited by 34
- 2023Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrievalcited by 24
- 2021Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglotscited by 23
- 2023Dolphin: A Challenging and Diverse Benchmark for Arabic NLGcited by 22
- 2022Multi Task Learning For Zero Shot Performance Prediction of Multilingual Modelscited by 20
- 2023Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformerscited by 18
- 2024Discovering Low-rank Subspaces for Language-agnostic Multilingual Representationscited by 18
12 most cited of 39 All 39 (JSON)
- 2026There is No Theoretical Curse of Multilinguality For Embedding Space Structure17 Aug 2026
- 2026SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrieval17 Jun 2026
- 2026MIMO: Multilingual Information Retrieval via Monolingual Objectives29 May 2026
- 2026AfrIFact: Cultural Information Retrieval, Evidence Extraction and Fact Checking for African Languages1 Apr 2026
- 2026Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders19 Mar 2026
- 2026One Instruction Does Not Fit All: How Well Do Embeddings Align Personas and Instructions in Low-Resource Indian Languages?15 Jan 2026
- 2025Generative Query Expansion with Multilingual LLMs for Cross-Lingual Information Retrieval24 Nov 2025
- 2025On the Entity-Level Alignment in Crosslingual Consistency11 Oct 2025
- 2024How Transliterations Improve Crosslingual Alignment25 Sep 2024
- 2024Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrieval20 Aug 2024
- 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval29 Jul 2024
- 2024Modular Sentence Encoders: Separating Language Specialization from Cross-Lingual Alignment20 Jul 2024
12 newest of 39 All 39 (JSON)