Cross-lingual Information Retrieval with BERT
Not on the map. Why?
Abstract (arXiv)
Multiple neural language models have been developed recently, e.g., BERT and XLNet, and achieved impressive results in various NLP tasks including sentence classification, question answering and document ranking. In this paper, we explore the use of the popular bidirectional language model, BERT, to model and learn the relevance between English queries and foreign-language documents in the task of cross-lingual information retrieval. A deep relevance matching model based on BERT is introduced and trained by finetuning a pretrained multilingual BERT model with weak supervision, using home-made CLIR training data derived from parallel corpora. Experimental results of the retrieval of Lithuanian documents against short English queries show that our model is effective and outperforms the competitive baseline approaches.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 4; 2023: 5; 2024: 3; 2025: 3; 2026: 1.
27 papers.
Sort:
By area:
- 2022Transfer Learning Approaches for Building Cross-Language Dense Retrieval Modelscited by 36
- 2021On Cross-Lingual Retrieval with Multilingual Text Encoderscited by 22
- 2022Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrievalcited by 17
- 2021Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrievalcited by 16
- 2021Learning Cross-Lingual IR from an English Retrievercited by 16
- 2022C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrievalcited by 14
- 2022CONCRETE: Improving Cross-lingual Fact-checking with Cross-lingual Retrievalcited by 14
- 2021X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answeringcited by 10
- 2021Graph-based Multilingual Product Retrieval in E-commerce Searchcited by 9
- 2021Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrievalcited by 8
- 2021Mind the Gap: Cross-Lingual Information Retrieval with Hierarchical Knowledge Enhancementcited by 8
- 2024Generative Retrieval as Multi-Vector Dense Retrievalcited by 8
15 more
- 2021Cross-Lingual Training with Dense Retrieval for Document Retrievalcited by 4
- 2023Machine Translation Impact in E-commerce Multilingual Searchcited by 4
- 2023Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Datacited by 4
- 2023Unified Embedding Based Personalized Retrieval in Etsy Searchcited by 4
- 2023Hubness Reduction Improves Sentence-BERT Semantic Spacescited by 4
- 2023ZC3: Zero-Shot Cross-Language Code Clone Detectioncited by 3
- 2024Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labelingcited by 3
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documentscited by 2
- 2025Anveshana: A New Benchmark Dataset for Cross-Lingual Information Retrieval On English Queries and Sanskrit Documentscited by 2
- 2021Leveraging Advantages of Interactive and Non-Interactive Models for Vector-Based Cross-Lingual Information Retrievalcited by 1
- 2021CDA: a Cost Efficient Content-based Multilingual Web Document Alignercited by 0
- 2021Cross-language Information Retrievalcited by 0
- 2024Enhancing E-commerce Product Title Translation with Retrieval-Augmented Generation and Large Language Modelscited by 0
- 2025Exploring new Approaches for Information Retrieval through Natural Language Processingcited by 0
- 2026Enhancing Generative Information Extraction with Two-step Validation: A Product Attribute Use Casecited by 0
- 2026Enhancing Generative Information Extraction with Two-step Validation: A Product Attribute Use Case29 Jul 2026
- 2025Anveshana: A New Benchmark Dataset for Cross-Lingual Information Retrieval On English Queries and Sanskrit Documents26 May 2025
- 2025Exploring new Approaches for Information Retrieval through Natural Language Processing4 May 2025
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents22 Apr 2025
- 2024Enhancing E-commerce Product Title Translation with Retrieval-Augmented Generation and Large Language Models19 Sep 2024
- 2024Generative Retrieval as Multi-Vector Dense Retrieval31 Mar 2024
- 2024Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labeling6 Mar 2024
- 2023Hubness Reduction Improves Sentence-BERT Semantic Spaces30 Nov 2023
- 2023ZC3: Zero-Shot Cross-Language Code Clone Detection26 Aug 2023
- 2023Unified Embedding Based Personalized Retrieval in Etsy Search7 Jun 2023
- 2023Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Data9 May 2023
- 2023Machine Translation Impact in E-commerce Multilingual Search31 Jan 2023
15 more
- 2022CONCRETE: Improving Cross-lingual Fact-checking with Cross-lingual Retrieval5 Sep 2022
- 2022C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrieval25 Apr 2022
- 2022Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval5 Apr 2022
- 2022Transfer Learning Approaches for Building Cross-Language Dense Retrieval Models20 Jan 2022
- 2021Mind the Gap: Cross-Lingual Information Retrieval with Hierarchical Knowledge Enhancement27 Dec 2021
- 2021On Cross-Lingual Retrieval with Multilingual Text Encoders21 Dec 2021
- 2021Learning Cross-Lingual IR from an English Retriever15 Dec 2021
- 2021Cross-language Information Retrieval10 Nov 2021
- 2021Leveraging Advantages of Interactive and Non-Interactive Models for Vector-Based Cross-Lingual Information Retrieval3 Nov 2021
- 2021Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval7 Sep 2021
- 2021Cross-Lingual Training with Dense Retrieval for Document Retrieval3 Sep 2021
- 2021Graph-based Multilingual Product Retrieval in E-commerce Search6 May 2021
- 2021X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering20 Apr 2021
- 2021CDA: a Cost Efficient Content-based Multilingual Web Document Aligner20 Feb 2021
- 2021Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval21 Jan 2021
- 2021Learning Cross-Lingual IR from an English Retrievercited by 16
- 2021Learning Cross-Lingual IR from an English Retriever15 Dec 2021
- 2022Transfer Learning Approaches for Building Cross-Language Dense Retrieval Modelscited by 36
- 2021On Cross-Lingual Retrieval with Multilingual Text Encoderscited by 22
- 2022Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrievalcited by 17
- 2021Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrievalcited by 16
- 2022C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrievalcited by 14
- 2022CONCRETE: Improving Cross-lingual Fact-checking with Cross-lingual Retrievalcited by 14
- 2021X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answeringcited by 10
- 2021Graph-based Multilingual Product Retrieval in E-commerce Searchcited by 9
- 2021Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrievalcited by 8
- 2021Mind the Gap: Cross-Lingual Information Retrieval with Hierarchical Knowledge Enhancementcited by 8
- 2024Generative Retrieval as Multi-Vector Dense Retrievalcited by 8
- 2021Cross-Lingual Training with Dense Retrieval for Document Retrievalcited by 4
12 most cited of 25 All 25 (JSON)
- 2026Enhancing Generative Information Extraction with Two-step Validation: A Product Attribute Use Case29 Jul 2026
- 2025Anveshana: A New Benchmark Dataset for Cross-Lingual Information Retrieval On English Queries and Sanskrit Documents26 May 2025
- 2025Exploring new Approaches for Information Retrieval through Natural Language Processing4 May 2025
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents22 Apr 2025
- 2024Generative Retrieval as Multi-Vector Dense Retrieval31 Mar 2024
- 2024Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labeling6 Mar 2024
- 2023Hubness Reduction Improves Sentence-BERT Semantic Spaces30 Nov 2023
- 2023ZC3: Zero-Shot Cross-Language Code Clone Detection26 Aug 2023
- 2023Unified Embedding Based Personalized Retrieval in Etsy Search7 Jun 2023
- 2023Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Data9 May 2023
- 2023Machine Translation Impact in E-commerce Multilingual Search31 Jan 2023
- 2022CONCRETE: Improving Cross-lingual Fact-checking with Cross-lingual Retrieval5 Sep 2022
12 newest of 25 All 25 (JSON)