mlsanityData to 7 Oct 2026

Multistage BiCross encoder for multilingual access to COVID-19 health information

arXiv 2101.03013 ↗First posted 8 Jan 2021cs.AI cs.IR cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

The Coronavirus (COVID-19) pandemic has led to a rapidly growing 'infodemic' of health information online. This has motivated the need for accurate semantic search and retrieval of reliable COVID-19 information across millions of documents, in multiple languages. To address this challenge, this paper proposes a novel high precision and high recall neural Multistage BiCross encoder approach. It is a sequential three-stage ranking pipeline which uses the Okapi BM25 retrieval algorithm and transformer-based bi-encoder and cross-encoder to effectively rank the documents with respect to the given query. We present experimental results from our participation in the Multilingual Information Access (MLIA) shared task on COVID-19 multilingual semantic search. The independently evaluated MLIA results validate our approach and demonstrate that it outperforms other state-of-the-art approaches according to nearly all evaluation metrics in cases of both monolingual and bilingual runs.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 41 references that are in the map. First posted on arXiv 8 Jan 2021.

Builds on

18 of 41 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  8. 2017Billion-scale similarity search with GPUscited by 2,477
  9. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  10. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  11. 2019Passage Re-ranking with BERTcited by 629
  12. 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 373
6 more
  1. 2019Simple Applications of BERT for Ad Hoc Document Retrievalcited by 34
  2. 2020Covidex: Neural Ranking Models and Keyword Search Infrastructure for the COVID-19 Open Research Datasetcited by 15
  3. 2019Let's measure run time! Extending the IR replicability infrastructure to include performance aspectscited by 10
  4. 2019Cross-Lingual Relevance Transfer for Document Retrievalcited by 9
  5. 2020SLEDGE-Z: A Zero-Shot Baseline for COVID-19 Literature Searchcited by 6
  6. 2018Evaluating Sentence-Level Relevance Feedback for High-Recall Information Retrievalcited by 2

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 1; 2023: 1.

3 papers.