mlsanityData to 14 Oct 2026

Domain Adaptation of Multilingual Semantic Search -- Literature Review

arXiv 2402.02932 ↗First posted 5 Feb 2024cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This literature review gives an overview of current approaches to perform domain adaptation in a low-resource and approaches to perform multilingual semantic search in a low-resource setting. We developed a new typology to cluster domain adaptation approaches based on the part of dense textual information retrieval systems, which they adapt, focusing on how to combine them efficiently. We also explore the possibilities of combining multilingual semantic search with domain adaptation approaches for dense retrievers in a low-resource setting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 132 of its 195 references that are in the map. First posted on arXiv 5 Feb 2024.

Builds on

132 of 195 references.

References · 132

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  8. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  9. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  10. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  11. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  12. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
38 more
  1. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  2. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  3. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  4. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  5. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
  6. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
  7. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  8. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  9. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  10. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  11. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
  12. 2021GPT Understands, Toocited by 716
  13. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
  14. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
  15. 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
  16. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
  17. 2021Large Dual Encoders Are Generalizable Retrieverscited by 456
  18. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  19. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
  20. 2021SPLADE: Sparse Lexical and Expansion Model for First Stage Rankingcited by 286
  21. 2021Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Samplingcited by 238
  22. 2021ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfercited by 231
  23. 2017Efficient Natural Language Response Suggestion for Smart Replycited by 229
  24. 2020Distilling Knowledge from Reader to Retriever for Question Answeringcited by 226
  25. 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 214
  26. 2021Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrievalcited by 203
  27. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
  28. 2019Multilingual Universal Sentence Encoder for Semantic Retrievalcited by 193
  29. 2013Exploiting Similarities among Languages for Machine Translationcited by 191
  30. 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 176
  31. 2021Condenser: a Pre-training Architecture for Dense Retrievalcited by 162
  32. 2021Optimizing Dense Retrieval Model Training with Hard Negativescited by 155
  33. 2020Pre-training Tasks for Embedding-based Large-scale Retrievalcited by 153
  34. 2020Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillationcited by 145
  35. 2020Neural Unsupervised Domain Adaptation in NLP---A Surveycited by 144
  36. 2019Synthetic QA Corpora Generation with Roundtrip Consistencycited by 143
  37. 2020Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Taskscited by 138
  38. 2022Dense Text Retrieval based on Pretrained Language Models: A Surveycited by 136

50 most cited of 132 All 132 (JSON)

Built on by

Not cited yet.