mlsanityData to 14 Oct 2026

Bitext Mining for Low-Resource Languages via Contrastive Learning

arXiv 2208.11194 ↗First posted 23 Aug 2022cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Mining high-quality bitexts for low-resource languages is challenging. This paper shows that sentence representation of language models fine-tuned with multiple negatives ranking loss, a contrastive objective, helps retrieve clean bitexts. Experiments show that parallel data mined from our approach substantially outperform the previous state-of-the-art method on low resource languages Khmer and Pashto.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 23 Aug 2022.

Builds on

10 of 25 references.

References · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  6. 2017Billion-scale similarity search with GPUscited by 2,497
  7. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  8. 2017Efficient Natural Language Response Suggestion for Smart Replycited by 229
  9. 2018Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddingscited by 83
  10. 2018Dual Conditional Cross-Entropy Filtering of Noisy Parallel Corporacited by 40

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 0; 2026: 1.

5 papers.

  1. 2023L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERTcited by 15
  2. 2022Multilingual Representation Distillation with Contrastive Learningcited by 11
  3. 2023Soft Prompt Decoding for Multilingual Dense Retrievalcited by 10
  4. 2024Direct Speech-to-Speech Neural Machine Translation: A Surveycited by 6
  5. 2026ViCLSR: A Supervised Contrastive Learning Framework with Natural Language Inference for Natural Language Understanding Taskscited by 0