mlsanityData to 7 Oct 2026

Learning Cross-Lingual Sentence Representations via a Multi-task Dual-Encoder Model

arXiv 1810.12836 ↗First posted 30 Oct 2018cs.CLcited by 46

Not on the map. Why?

Abstract (arXiv)

A significant roadblock in multilingual neural language modeling is the lack of labeled non-English data. One potential method for overcoming this issue is learning cross-lingual text representations that can be used to transfer the performance from training on English tasks to non-English tasks, despite little to no task-specific non-English data. In this paper, we explore a natural setup for learning cross-lingual sentence representations: the dual-encoder. We provide a comprehensive evaluation of our cross-lingual representations on a number of monolingual, cross-lingual, and zero-shot/few-shot learning tasks, and also give an analysis of different learned cross-lingual embedding spaces.

Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Oct 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 24; 2022: 11; 2023: 5; 2024: 6.

46 papers.

Sort:

By area:

  1. 2024User-LLM: Efficient LLM Contextualization with User Embeddingscited by 74
  2. 2021Multilingual and Cross-Lingual Intent Detection from Spoken Datacited by 35
  3. 2021Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrievalcited by 27
  4. 2021Are Pre-trained Convolutions Better than Pre-trained Transformers?cited by 27
  5. 2022English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddingscited by 26
  6. 2021ConvFiT: Conversational Fine-Tuning of Pretrained Language Modelscited by 25
  7. 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factorscited by 25
  8. 2021On Cross-Lingual Retrieval with Multilingual Text Encoderscited by 22
  9. 2021Paraphrastic Representations at Scalecited by 19
  10. 2022Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curriculacited by 17
  11. 2021Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrievalcited by 16
  12. 2021A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representationscited by 16
34 more
  1. 2021Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis Modelcited by 13
  2. 2022Detecting Text Formality: A Study of Text Classification Approachescited by 11
  3. 2023Language Models are Universal Embedderscited by 11
  4. 2021A Dataset and Baselines for Multilingual Reply Suggestioncited by 9
  5. 2021Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversationscited by 9
  6. 2023Dual-Alignment Pre-training for Cross-lingual Sentence Embeddingcited by 9
  7. 2024LuxEmbedder: A Cross-Lingual Approach to Enhanced Luxembourgish Sentence Embeddingscited by 7
  8. 2021NewsEmbed: Modeling News through Pre-trained Document Representationscited by 6
  9. 2021Learning Federated Representations and Recommendations with Limited Negativescited by 6
  10. 2021Lightweight Cross-Lingual Sentence Representation Learningcited by 5
  11. 2021PAUSE: Positive and Annealed Unlabeled Sentence Embeddingcited by 5
  12. 2021Towards Zero-shot Cross-lingual Image Retrieval and Taggingcited by 4
  13. 2022Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representationcited by 4
  14. 2024Improving Multi-lingual Alignment Through Soft Contrastive Learningcited by 4
  15. 2021A Neighbourhood Framework for Resource-Lean Content Flaggingcited by 3
  16. 2022Multi-task Learning for Cross-Lingual Sentiment Analysiscited by 3
  17. 2021Deception detection in text and its relation to the cultural dimension of individualism/collectivismcited by 2
  18. 2022Cross-Lingual Phrase Retrievalcited by 2
  19. 2024Fine-tuning the SwissBERT Encoder Model for Embedding Sentences and Documentscited by 2
  20. 2021Leveraging Advantages of Interactive and Non-Interactive Models for Vector-Based Cross-Lingual Information Retrievalcited by 1
  21. 2022EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learningcited by 1
  22. 2022GROWN+UP: A Graph Representation Of a Webpage Network Utilizing Pre-trainingcited by 1
  23. 2022Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matchingcited by 1
  24. 2024Cross-lingual Contextualized Phrase Retrievalcited by 1
  25. 2021Unbiased Sentence Encoder For Large-Scale Multi-lingual Search Enginescited by 0
  26. 2021Classification of Consumer Belief Statements From Social Mediacited by 0
  27. 2021A Case Study and Qualitative Analysis of Simple Cross-Lingual Opinion Miningcited by 0
  28. 2021How to Build Robust FAQ Chatbot with Controllable Question Generator?cited by 0
  29. 2022Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learningcited by 0
  30. 2022Multilingual News Location Detection using an Entity-Based Siamese Network with Semi-Supervised Contrastive Learning and Knowledge Basecited by 0
  31. 2023PESTS: Persian_English Cross Lingual Corpus for Semantic Textual Similaritycited by 0
  32. 2023Retrieval-based Text Selection for Addressing Class-Imbalanced Data in Classificationcited by 0
  33. 2023Differentially Private Optimization for Non-Decomposable Objective Functionscited by 0
  34. 2024Domain Adaptation of Multilingual Semantic Search -- Literature Reviewcited by 0