mlsanityData to 7 Oct 2026

Multilingual Universal Sentence Encoder for Semantic Retrieval

arXiv 1907.04307 ↗First posted 9 Jul 2019cs.CLcited by 192

Not on the map. Why?

Abstract (arXiv)

We introduce two pre-trained retrieval focused multilingual sentence encoding models, respectively based on the Transformer and CNN model architectures. The models embed text from 16 languages into a single semantic space using a multi-task trained dual-encoder that learns tied representations using translation based bridge tasks (Chidambaram al., 2018). The models provide performance that is competitive with the state-of-the-art on: semantic retrieval (SR), translation pair bitext retrieval (BR) and retrieval question answering (ReQA). On English transfer learning tasks, our sentence-level embeddings approach, and in some cases exceed, the performance of monolingual, English only, sentence embedding models. Our models are made available for download on TensorFlow Hub.

Key facts. Cited by 192 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jul 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 42; 2022: 37; 2023: 53; 2024: 43; 2025: 12; 2026: 4.

192 papers.

Sort:

By area:

  1. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  2. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  3. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  4. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
  5. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
  6. 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
  7. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  8. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  9. 2020Language Conditioned Imitation Learning over Unstructured Datacited by 208
  10. 2021A Survey of Zero-shot Generalisation in Deep Reinforcement Learningcited by 164
  11. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  12. 2021TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learningcited by 116
38 more
  1. 2024Steering Your Generalists: Improving Robotic Foundation Models via Value Guidancecited by 100
  2. 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
  3. 2022Instruction-driven history-aware policies for robotic manipulationscited by 93
  4. 2023Dense X Retrieval: What Retrieval Granularity Should We Use?cited by 88
  5. 2022AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilitiescited by 84
  6. 2024MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizercited by 80
  7. 2024In-context Learning with Retrieved Demonstrations for Language Models: A Surveycited by 69
  8. 2021AraT5: Text-to-Text Transformers for Arabic Language Generationcited by 63
  9. 2021Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuningcited by 46
  10. 2021MURAL: Multimodal, Multitask Retrieval Across Languagescited by 44
  11. 2021A Statutory Article Retrieval Dataset in Frenchcited by 40
  12. 2021TWEAC: Transformer with Extendable QA Agent Classifierscited by 37
  13. 2021Multilingual and Cross-Lingual Intent Detection from Spoken Datacited by 35
  14. 2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translationscited by 35
  15. 2023Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Modelscited by 35
  16. 2022XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsingcited by 32
  17. 2023Goal Representations for Instruction Following: A Semi-Supervised Language Interface to Controlcited by 32
  18. 2024DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perceptioncited by 32
  19. 2023A Family of Pretrained Transformer Language Models for Russiancited by 27
  20. 2022English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddingscited by 26
  21. 2021ConvFiT: Conversational Fine-Tuning of Pretrained Language Modelscited by 25
  22. 2021Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factorscited by 25
  23. 2023PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillationcited by 25
  24. 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verificationcited by 25
  25. 2023Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Informationcited by 24
  26. 2022Cross-Lingual Dialogue Dataset Creation via Outline-Based Generationcited by 23
  27. 2021On Cross-Lingual Retrieval with Multilingual Text Encoderscited by 22
  28. 2022Cross-Lingual Cross-Modal Retrieval with Noise-Robust Learningcited by 22
  29. 2023Assessing Large Language Models on Climate Informationcited by 22
  30. 2023Exploring Zero and Few-shot Techniques for Intent Classificationcited by 21
  31. 2021Few-shot Controllable Style Transfer for Low-Resource Multilingual Settingscited by 20
  32. 2022Exploring Dual Encoder Architectures for Question Answeringcited by 19
  33. 2024Authorship Obfuscation in Multilingual Machine-Generated Text Detectioncited by 19
  34. 2024Policy Adaptation via Language Optimization: Decomposing Tasks for Few-Shot Imitationcited by 18
  35. 2023Domain Terminology Integration into Machine Translation: Leveraging Large Language Modelscited by 17
  36. 2021Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrievalcited by 16
  37. 2021A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representationscited by 16
  38. 2022BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metriccited by 16

50 most cited of 192 All 192 (JSON)