Massively Multilingual Word Embeddings
Not on the map. Why?
Abstract (arXiv)
We introduce new methods for estimating and evaluating embeddings of words in more than fifty languages in a single shared embedding space. Our estimation methods, multiCluster and multiCCA, use dictionaries and monolingual data; they do not require parallel data. Our new evaluation method, multiQVEC-CCA, is shown to correlate better than previous ones with two downstream tasks (text categorization and parsing). We also describe a web portal for evaluation that will facilitate further research in this area, along with open-source releases of all our methods.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 5; 2023: 4; 2024: 1; 2025: 2; 2026: 3.
26 papers.
Sort:
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
- 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
- 2021How to Adapt Your Pretrained Multilingual Model to 1600 Languagescited by 54
- 2021AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languagescited by 50
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptationcited by 44
- 2022Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferabilitycited by 26
- 2023Hyperpolyglot LLMs: Cross-Lingual Interpretability in Token Embeddingscited by 19
- 2021Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios?cited by 11
- 2023Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphscited by 11
- 2021Debiasing Multilingual Word Embeddings: A Case Study of Three Indian Languagescited by 8
14 more
- 2021Majority Voting with Bidirectional Pre-translation For Bitext Retrievalcited by 5
- 2021Cross-lingual hate speech detection based on multilingual domain-specific word embeddingscited by 4
- 2025Translate, then Detect: Leveraging Machine Translation for Cross-Lingual Toxicity Classificationcited by 4
- 2021Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddingscited by 3
- 2023GRI: Graph-based Relative Isomorphism of Word Embedding Spacescited by 3
- 2024Ultra-lightweight Neural Differential DSP Vocoder For High Quality Speech Synthesiscited by 2
- 2022Effective Transfer Learning for Low-Resource Natural Language Understandingcited by 1
- 2025Enhancing Multilingual Language Models for Code-Switched Input Datacited by 1
- 2026Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RLcited by 1
- 2021Cross-language Information Retrievalcited by 0
- 2022Third-Party Aligner for Neural Word Alignmentscited by 0
- 2023PESTS: Persian_English Cross Lingual Corpus for Semantic Textual Similaritycited by 0
- 2026Effective vocabulary expansion of multilingual language models for extremely low-resource languagescited by 0
- 2026TypeProbe: Recovering Type Representations from Hidden States of Pre-trained Code Modelscited by 0
- 2026TypeProbe: Recovering Type Representations from Hidden States of Pre-trained Code Models9 Jul 2026
- 2026Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL22 Apr 2026
- 2026Effective vocabulary expansion of multilingual language models for extremely low-resource languages10 Feb 2026
- 2025Translate, then Detect: Leveraging Machine Translation for Cross-Lingual Toxicity Classification17 Sep 2025
- 2025Enhancing Multilingual Language Models for Code-Switched Input Data11 Mar 2025
- 2024Ultra-lightweight Neural Differential DSP Vocoder For High Quality Speech Synthesis19 Jan 2024
- 2023Hyperpolyglot LLMs: Cross-Lingual Interpretability in Token Embeddings29 Nov 2023
- 2023GRI: Graph-based Relative Isomorphism of Word Embedding Spaces18 Oct 2023
- 2023Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs22 May 2023
- 2023PESTS: Persian_English Cross Lingual Corpus for Semantic Textual Similarity13 May 2023
- 2022Third-Party Aligner for Neural Word Alignments8 Nov 2022
- 2022Effective Transfer Learning for Low-Resource Natural Language Understanding19 Aug 2022
14 more
- 2022Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability21 Mar 2022
- 2022Challenges and Strategies in Cross-Cultural NLP18 Mar 2022
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation17 Mar 2022
- 2021Cross-language Information Retrieval10 Nov 2021
- 2021Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios?26 Oct 2021
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Dataset31 Aug 2021
- 2021Debiasing Multilingual Word Embeddings: A Case Study of Three Indian Languages21 Jul 2021
- 2021How to Adapt Your Pretrained Multilingual Model to 1600 Languages3 Jun 2021
- 2021Cross-lingual hate speech detection based on multilingual domain-specific word embeddings30 Apr 2021
- 2021AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages18 Apr 2021
- 2021BERT: A Review of Applications in Natural Language Processing and Understanding22 Mar 2021
- 2021Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings11 Mar 2021
- 2021Majority Voting with Bidirectional Pre-translation For Bitext Retrieval10 Mar 2021
- 2021Word Alignment by Fine-tuning Embeddings on Parallel Corpora20 Jan 2021
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
- 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
- 2021How to Adapt Your Pretrained Multilingual Model to 1600 Languagescited by 54
- 2021AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languagescited by 50
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptationcited by 44
- 2022Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferabilitycited by 26
- 2023Hyperpolyglot LLMs: Cross-Lingual Interpretability in Token Embeddingscited by 19
- 2021Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios?cited by 11
- 2023Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphscited by 11
- 2021Debiasing Multilingual Word Embeddings: A Case Study of Three Indian Languagescited by 8
12 most cited of 26 All 26 (JSON)
- 2026TypeProbe: Recovering Type Representations from Hidden States of Pre-trained Code Models9 Jul 2026
- 2026Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL22 Apr 2026
- 2026Effective vocabulary expansion of multilingual language models for extremely low-resource languages10 Feb 2026
- 2025Translate, then Detect: Leveraging Machine Translation for Cross-Lingual Toxicity Classification17 Sep 2025
- 2025Enhancing Multilingual Language Models for Code-Switched Input Data11 Mar 2025
- 2024Ultra-lightweight Neural Differential DSP Vocoder For High Quality Speech Synthesis19 Jan 2024
- 2023Hyperpolyglot LLMs: Cross-Lingual Interpretability in Token Embeddings29 Nov 2023
- 2023GRI: Graph-based Relative Isomorphism of Word Embedding Spaces18 Oct 2023
- 2023Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs22 May 2023
- 2023PESTS: Persian_English Cross Lingual Corpus for Semantic Textual Similarity13 May 2023
- 2022Third-Party Aligner for Neural Word Alignments8 Nov 2022
- 2022Effective Transfer Learning for Low-Resource Natural Language Understanding19 Aug 2022
12 newest of 26 All 26 (JSON)