# Polyglot: Distributed Word Representations for Multilingual NLP

arXiv: https://arxiv.org/abs/1307.1662 · HTML: https://mlsanity.com/paper/1307.1662/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Jul 2013.

## Built on by (most cited first, 19 of 19)

- [Towards a Cleaner Document-Oriented Multilingual Crawled Corpus](https://mlsanity.com/paper/2201.06642/) (2022)
- [DaCy: A Unified Framework for Danish NLP](https://mlsanity.com/paper/2107.05295/) (2021)
- [Vacaspati: A Diverse Corpus of Bangla Literature](https://mlsanity.com/paper/2307.05083/) (2023)
- [Offense Detection in Dravidian Languages using Code-Mixing Index based Focal Loss](https://mlsanity.com/paper/2111.06916/) (2021)
- [Dependency Parsing with Bottom-up Hierarchical Pointer Networks](https://mlsanity.com/paper/2105.09611/) (2021)
- [UzBERT: pretraining a BERT model for Uzbek](https://mlsanity.com/paper/2108.09814/) (2021)
- [Overview of GUA-SPA at IberLEF 2023: Guarani-Spanish Code Switching Analysis](https://mlsanity.com/paper/2309.06163/) (2023)
- [Blending gradient boosted trees and neural networks for point and probabilistic forecasting of hierarchical time series](https://mlsanity.com/paper/2310.13029/) (2023)
- [Learning to Make Compiler Optimizations More Effective](https://mlsanity.com/paper/2102.13514/) (2021)
- [Can we obtain significant success in RST discourse parsing by using Large Language Models?](https://mlsanity.com/paper/2403.05065/) (2024)
- [LAWDR: Language-Agnostic Weighted Document Representations from Pre-trained Models](https://mlsanity.com/paper/2106.03379/) (2021)
- [Cross-Lingual and Cross-Domain Crisis Classification for Low-Resource Scenarios](https://mlsanity.com/paper/2209.02139/) (2022)
- [Optimal Size-Performance Tradeoffs: Weighing PoS Tagger Models](https://mlsanity.com/paper/2104.07951/) (2021)
- [COSMMIC: Comment-Sensitive Multimodal Multilingual Indian Corpus for Summarization and Headline Generation](https://mlsanity.com/paper/2506.15372/) (2025)
- [From Fragments to Facts: A Curriculum-Driven DPO Approach for Generating Hindi News Veracity Explanations](https://mlsanity.com/paper/2507.05179/) (2025)
- [Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL](https://mlsanity.com/paper/2604.20835/) (2026)
- [TurkicNLP: An NLP Toolkit for Turkic Languages](https://mlsanity.com/paper/2602.19174/) (2026)
- [Priberam Labs at the NTCIR-15 SHINRA2020-ML: Classification Task](https://mlsanity.com/paper/2105.05605/) (2021)
- [ARCOQ: Arabic Closest Opposite Questions Dataset](https://mlsanity.com/paper/2310.14384/) (2023)

## Abstract (arXiv)

Distributed word representations (word embeddings) have recently contributed to competitive performance in language modeling and several NLP tasks. In this work, we train word embeddings for more than 100 languages using their corresponding Wikipedias. We quantitatively demonstrate the utility of our word embeddings by using them as the sole features for training a part of speech tagger for a subset of these languages. We find their performance to be competitive with near state-of-art methods in English, Danish and Swedish. Moreover, we investigate the semantic features captured by these embeddings through the proximity of word groupings. We will release these embeddings publicly to help researchers in the development and enhancement of multilingual applications.