mlsanityData to 7 Oct 2026

Learning Word Vectors for 157 Languages

arXiv 1802.06893 ↗First posted 19 Feb 2018cs.CL cs.LGcited by 279

Not on the map. Why?

Abstract (arXiv)

Distributed word representations, or word vectors, have recently been applied to many tasks in natural language processing, leading to state-of-the-art performance. A key ingredient to the successful application of these representations is to train them on very large corpora, and use these pre-trained models in downstream tasks. In this paper, we describe how we trained such high quality word representations for 157 languages. We used two sources of data to train these models: the free online encyclopedia Wikipedia and data from the common crawl project. We also introduce three new word analogy datasets to evaluate these word vectors, for French, Hindi and Polish. Finally, we evaluate our pre-trained word vectors on 10 languages for which evaluation datasets exists, showing very strong performance compared to previous models.

Key facts. Cited by 279 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Feb 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 84; 2022: 47; 2023: 39; 2024: 49; 2025: 32; 2026: 28.

279 papers.

Sort:

By area:

  1. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
  2. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 332
  3. 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
  4. 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 172
  5. 2022Towards a Cleaner Document-Oriented Multilingual Crawled Corpuscited by 143
  6. 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
  7. 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelscited by 104
  8. 2021Achieving Forgetting Prevention and Knowledge Transfer in Continual Learningcited by 91
  9. 2021What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpuscited by 79
  10. 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 73
  11. 2023MathPile: A Billion-Token-Scale Pretraining Corpus for Mathcited by 67
  12. 2025Meta CLIP 2: A Worldwide Scaling Recipecited by 59
38 more
  1. 2021Are Multilingual Models Effective in Code-Switching?cited by 56
  2. 2024ALLaM: Large Language Models for Arabic and Englishcited by 55
  3. 2021How to Adapt Your Pretrained Multilingual Model to 1600 Languagescited by 54
  4. 2021AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languagescited by 50
  5. 2022Bitext Mining Using Distilled Sentence Representations for Low-Resource Languagescited by 48
  6. 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 48
  7. 2021Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Taskscited by 46
  8. 2023HateMM: A Multi-Modal Dataset for Hate Video Classificationcited by 41
  9. 2021A Statutory Article Retrieval Dataset in Frenchcited by 40
  10. 2022Large-Scale Hate Speech Detection with Cross-Domain Transfercited by 39
  11. 2024Aioli: A Unified Optimization Framework for Language Model Data Mixingcited by 33
  12. 2024Large Language Models are Efficient Learners of Noise-Robust Speech Recognitioncited by 30
  13. 2021CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Taskscited by 29
  14. 2021A Large-scale Dataset for Hate Speech Detection on Vietnamese Social Media Textscited by 25
  15. 2021Semantic Diversity Learning for Zero-Shot Multi-label Classificationcited by 24
  16. 2021Better Feature Integration for Named Entity Recognitioncited by 22
  17. 2024How Can We Effectively Expand the Vocabulary of LLMs with 0.01GB of Target Language Text?cited by 22
  18. 2021Dataset for Identification of Homophobia and Transophobia in Multilingual YouTube Commentscited by 20
  19. 2021Privacy-Preserving Graph Convolutional Networks for Text Classificationcited by 19
  20. 2021Abuse is Contextual, What about NLP? The Role of Context in Abusive Language Annotation and Detectioncited by 19
  21. 2023Discovering Universal Geometry in Embeddings with ICAcited by 19
  22. 2021Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpuscited by 18
  23. 2022A Survey on Aspect-Based Sentiment Classificationcited by 18
  24. 2021Constructive and Toxic Speech Detection for Open-domain Social Media Comments in Vietnamesecited by 17
  25. 2023Large Language Models are Fixated by Red Herrings: Exploring Creative Problem Solving and Einstellung Effect using the Only Connect Wall Datasetcited by 17
  26. 2021DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharingcited by 16
  27. 2023ChineseWebText: Large-scale High-quality Chinese Web Text Extracted with Effective Evaluation Modelcited by 16
  28. 2024OpenFGL: A Comprehensive Benchmark for Federated Graph Learningcited by 16
  29. 2021Object Priors for Classifying and Localizing Unseen Actionscited by 15
  30. 2021Robust Optimization for Multilingual Translation with Imbalanced Datacited by 15
  31. 2021What Makes Sentences Semantically Related: A Textual Relatedness Dataset and Empirical Studycited by 15
  32. 2022Few-Shot Learning with Siamese Networks and Label Tuningcited by 15
  33. 2022Multimodal Hate Speech Detection from Bengali Memes and Textscited by 15
  34. 2023Transfer to a Low-Resource Language via Close Relatives: The Case Study on Faroesecited by 15
  35. 2024GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languagescited by 15
  36. 2022BD-SHS: A Benchmark Dataset for Learning to Detect Online Bangla Hate Speech in Different Social Contextscited by 14
  37. 2023Do large language models solve verbal analogies like children do?cited by 13
  38. 2025Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scalecited by 13

50 most cited of 279 All 279 (JSON)