mlsanityData to 14 Oct 2026

XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond

arXiv 2104.12250 ↗First posted 25 Apr 2021cs.CLcited by 114

Not on the map. Why?

Abstract (arXiv)

Language models are ubiquitous in current NLP, and their multilingual capacity has recently attracted considerable attention. However, current analyses have almost exclusively focused on (multilingual variants of) standard benchmarks, and have relied on clean pre-training and task-specific corpora as multilingual signals. In this paper, we introduce XLM-T, a model to train and evaluate multilingual language models in Twitter. In this paper we provide: (1) a new strong multilingual baseline consisting of an XLM-R (Conneau et al. 2020) model pre-trained on millions of tweets in over thirty languages, alongside starter code to subsequently fine-tune on a target task; and (2) a set of unified sentiment analysis Twitter datasets in eight different languages and a XLM-T model fine-tuned on them.

Key facts. Cited by 114 papers in the map (data through 14 Oct 2026). Builds on 24 of its 45 references that are in the map. First posted on arXiv 25 Apr 2021.

Builds on

24 of 45 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  6. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  7. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  8. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  9. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  10. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
  11. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  12. 2019How multilingual is Multilingual BERT?cited by 645
12 more
  1. 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 417
  2. 2020BERTweet: A pre-trained language model for English Tweetscited by 346
  3. 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 318
  4. 2018Learning Word Vectors for 157 Languagescited by 280
  5. 2019SemEval-2017 Task 4: Sentiment Analysis in Twittercited by 210
  6. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 207
  7. 2020SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweetscited by 62
  8. 2016Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classificationcited by 48
  9. 2019An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Modelscited by 39
  10. 2017Building a Sentiment Corpus of Tweets in Brazilian Portuguesecited by 20
  11. 2019Sentiment analysis is not solved! Assessing and probing sentiment classificationcited by 14
  12. 2020Improving Sentiment Analysis over non-English Tweets using Multilingual Transformers and Automatic Translation for Data-Augmentationcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 9; 2023: 39; 2024: 26; 2025: 27; 2026: 12.

114 papers.

Sort:

By area:

  1. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
  2. 2023MAGE: Machine-generated Text Detection in the Wildcited by 132
  3. 2022TweetNLP: Cutting-Edge Natural Language Processing for Social Mediacited by 71
  4. 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
  5. 2024LLMs Are Few-Shot In-Context Low-Resource Language Learnerscited by 68
  6. 2023ChatGPT: A Meta-Analysis after 2.5 Monthscited by 51
  7. 2024Reasoning Runtime Behavior of a Program with LLM: How Far Are We?cited by 45
  8. 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
  9. 2023Overview of AuTexTification at IberLEF 2023: Detection and Attribution of Machine-Generated Text in Multiple Domainscited by 31
  10. 2023An Efficient Multilingual Language Model Compression through Vocabulary Trimmingcited by 20
  11. 2023Zero- and Few-Shot Prompting with LLMs: A Comparative Study with Fine-tuned Models for Bangla Sentiment Analysiscited by 20
  12. 2023Unsupervised Layer-wise Score Aggregation for Textual OOD Detectioncited by 15
38 more
  1. 2024What Drives Performance in Multilingual Language Models?cited by 15
  2. 2022HERDPhobia: A Dataset for Hate Speech against Fulani in Nigeriacited by 12
  3. 2023ViSoBERT: A Pre-Trained Language Model for Vietnamese Social Media Text Processingcited by 11
  4. 2024Getting More from Less: Large Language Models are Good Spontaneous Multilingual Learnerscited by 11
  5. 2024NaijaHate: Evaluating Hate Speech Detection on Nigerian Twitter Using Representative Datacited by 10
  6. 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
  7. 2021pysentimiento: A Python Toolkit for Opinion Mining and Social NLP taskscited by 9
  8. 2022ArmanEmo: A Persian Dataset for Text-based Emotion Detectioncited by 9
  9. 2023SuperTweetEval: A Challenging, Unified and Heterogeneous Benchmark for Social Media NLP Researchcited by 9
  10. 2023Pre-trained Speech Processing Models Contain Human-Like Biases that Propagate to Speech Emotion Recognitioncited by 9
  11. 2023UZH_CLyp at SemEval-2023 Task 9: Head-First Fine-Tuning and ChatGPT Data Generation for Cross-Lingual Learning in Tweet Intimacy Predictioncited by 8
  12. 2023Uncovering Political Hate Speech During Indian Election Campaign: A New Low-Resource Dataset and Baselinescited by 8
  13. 2022Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languagescited by 7
  14. 2022Using Emotion Embeddings to Transfer Knowledge Between Emotions, Languages, and Annotation Formatscited by 7
  15. 2025Diversity-oriented Data Augmentation with Large Language Modelscited by 7
  16. 2025Can Prompting LLMs Unlock Hate Speech Detection across Languages? A Zero-shot and Few-shot Studycited by 7
  17. 2025HUME: Measuring the Human-Model Performance Gap in Text Embedding Taskscited by 7
  18. 2023Don't Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewritingcited by 6
  19. 2023Public Attitudes Toward ChatGPT on Twitter: Sentiments, Topics, and Occupationscited by 6
  20. 2024The AffectToolbox: Affect Analysis for Everyonecited by 5
  21. 2025Do Methods to Jailbreak and Defend LLMs Generalize Across Languages?cited by 5
  22. 2023A Predictive Factor Analysis of Social Biases and Task-Performance in Pretrained Masked Language Modelscited by 4
  23. 2024The Privileged Students: On the Value of Initialization in Multilingual Knowledge Distillationcited by 4
  24. 2024data2lang2vec: Data Driven Typological Features Completioncited by 4
  25. 2025AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Textcited by 4
  26. 2025Tau-Eval: A Unified Evaluation Framework for Useful and Private Text Anonymizationcited by 4
  27. 2026Where Does the Noise Come From? A Variance-Components Decomposition of Non-Determinism in LLM Brand Answerscited by 4
  28. 2022Language Agnostic Code-Mixing Data Augmentation by Predicting Linguistic Patternscited by 3
  29. 2022Anger Breeds Controversy: Analyzing Controversy and Emotions on Redditcited by 3
  30. 2023Federated Learning Based Multilingual Emoji Prediction In Clean and Attack Scenarioscited by 3
  31. 2023The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languagescited by 3
  32. 2023The Uli Dataset: An Exercise in Experience Led Annotation of oGBVcited by 3
  33. 2024Cloaked Classifiers: Pseudonymization Strategies on Sensitive Classification Taskscited by 3
  34. 2024The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Modelscited by 3
  35. 2024Beyond Dataset Creation: Critical View of Annotation Variation and Bias Probing of a Dataset for Online Radical Content Detectioncited by 3
  36. 2025Provably Safe Model Updatescited by 3
  37. 2022SOLD: Sinhala Offensive Language Datasetcited by 2
  38. 2023Migration Reframed? A multilingual analysis on the stance shift in Europe during the Ukrainian crisiscited by 2

50 most cited of 114 All 114 (JSON)