mlsanityData to 14 Oct 2026

SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection

arXiv 2503.07269 ↗First posted 10 Mar 2025cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

We present our shared task on text-based emotion detection, covering more than 30 languages from seven distinct language families. These languages are predominantly low-resource and are spoken across various continents. The data instances are multi-labeled with six emotional classes, with additional datasets in 11 languages annotated for emotion intensity. Participants were asked to predict labels in three tracks: (a) multilabel emotion detection, (b) emotion intensity score detection, and (c) cross-lingual emotion detection. The task attracted over 700 participants. We received final submissions from more than 200 teams and 93 system description papers. We report baseline results, along with findings on the best-performing systems, the most common approaches, and the most effective methods across different tracks and languages. The datasets for this task are publicly available. The dataset is available at SemEval2025 Task 11 https://brighter-dataset.github.io

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 15 of its 112 references that are in the map. First posted on arXiv 10 Mar 2025.

Builds on

15 of 112 references.

References · 15

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  3. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  4. 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
  5. 2023Multilingual Language Models are not Multicultural: A Case Study in Emotioncited by 54
  6. 2017WASSA-2017 Shared Task on Emotion Intensitycited by 38
  7. 2020XED: A Multilingual Dataset for Sentiment Analysis and Emotion Detectioncited by 33
  8. 2022Best Practices in the Creation and Use of Emotion Lexiconscited by 27
  9. 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languagescited by 27
  10. 2017Capturing Reliable Fine-Grained Sentiment Associations by Crowdsourcing and Best-Worst Scalingcited by 23
  11. 2024No Culture Left Behind: ArtELingo-28, a Benchmark of WikiArt with Captions in 28 Languagescited by 19
  12. 2024WorryWords: Norms of Anxiety Association for over 44k English Wordscited by 10
3 more
  1. 2023Does mBERT understand Romansh? Evaluating word embeddings using word alignmentcited by 3
  2. 2025Team A at SemEval-2025 Task 11: Breaking Language Barriers in Emotion Detection with Multilingual Modelscited by 1
  3. 2025Lotus at SemEval-2025 Task 11: RoBERTa with Llama-3 Generated Explanations for Multi-Label Emotion Classificationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 5.

9 papers.

  1. 2025A Survey on Multilingual Mental Disorders Detection from Social Media Datacited by 3
  2. 2025AfriMTEB and AfriE5: Benchmarking and Adapting Text Embedding Models for African Languagescited by 3
  3. 2025Exploring Cultural Nuances in Emotion Perception Across 15 African Languagescited by 1
  4. 2025EmoBench-UA: A Benchmark Dataset for Emotion Detection in Ukrainiancited by 0
  5. 2026Beyond Majority Voting: Agreement-Based Clustering to Model Annotator Perspectives in Subjective NLP Taskscited by 0
  6. 2026ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Modelscited by 0
  7. 2026VIBE: A VAD-Informed Benchmark for Entity-Centered Affective Profiling of Large Language Model Outputscited by 0
  8. 2026Cross-lingual Functional Vectors for Emotion Detection in Large Language Modelscited by 0
  9. 2026Disentangling Topology and Diversity in Multi-Agent LLMs for Multilingual Low-Resource Emotion Detectioncited by 0