WASSA-2017 Shared Task on Emotion Intensity
Not on the map. Why?
Abstract (arXiv)
We present the first shared task on detecting the intensity of emotion felt by the speaker of a tweet. We create the first datasets of tweets annotated for anger, fear, joy, and sadness intensities using a technique called best--worst scaling (BWS). We show that the annotations lead to reliable fine-grained intensity scores (rankings of tweets by intensity). The data was partitioned into training, development, and test sets for the competition. Twenty-two teams participated in the shared task, with the best system obtaining a Pearson correlation of 0.747 with the gold intensity scores. We summarize the machine learning setups, resources, and tools used by the participating teams, with a focus on the techniques and resources that are particularly useful for the task. The emotion intensity dataset and the shared task are helping improve our understanding of how we convey more or less intense emotions through language.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 7; 2023: 3; 2024: 7; 2025: 5; 2026: 4.
37 papers.
Sort:
By area:
- 2022Dataless Knowledge Fusion by Merging Weights of Language Modelscited by 384
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2024Parameter Competition Balancing for Model Mergingcited by 71
- 2021Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classificationcited by 43
- 2023A Wide Evaluation of ChatGPT on Affective Computing Taskscited by 30
- 2021BLEU, METEOR, BERTScore: Evaluation of Metrics Performance in Assessing Critical Translation Errors in Sentiment-oriented Textcited by 22
- 2024Knowledge Fusion By Evolving Weights of Language Modelscited by 16
- 2021Multi-Task Learning with Sentiment, Emotion, and Target Detection to Recognize Hate Speech and Offensive Languagecited by 12
- 2024IterIS: Iterative Inference-Solving Alignment for LoRA Mergingcited by 11
- 2021Emotion Ratings: How Intensity, Annotation Confidence and Agreements are Entangledcited by 10
- 2021Fine-Grained Emotion Prediction by Modeling Emotion Definitionscited by 9
- 2025SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detectioncited by 9
25 more
- 2023Where are We in Event-centric Emotion Analysis? Bridging Emotion Role Labeling and Appraisal-based Approachescited by 7
- 2025Language Models Predict Empathy Gaps Between Social In-groups and Out-groupscited by 6
- 2025Emotions in the Loop: A Survey of Affective Computing for Emotional Supportcited by 5
- 2021Challenges in Translation of Emotions in Multilingual User-Generated Content: Twitter as a Case Studycited by 4
- 2021Sentiment-Aware Measure (SAM) for Evaluating Sentiment Transfer by Machine Translation Systemscited by 4
- 2025Out-of-the-Box Conditional Text Embeddings from Large Language Modelscited by 4
- 2022Please, Don't Forget the Difference and the Confidence Interval when Seeking for the State-of-the-Art Statuscited by 3
- 2022"splink" is happy and "phrouth" is scary: Emotion Intensity Analysis for Nonsense Wordscited by 2
- 2022Transformer-based Text Classification on Unified Bangla Multi-class Emotion Corpuscited by 2
- 2022Modelling Emotion Dynamics in Song Lyrics with State Space Modelscited by 2
- 2021Silhouettes and quasi residual plots for neural nets and tree-based classifierscited by 1
- 2023Emotion-Oriented Behavior Model Using Deep Learningcited by 1
- 2024EFO: the Emotion Frame Ontologycited by 1
- 2024Predicting Emotion Intensity in Polish Political Texts: Comparing Supervised Models and Large Language Models in a Resource-Poor Languagecited by 1
- 2021Guilt by Association: Emotion Intensities in Lexical Representationscited by 0
- 2021Identifying negativity factors from social media text corpus using sentiment analysis methodcited by 0
- 2022Analyzing the Intensity of Complaints on Social Mediacited by 0
- 2022DeepEmotex: Classifying Emotion in Text Messages using Deep Transfer Learningcited by 0
- 2024SensoryT5: Infusing Sensorimotor Norms into T5 for Enhanced Fine-grained Emotion Classificationcited by 0
- 2024Understanding Social Perception, Interactions, and Safety Aspects of Sidewalk Delivery Robots Using Sentiment Analysiscited by 0
- 2025Domain Lexical Knowledge-based Word Embedding Learning for Text Classification under Small Datacited by 0
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Surveycited by 0
- 2026Beyond Sentiment Classification: A Generative Framework for Emotion Intensity Evaluation in Textcited by 0
- 2026VIBE: A VAD-Informed Benchmark for Entity-Centered Affective Profiling of Large Language Model Outputscited by 0
- 2026Focusing Condition: Inference-Time Self-Contrastive Steering Elicits Better Conditional Text Embeddings in LLMscited by 0
- 2026Focusing Condition: Inference-Time Self-Contrastive Steering Elicits Better Conditional Text Embeddings in LLMs26 Sep 2026
- 2026VIBE: A VAD-Informed Benchmark for Entity-Centered Affective Profiling of Large Language Model Outputs4 Aug 2026
- 2026Beyond Sentiment Classification: A Generative Framework for Emotion Intensity Evaluation in Text15 May 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2025Domain Lexical Knowledge-based Word Embedding Learning for Text Classification under Small Data2 Jun 2025
- 2025Emotions in the Loop: A Survey of Affective Computing for Emotional Support2 May 2025
- 2025Out-of-the-Box Conditional Text Embeddings from Large Language Models23 Apr 2025
- 2025SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection10 Mar 2025
- 2025Language Models Predict Empathy Gaps Between Social In-groups and Out-groups2 Mar 2025
- 2024IterIS: Iterative Inference-Solving Alignment for LoRA Merging21 Nov 2024
- 2024Parameter Competition Balancing for Model Merging3 Oct 2024
- 2024Predicting Emotion Intensity in Polish Political Texts: Comparing Supervised Models and Large Language Models in a Resource-Poor Language16 Jul 2024
25 more
- 2024Knowledge Fusion By Evolving Weights of Language Models18 Jun 2024
- 2024SensoryT5: Infusing Sensorimotor Norms into T5 for Enhanced Fine-grained Emotion Classification22 Mar 2024
- 2024Understanding Social Perception, Interactions, and Safety Aspects of Sidewalk Delivery Robots Using Sentiment Analysis9 Mar 2024
- 2024EFO: the Emotion Frame Ontology19 Jan 2024
- 2023Emotion-Oriented Behavior Model Using Deep Learning28 Oct 2023
- 2023Where are We in Event-centric Emotion Analysis? Bridging Emotion Role Labeling and Appraisal-based Approaches5 Sep 2023
- 2023A Wide Evaluation of ChatGPT on Affective Computing Tasks26 Aug 2023
- 2022Dataless Knowledge Fusion by Merging Weights of Language Models19 Dec 2022
- 2022Modelling Emotion Dynamics in Song Lyrics with State Space Models17 Oct 2022
- 2022Transformer-based Text Classification on Unified Bangla Multi-class Emotion Corpus12 Oct 2022
- 2022DeepEmotex: Classifying Emotion in Text Messages using Deep Transfer Learning12 Jun 2022
- 2022Please, Don't Forget the Difference and the Confidence Interval when Seeking for the State-of-the-Art Status23 May 2022
- 2022Analyzing the Intensity of Complaints on Social Media20 Apr 2022
- 2022"splink" is happy and "phrouth" is scary: Emotion Intensity Analysis for Nonsense Words24 Feb 2022
- 2021Sentiment-Aware Measure (SAM) for Evaluating Sentiment Transfer by Machine Translation Systems30 Sep 2021
- 2021BLEU, METEOR, BERTScore: Evaluation of Metrics Performance in Assessing Critical Translation Errors in Sentiment-oriented Text29 Sep 2021
- 2021Multi-Task Learning with Sentiment, Emotion, and Target Detection to Recognize Hate Speech and Offensive Language21 Sep 2021
- 2021Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classification12 Sep 2021
- 2021Fine-Grained Emotion Prediction by Modeling Emotion Definitions26 Jul 2021
- 2021Identifying negativity factors from social media text corpus using sentiment analysis method6 Jul 2021
- 2021Challenges in Translation of Emotions in Multilingual User-Generated Content: Twitter as a Case Study20 Jun 2021
- 2021Silhouettes and quasi residual plots for neural nets and tree-based classifiers16 Jun 2021
- 2021Guilt by Association: Emotion Intensities in Lexical Representations18 Apr 2021
- 2021Membership Inference Attacks on Machine Learning: A Survey14 Mar 2021
- 2021Emotion Ratings: How Intensity, Annotation Confidence and Agreements are Entangled2 Mar 2021
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2021Membership Inference Attacks on Machine Learning: A Survey14 Mar 2021
- 2022Dataless Knowledge Fusion by Merging Weights of Language Modelscited by 384
- 2024Parameter Competition Balancing for Model Mergingcited by 71
- 2021Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classificationcited by 43
- 2023A Wide Evaluation of ChatGPT on Affective Computing Taskscited by 30
- 2021BLEU, METEOR, BERTScore: Evaluation of Metrics Performance in Assessing Critical Translation Errors in Sentiment-oriented Textcited by 22
- 2024Knowledge Fusion By Evolving Weights of Language Modelscited by 16
- 2021Multi-Task Learning with Sentiment, Emotion, and Target Detection to Recognize Hate Speech and Offensive Languagecited by 12
- 2024IterIS: Iterative Inference-Solving Alignment for LoRA Mergingcited by 11
- 2021Emotion Ratings: How Intensity, Annotation Confidence and Agreements are Entangledcited by 10
- 2021Fine-Grained Emotion Prediction by Modeling Emotion Definitionscited by 9
- 2025SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detectioncited by 9
- 2023Where are We in Event-centric Emotion Analysis? Bridging Emotion Role Labeling and Appraisal-based Approachescited by 7
12 most cited of 36 All 36 (JSON)
- 2026Focusing Condition: Inference-Time Self-Contrastive Steering Elicits Better Conditional Text Embeddings in LLMs26 Sep 2026
- 2026VIBE: A VAD-Informed Benchmark for Entity-Centered Affective Profiling of Large Language Model Outputs4 Aug 2026
- 2026Beyond Sentiment Classification: A Generative Framework for Emotion Intensity Evaluation in Text15 May 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2025Domain Lexical Knowledge-based Word Embedding Learning for Text Classification under Small Data2 Jun 2025
- 2025Emotions in the Loop: A Survey of Affective Computing for Emotional Support2 May 2025
- 2025Out-of-the-Box Conditional Text Embeddings from Large Language Models23 Apr 2025
- 2025SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection10 Mar 2025
- 2025Language Models Predict Empathy Gaps Between Social In-groups and Out-groups2 Mar 2025
- 2024IterIS: Iterative Inference-Solving Alignment for LoRA Merging21 Nov 2024
- 2024Parameter Competition Balancing for Model Merging3 Oct 2024
- 2024Predicting Emotion Intensity in Polish Political Texts: Comparing Supervised Models and Large Language Models in a Resource-Poor Language16 Jul 2024
12 newest of 36 All 36 (JSON)