WASSA@IITK at WASSA 2021: Multi-task Learning and Transformer Finetuning for Emotion Classification and Empathy Prediction
Not on the map. Why?
Abstract (arXiv)
This paper describes our contribution to the WASSA 2021 shared task on Empathy Prediction and Emotion Classification. The broad goal of this task was to model an empathy score, a distress score and the overall level of emotion of an essay written in response to a newspaper article associated with harm to someone. We have used the ELECTRA model abundantly and also advanced deep learning approaches like multi-task learning. Additionally, we also leveraged standard machine learning techniques like ensembling. Our system achieves a Pearson Correlation Coefficient of 0.533 on sub-task I and a macro F1 score of 0.5528 on sub-task II. We ranked 1st in Emotion Classification sub-task and 3rd in Empathy Prediction sub-task
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 20 Apr 2021.
Builds on
12 of 22 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 377
- 2019Multi-Task Deep Neural Networks for Natural Language Understandingcited by 349
- 2018Modeling Empathy and Distress in Reaction to News Storiescited by 52
- 2020Multi-task learning for natural language processing in the 2020s: where are we going?cited by 27
- 2013Class Imbalance Problem in Data Mining Reviewcited by 16
- 2019Learning Word Ratings for Empathy and Distress from Document-Level User Responsescited by 10
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 0; 2025: 2.
6 papers.
- 2023Empathy Detection from Text, Audiovisual, Audio or Physiological Signals: A Systematic Review of Task Formulations and Machine Learning Methodscited by 5
- 2022A Critical Reflection and Forward Perspective on Empathy and Natural Language Processingcited by 4
- 2022Transformer based ensemble for emotion detectioncited by 1
- 2023Data Augmentation for Emotion Detection in Small Imbalanced Text Datacited by 1
- 2025Labels Generated by Large Language Models Help Measure People's Empathy in Vitrocited by 1
- 2025UPLME: Uncertainty-Aware Probabilistic Language Modelling for Robust Empathy Regressioncited by 1
- 2025UPLME: Uncertainty-Aware Probabilistic Language Modelling for Robust Empathy Regression5 Aug 2025
- 2025Labels Generated by Large Language Models Help Measure People's Empathy in Vitro1 Jan 2025
- 2023Empathy Detection from Text, Audiovisual, Audio or Physiological Signals: A Systematic Review of Task Formulations and Machine Learning Methods30 Oct 2023
- 2023Data Augmentation for Emotion Detection in Small Imbalanced Text Data25 Oct 2023
- 2022A Critical Reflection and Forward Perspective on Empathy and Natural Language Processing29 Oct 2022
- 2022Transformer based ensemble for emotion detection22 Mar 2022