PVG at WASSA 2021: A Multi-Input, Multi-Task, Transformer-Based Architecture for Empathy and Distress Prediction
Not on the map. Why?
Abstract (arXiv)
Active research pertaining to the affective phenomenon of empathy and distress is invaluable for improving human-machine interaction. Predicting intensities of such complex emotions from textual data is difficult, as these constructs are deeply rooted in the psychological theory. Consequently, for better prediction, it becomes imperative to take into account ancillary factors such as the psychological test scores, demographic features, underlying latent primitive emotions, along with the text's undertone and its psychological complexity. This paper proffers team PVG's solution to the WASSA 2021 Shared Task on Predicting Empathy and Emotion in Reaction to News Stories. Leveraging the textual data, demographic features, psychological test score, and the intrinsic interdependencies of primitive emotions and empathy, we propose a multi-input, multi-task framework for the task of empathy score prediction. Here, the empathy score prediction is considered the primary task, while emotion and empathy classification are considered secondary auxiliary tasks. For the distress score prediction task, the system is further boosted by the addition of lexical features. Our submission ranked 1st based on the average correlation (0.545) as well as the distress correlation (0.574), and 2nd for the empathy Pearson correlation (0.517).
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 15 of its 34 references that are in the map. First posted on arXiv 4 Mar 2021.
Builds on
15 of 34 references.
References · 15
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 375
- 2020A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Supportcited by 182
- 2017Learned in Translation: Contextualized Word Vectorscited by 104
- 2016Entity Embeddings of Categorical Variablescited by 87
- 2017Deep Voice: Real-time Neural Text-to-Speechcited by 83
- 2016A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Taskscited by 62
- 2018Modeling Empathy and Distress in Reaction to News Storiescited by 52
- 2016Empath: Understanding Topic Signals in Large-Scale Textcited by 51
- 2017Word Affect Intensitiescited by 51
- 2017Deep Multitask Learning for Semantic Dependency Parsingcited by 10
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 0; 2025: 3.
7 papers.
- 2023Empathy Detection from Text, Audiovisual, Audio or Physiological Signals: A Systematic Review of Task Formulations and Machine Learning Methodscited by 5
- 2022A Critical Reflection and Forward Perspective on Empathy and Natural Language Processingcited by 4
- 2025Labels Generated by Large Language Models Help Measure People's Empathy in Vitrocited by 1
- 2025UPLME: Uncertainty-Aware Probabilistic Language Modelling for Robust Empathy Regressioncited by 1
- 2022Leveraging Emotion-specific Features to Improve Transformer Performance for Emotion Classificationcited by 0
- 2023S-Omninet: Structured Data Enhanced Universal Multimodal Learning Architecturecited by 0
- 2025Empaths at SemEval-2025 Task 11: Retrieval-Augmented Approach to Perceived Emotions Predictioncited by 0
- 2025UPLME: Uncertainty-Aware Probabilistic Language Modelling for Robust Empathy Regression5 Aug 2025
- 2025Empaths at SemEval-2025 Task 11: Retrieval-Augmented Approach to Perceived Emotions Prediction4 Jun 2025
- 2025Labels Generated by Large Language Models Help Measure People's Empathy in Vitro1 Jan 2025
- 2023Empathy Detection from Text, Audiovisual, Audio or Physiological Signals: A Systematic Review of Task Formulations and Machine Learning Methods30 Oct 2023
- 2023S-Omninet: Structured Data Enhanced Universal Multimodal Learning Architecture1 Jul 2023
- 2022A Critical Reflection and Forward Perspective on Empathy and Natural Language Processing29 Oct 2022
- 2022Leveraging Emotion-specific Features to Improve Transformer Performance for Emotion Classification30 Apr 2022