Deep learning for affective computing: text-based emotion recognition in decision support
Not on the map. Why?
Abstract (arXiv)
Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within narrative documents presents a challenging undertaking due to the complexity and ambiguity of language. Performance improvements can be achieved through deep learning; yet, as demonstrated in this paper, the specific nature of this task requires the customization of recurrent neural networks with regard to bidirectional processing, dropout layers as a means of regularization, and weighted loss functions. In addition, we propose sent2affect, a tailored form of transfer learning for affective computing: here the network is pre-trained for a different task (i.e. sentiment analysis), while the output layer is subsequently tuned to the task of emotion recognition. The resulting performance is evaluated in a holistic setting across 6 benchmark datasets, where we find that both recurrent neural networks and transfer learning consistently outperform traditional machine learning. Altogether, the findings have considerable implications for the use of affective computing.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 2; 2023: 1; 2024: 2; 2025: 2.
14 papers.
Sort:
- 2021Multimodal Engagement Analysis from Facial Videos in the Classroomcited by 27
- 2021Contrastive Domain Adaptation for Question Answering using Limited Text Corporacited by 20
- 2021HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognitioncited by 14
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertaintycited by 11
- 2021Shapes of Emotions: Multimodal Emotion Recognition in Conversations via Emotion Shiftscited by 9
- 2021Training Affective Computer Vision Models by Crowdsourcing Soft-Target Labelscited by 8
- 2021Multistage linguistic conditioning of convolutional layers for speech emotion recognitioncited by 8
- 2025Quantum Federated Learning for Multimodal Data: A Modality-Agnostic Approachcited by 8
- 2022QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptationcited by 2
- 2024Fine-tuning Strategies for Domain Specific Question Answering under Low Annotation Budget Constraintscited by 1
- 2022DeepEmotex: Classifying Emotion in Text Messages using Deep Transfer Learningcited by 0
- 2023REDAffectiveLM: Leveraging Affect Enriched Embedding and Transformer-based Neural Language Model for Readers' Emotion Detectioncited by 0
2 more
- 2025DEAP DIVE: Dataset Investigation with Vision transformers for EEG evaluation1 Oct 2025
- 2025Quantum Federated Learning for Multimodal Data: A Modality-Agnostic Approach10 Jul 2025
- 2024Fine-tuning Strategies for Domain Specific Question Answering under Low Annotation Budget Constraints17 Jan 2024
- 2024A Joint-Reasoning based Disease Q&A System6 Jan 2024
- 2023REDAffectiveLM: Leveraging Affect Enriched Embedding and Transformer-based Neural Language Model for Readers' Emotion Detection21 Jan 2023
- 2022QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation19 Oct 2022
- 2022DeepEmotex: Classifying Emotion in Text Messages using Deep Transfer Learning12 Jun 2022
- 2021Shapes of Emotions: Multimodal Emotion Recognition in Conversations via Emotion Shifts3 Dec 2021
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty16 Oct 2021
- 2021Multistage linguistic conditioning of convolutional layers for speech emotion recognition13 Oct 2021
- 2021Contrastive Domain Adaptation for Question Answering using Limited Text Corpora31 Aug 2021
- 2021HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition3 Feb 2021
2 more
- 2021Multimodal Engagement Analysis from Facial Videos in the Classroomcited by 27
- 2021Contrastive Domain Adaptation for Question Answering using Limited Text Corporacited by 20
- 2021HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognitioncited by 14
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertaintycited by 11
- 2021Shapes of Emotions: Multimodal Emotion Recognition in Conversations via Emotion Shiftscited by 9
- 2021Training Affective Computer Vision Models by Crowdsourcing Soft-Target Labelscited by 8
- 2021Multistage linguistic conditioning of convolutional layers for speech emotion recognitioncited by 8
- 2025Quantum Federated Learning for Multimodal Data: A Modality-Agnostic Approachcited by 8
- 2022QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptationcited by 2
- 2024Fine-tuning Strategies for Domain Specific Question Answering under Low Annotation Budget Constraintscited by 1
- 2022DeepEmotex: Classifying Emotion in Text Messages using Deep Transfer Learningcited by 0
- 2023REDAffectiveLM: Leveraging Affect Enriched Embedding and Transformer-based Neural Language Model for Readers' Emotion Detectioncited by 0
12 most cited of 14 All 14 (JSON)
- 2025DEAP DIVE: Dataset Investigation with Vision transformers for EEG evaluation1 Oct 2025
- 2025Quantum Federated Learning for Multimodal Data: A Modality-Agnostic Approach10 Jul 2025
- 2024Fine-tuning Strategies for Domain Specific Question Answering under Low Annotation Budget Constraints17 Jan 2024
- 2024A Joint-Reasoning based Disease Q&A System6 Jan 2024
- 2023REDAffectiveLM: Leveraging Affect Enriched Embedding and Transformer-based Neural Language Model for Readers' Emotion Detection21 Jan 2023
- 2022QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation19 Oct 2022
- 2022DeepEmotex: Classifying Emotion in Text Messages using Deep Transfer Learning12 Jun 2022
- 2021Shapes of Emotions: Multimodal Emotion Recognition in Conversations via Emotion Shifts3 Dec 2021
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty16 Oct 2021
- 2021Multistage linguistic conditioning of convolutional layers for speech emotion recognition13 Oct 2021
- 2021Contrastive Domain Adaptation for Question Answering using Limited Text Corpora31 Aug 2021
- 2021HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition3 Feb 2021
12 newest of 14 All 14 (JSON)