# Evaluation of Error and Correlation-Based Loss Functions For Multitask Learning Dimensional Speech Emotion Recognition

arXiv: https://arxiv.org/abs/2003.10724 · HTML: https://mlsanity.com/paper/2003.10724/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Mar 2020.

## Built on by (most cited first, 13 of 13)

- [Exploiting Emotional Dependencies with Graph Convolutional Networks for Facial Expression Recognition](https://mlsanity.com/paper/2106.03487/) (2021)
- [Quantifying Valence and Arousal in Text with Multilingual Pre-trained Transformers](https://mlsanity.com/paper/2302.14021/) (2023)
- [The Whole Is Bigger Than the Sum of Its Parts: Modeling Individual Annotators to Capture Emotional Variability](https://mlsanity.com/paper/2408.11956/) (2024)
- [Less is More: Sparse Sampling for Dense Reaction Predictions](https://mlsanity.com/paper/2106.01764/) (2021)
- [SVLDL: Improved Speaker Age Estimation Using Selective Variance Label Distribution Learning](https://mlsanity.com/paper/2210.09524/) (2022)
- [Deep Learning for Assessment of Oral Reading Fluency](https://mlsanity.com/paper/2405.19426/) (2024)
- [Labels Generated by Large Language Models Help Measure People's Empathy in Vitro](https://mlsanity.com/paper/2501.00691/) (2025)
- [Universal Semantic Disentangled Privacy-preserving Speech Representation Learning](https://mlsanity.com/paper/2505.13085/) (2025)
- [Developing a High-performance Framework for Speech Emotion Recognition in Naturalistic Conditions Challenge for Emotional Attribute Prediction](https://mlsanity.com/paper/2506.10930/) (2025)
- [Usefulness of Emotional Prosody in Neural Machine Translation](https://mlsanity.com/paper/2404.17968/) (2024)
- [United we stand, Divided we fall: Handling Weak Complementary Relationships for Audio-Visual Emotion Recognition in Valence-Arousal Space](https://mlsanity.com/paper/2503.12261/) (2025)
- [MMMOS: Multi-domain Multi-axis Audio Quality Assessment](https://mlsanity.com/paper/2507.04094/) (2025)
- [LAPS-Diff: A Diffusion-Based Framework for Singing Voice Synthesis With Language Aware Prosody-Style Guided Learning](https://mlsanity.com/paper/2507.04966/) (2025)

## Abstract (arXiv)

The choice of a loss function is a critical part of machine learning. This paper evaluated two different loss functions commonly used in regression-task dimensional speech emotion recognition, an error-based and a correlation-based loss functions. We found that using a correlation-based loss function with a concordance correlation coefficient (CCC) loss resulted in better performance than an error-based loss function with mean squared error (MSE) loss and mean absolute error (MAE), in terms of the averaged CCC score. The results are consistent with two input feature sets and two datasets. The scatter plots of test prediction by those two loss functions also confirmed the results measured by CCC scores.
