mlsanityData to 7 Oct 2026

Speech MOS multi-task learning and rater bias correction

arXiv 2212.01911 ↗First posted 4 Dec 2022cs.SD cs.AI eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Perceptual speech quality is an important performance metric for teleconferencing applications. The mean opinion score (MOS) is standardized for the perceptual evaluation of speech quality and is obtained by asking listeners to rate the quality of a speech sample. Recently, there has been increasing research interest in developing models for estimating MOS blindly. Here we propose a multi-task framework to include additional labels and data in training to improve the performance of a blind MOS estimation model. Experimental results indicate that the proposed model can be trained to jointly estimate MOS, reverberation time (T60), and clarity (C50) by combining two disjoint data sets in training, one containing only MOS labels and the other containing only T60 and C50 labels. Furthermore, we use a semi-supervised framework to combine two MOS data sets in training, one containing only MOS labels (per ITU-T Recommendation P.808), and the other containing separate scores for speech signal, background noise, and overall quality (per ITU-T Recommendation P.835). Finally, we present preliminary results for addressing individual rater bias in the MOS labels.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 32 references that are in the map. First posted on arXiv 4 Dec 2022.

Builds on

11 of 32 references.

References · 11

  1. 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 235
  2. 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 189
  3. 2020The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Resultscited by 128
  4. 2019Learning a Deep ConvNet for Multi-label Classification with Partial Labelscited by 124
  5. 2022ICASSP 2022 Deep Noise Suppression Challengecited by 57
  6. 2020Multitask Emotion Recognition with Incomplete Labelscited by 39
  7. 2022Large Loss Matters in Weakly Supervised Multi-Label Classificationcited by 38
  8. 2020An Open source Implementation of ITU-T Recommendation P.808 with Validationcited by 27
  9. 2021Multi-label Classification with Partial Annotations using Class-aware Selective Losscited by 25
  10. 2022ConferencingSpeech 2022 Challenge: Non-intrusive Objective Speech Quality Assessment (NISQA) Challenge for Online Conferencing Applicationscited by 15
  11. 2022Predicting score distribution to improve non-intrusive speech quality estimationcited by 2

Built on by

Not cited yet.