mlsanityData to 7 Oct 2026

The VoiceMOS Challenge 2022

arXiv 2203.11389 ↗First posted 21 Mar 2022cs.SD eess.AScited by 57

Not on the map. Why?

Abstract (arXiv)

We present the first edition of the VoiceMOS Challenge, a scientific event that aims to promote the study of automatic prediction of the mean opinion score (MOS) of synthetic speech. This challenge drew 22 participating teams from academia and industry who tried a variety of approaches to tackle the problem of predicting human ratings of synthesized speech. The listening test data for the main track of the challenge consisted of samples from 187 different text-to-speech and voice conversion systems spanning over a decade of research, and the out-of-domain track consisted of data from more recent systems rated in a separate listening test. Results of the challenge show the effectiveness of fine-tuning self-supervised speech models for the MOS prediction task, as well as the difficulty of predicting MOS ratings for unseen speakers and listeners, and for unseen systems in the out-of-domain setting.

Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Mar 2022.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 12; 2023: 11; 2024: 10; 2025: 9; 2026: 15.

57 papers.

Sort:

By area:

  1. 2024The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speechcited by 78
  2. 2023A Comprehensive Review of Data-Driven Co-Speech Gesture Generationcited by 66
  3. 2022SpeechLMScore: Evaluating speech generation using speech language modelcited by 19
  4. 2022SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesiscited by 18
  5. 2025Differentiable Reward Optimization for LLM based TTS systemcited by 15
  6. 2024TTSDS -- Text-to-Speech Distribution Scorecited by 14
  7. 2024Enabling Auditory Large Language Models for Automatic Speech Quality Evaluationcited by 13
  8. 2022Fusion of Self-supervised Learned Models for MOS Predictioncited by 10
  9. 2022SQuId: Measuring Speech Naturalness in Many Languagescited by 10
  10. 2022DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scorescited by 7
  11. 2024Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speechcited by 7
  12. 2024DLPO: Diffusion Model Loss-Guided Reinforcement Learning for Fine-Tuning Text-to-Speech Diffusion Modelscited by 7
38 more
  1. 2024FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillationcited by 7
  2. 2024USAT: A Universal Speaker-Adaptive Text-to-Speech Approachcited by 6
  3. 2023Disentanglement in a GAN for Unconditional Speech Synthesiscited by 4
  4. 2023On the Use of Self-Supervised Speech Representations in Spontaneous Speech Synthesiscited by 4
  5. 2023Evaluating Methods for Ground-Truth-Free Foreign Accent Conversioncited by 4
  6. 2023On the Relevance of Phoneme Duration Variability of Synthesized Training Data for Automatic Speech Recognitioncited by 4
  7. 2025From Scores to Preferences: Redefining MOS Benchmarking for Speech Quality Reward Modelingcited by 4
  8. 2022GAN You Hear Me? Reclaiming Unconditional Speech Synthesis from Diffusion Modelscited by 3
  9. 2023Resource-Efficient Fine-Tuning Strategies for Automatic MOS Prediction in Text-to-Speech for Low-Resource Languagescited by 3
  10. 2025Fine-Tuning Text-to-Speech Diffusion Models Using Reinforcement Learning with Human Feedbackcited by 3
  11. 2022Investigating Content-Aware Neural Text-To-Speech MOS Prediction Using Prosodic and Linguistic Featurescited by 2
  12. 2023Strategies in Transfer Learning for Low-Resource Speech Synthesis: Phone Mapping, Features Input, and Source Language Selectioncited by 2
  13. 2024A Collection of Pragmatic-Similarity Judgments over Spoken Dialog Utterancescited by 2
  14. 2025LatentVoiceGrad: Nonparallel Voice Conversion with Latent Diffusion/Flow-Matching Modelscited by 2
  15. 2025Objective Evaluation of Prosody and Intelligibility in Speech Synthesis via Conditional Prediction of Discrete Tokenscited by 2
  16. 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversioncited by 2
  17. 2026Something from Nothing: Data Augmentation for Robust Severity Level Estimation of Dysarthric Speechcited by 2
  18. 2026RW-Voice-EQ Bench: A Real World Benchmark for Evaluating Voice AI Systemscited by 2
  19. 2022Using Rater and System Metadata to Explain Variance in the VoiceMOS Challenge 2022 Datasetcited by 1
  20. 2022Predicting pairwise preferences between TTS audio stimuli using parallel ratings data and anti-symmetric twin neural networkscited by 1
  21. 2023Multi-Task Pseudo-Label Learning for Non-Intrusive Speech Quality Assessment Modelcited by 1
  22. 2025Improving Perceptual Audio Aesthetic Assessment via Triplet Loss and Self-Supervised Embeddingscited by 1
  23. 2026SAM Audio Judge: A Unified Multimodal Framework for Perceptual Evaluation of Audio Separationcited by 1
  24. 2026Rho-Perfect: Correlation Ceiling For Subjective Evaluation Datasetscited by 1
  25. 2026AnimeScore: A Preference-Based Dataset and Framework for Evaluating Anime-Like Speech Stylecited by 1
  26. 2026PSP: An Interpretable Per-Dimension Accent Benchmark for Indic Text-to-Speechcited by 1
  27. 2026ANCHOR: Autoregressive Non-intrusive Chunk-Ordered Refinement for Joint Multi-Resolution Speech Quality Modelingcited by 1
  28. 2026Auditing Protocol-Level Shortcuts in Large Audio Language Model Judges for Speech Evaluationcited by 1
  29. 2026The Limits of Reference-Free Speech Quality Metrics as Evaluators and Rewards on Modern Text-to-Speechcited by 1
  30. 2022Improving Self-Supervised Learning-based MOS Prediction Networkscited by 0
  31. 2022Comparison of Speech Representations for the MOS Prediction Systemcited by 0
  32. 2022R-MelNet: Reduced Mel-Spectral Modeling for Neural TTScited by 0
  33. 2023MooseNet: A Trainable Metric for Synthesized Speech with a PLDA Modulecited by 0
  34. 2023The Effects of Input Type and Pronunciation Dictionary Usage in Transfer Learning for Low-Resource Text-to-Speechcited by 0
  35. 2023Speech Synthesis By Unrolling Diffusion Process using Neural Network Layerscited by 0
  36. 2024Automatic design optimization of preference-based subjective evaluation with online learning in crowdsourcing environmentcited by 0
  37. 2024Training Generative Adversarial Network-Based Vocoder with Limited Data Using Augmentation-Conditional Discriminatorcited by 0
  38. 2025SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Predictioncited by 0

50 most cited of 57 All 57 (JSON)