The AudioMOS Challenge 2025
Not on the map. Why?
Abstract (arXiv)
This is the summary paper for the AudioMOS Challenge 2025, the very first challenge for automatic subjective quality prediction for synthetic audio. The challenge consists of three tracks. The first track aims to assess text-to-music samples in terms of overall quality and textual alignment. The second track is based on the four evaluation dimensions of Meta Audiobox Aesthetics, and the test set consists of text-to-speech, text-to-audio, and text-to-music samples. The third track focuses on synthetic speech quality assessment in different sampling rates. The challenge attracted 24 unique teams from both academia and industry, and improvements over the baselines were confirmed. The outcome of this challenge is expected to facilitate development and progress in the field of automatic evaluation for audio generation systems.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Sep 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026MuQ-Eval: An Open-Source Per-Sample Quality Metric for AI Music Generation Evaluationcited by 6
- 2026GSRM: Generative Speech Reward Model for Speech RLHFcited by 4
- 2026JASTIN: Aligning LLMs for Zero-Shot Audio and Speech Evaluation via Natural Language Instructionscited by 2
- 2026SA-SSL-MOS: Self-supervised Learning MOS Prediction with Spectral Augmentation for Generalized Multi-Rate Speech Assessmentcited by 0
- 2026Robust Generative Audio Quality Assessment: Disentangling Quality from Spurious Correlationscited by 0
- 2026DeRA-MOS: Optimizing Text-to-Music Evaluation via Decoupled Listwise Ranking and Modality Alignmentcited by 0
- 2026DAMOS: Learning Distortion-Aware Speech Quality Assessment through Explicit Distortion Localizationcited by 0
- 2026XSQ-AST: An Explainable Audio Spectrogram Transformer Framework for Localising Synthetic Speech Artifactscited by 0
- 2026XSQ-AST: An Explainable Audio Spectrogram Transformer Framework for Localising Synthetic Speech Artifacts21 Sep 2026
- 2026DAMOS: Learning Distortion-Aware Speech Quality Assessment through Explicit Distortion Localization21 Aug 2026
- 2026DeRA-MOS: Optimizing Text-to-Music Evaluation via Decoupled Listwise Ranking and Modality Alignment8 Jun 2026
- 2026JASTIN: Aligning LLMs for Zero-Shot Audio and Speech Evaluation via Natural Language Instructions6 May 2026
- 2026MuQ-Eval: An Open-Source Per-Sample Quality Metric for AI Music Generation Evaluation24 Mar 2026
- 2026Robust Generative Audio Quality Assessment: Disentangling Quality from Spurious Correlations17 Mar 2026
- 2026SA-SSL-MOS: Self-supervised Learning MOS Prediction with Spectral Augmentation for Generalized Multi-Rate Speech Assessment16 Feb 2026
- 2026GSRM: Generative Speech Reward Model for Speech RLHF14 Feb 2026