mlsanityData to 14 Oct 2026

DeRA-MOS: Optimizing Text-to-Music Evaluation via Decoupled Listwise Ranking and Modality Alignment

arXiv 2606.10010 ↗First posted 8 Jun 2026eess.AS cs.AI cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Evaluating text-to-music (TTM) systems remains expensive because music impression (MI) and text alignment (TA) scores rely on human mean opinion scores (MOS). Most automatic MOS estimators are trained with point-wise regression or distributional classification. These objectives do not directly optimize rank-based metrics and provide weak geometric constraints for cross-modal coherence. To address these gaps, we propose DeRA-MOS, a decoupled optimization framework for TTM evaluation. For MI, we introduce a batch-aware listwise ranking loss that models relative order within each mini-batch and better aligns with evaluation based on Spearman's rank correlation coefficient (SRCC). For TA, we introduce a score-anchored modality alignment loss that maps human scores to target audio-text similarity and regularizes the latent space before fusion. By effectively mitigating the point-wise training mismatch and modality drift, experiments on MusicEval demonstrate that our decoupled framework yields substantial improvements in both MI and TA ranking metrics, establishing a robust paradigm for large-scale TTM evaluation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

26 of 40 references.

References · 26

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  4. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  5. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  6. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  7. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  8. 2023Simple and Controllable Music Generationcited by 488
  9. 2023MusicLM: Generating Music From Textcited by 448
  10. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 390
  11. 2021AudioCLIP: Extending CLIP to Image, Text and Audiocited by 339
  12. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 324
14 more
  1. 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 192
  2. 2019Rank consistent ordinal regression for neural networks with application to age estimationcited by 133
  3. 2019MOSNet: Deep Learning based Objective Assessment for Voice Conversioncited by 127
  4. 2014Label Distribution Learningcited by 124
  5. 2023Adapting Frechet Audio Distance for Generative Music Evaluationcited by 92
  6. 2021Generalization Ability of MOS Prediction Networkscited by 69
  7. 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 68
  8. 2021MBNet: MOS Prediction for Synthesized Speech with Mean-Bias Networkcited by 37
  9. 2021LDNet: Unified Listener Dependent Modeling in MOS Prediction for Synthetic Speechcited by 24
  10. 2025MusicEval: A Generative Music Dataset with Expert Ratings for Automatic Text-to-Music Evaluationcited by 18
  11. 2025The AudioMOS Challenge 2025cited by 8
  12. 2025QAMRO: Quality-aware Adaptive Margin Ranking Optimization for Human-aligned Assessment of Audio Generation Systemscited by 3
  13. 2025DRASP: A Dual-Resolution Attentive Statistics Pooling Framework for Automatic MOS Predictioncited by 2
  14. 2025ASTAR-NTU solution to AudioMOS Challenge 2025 Track1cited by 1

Built on by

Not cited yet.