mlsanityData to 7 Oct 2026

VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music

arXiv 2412.17667 ↗First posted 23 Dec 2024cs.SD cs.MM eess.AScited by 30

Not on the map. Why?

Abstract (arXiv)

In this work, we introduce VERSA, a unified and standardized evaluation toolkit designed for various speech, audio, and music signals. The toolkit features a Pythonic interface with flexible configuration and dependency control, making it user-friendly and efficient. With full installation, VERSA offers 65 metrics with 729 metric variations based on different configurations. These metrics encompass evaluations utilizing diverse external resources, including matching and non-matching reference audio, text transcriptions, and text captions. As a lightweight yet comprehensive toolkit, VERSA is versatile to support the evaluation of a wide range of downstream scenarios. To demonstrate its capabilities, this work highlights example use cases for VERSA, including audio coding, speech synthesis, speech enhancement, singing synthesis, and music generation. The toolkit is available at https://github.com/wavlab-speech/versa.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Dec 2024.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 16; 2026: 14.

30 papers.

Sort:

By area:

  1. 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Modelcited by 60
  2. 2025Recent Advances in Discrete Speech Tokens: A Reviewcited by 42
  3. 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generationcited by 24
  4. 2025AudioJudge: Understanding What Works in Large Audio Model Based Speech Evaluationcited by 20
  5. 2025OpusLM: A Family of Open Unified Speech Language Modelscited by 9
  6. 2025TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systemscited by 7
  7. 2025Chain-of-Thought Training for Open E2E Spoken Dialogue Systemscited by 5
  8. 2026Optimizing Conversational Quality in Spoken Dialogue Systems with Reinforcement Learning from AI Feedbackcited by 5
  9. 2025A Comprehensive Survey on Generative AI for Video-to-Music Generationcited by 4
  10. 2025Chain-of-Thought Reasoning in Streaming Full-Duplex End-to-End Spoken Dialogue Systemscited by 4
  11. 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captionscited by 4
  12. 2025MIKU-PAL: An Automated and Standardized Multi-Modal Method for Speech Paralinguistic and Affect Labelingcited by 3
18 more
  1. 2025VSSFlow: Unifying Video-conditioned Sound and Speech Generation via Joint Learningcited by 3
  2. 2025Frequency-Weighted Training Losses for Phoneme-Level DNN-based Speech Enhancementcited by 1
  3. 2026Do Neural Codecs Generalize? A Controlled Study Across Unseen Languages and Non-Speech Taskscited by 1
  4. 2026MamTra: A Hybrid Mamba-Transformer Backbone for Speech Synthesiscited by 1
  5. 2026The False Resonance: A Critical Examination of Emotion Embedding Similarity for Speech Generation Evaluationcited by 1
  6. 2025AudioCodecBench: A Comprehensive Benchmark for Audio Codec Evaluationcited by 0
  7. 2025AU-Harness: An Open-Source Toolkit for Holistic Evaluation of Audio LLMscited by 0
  8. 2025Conversational Orientation Reasoning: Egocentric-to-Allocentric Navigation with Multimodal Chain-of-Thoughtcited by 0
  9. 2025Assessing speech quality metrics for evaluation of neural audio codecs under clean speech conditionscited by 0
  10. 2026STACodec: Semantic Token Assignment for Balancing Acoustic Fidelity and Semantic Information in Audio Codecscited by 0
  11. 2026LLM-Guided Reinforcement Learning for Audio-Visual Speech Enhancementcited by 0
  12. 2026Multilingual Multi-Speaker Unit Vocoders: A Systematic Analysis of Discrete Speech Representationscited by 0
  13. 2026Investigating Human-Model Discrepancies in Speech Quality Assessment via Acoustic and Prosodic Perturbationscited by 0
  14. 2026PASQA: Pitch-Accent-Focused Speech Quality Assessment Model Trained on Synthetic Speech with Accent Errorscited by 0
  15. 2026LACE: Layer-Wise Compression for Dynamic Frame Rate Codecscited by 0
  16. 2026HaikuS2S: A Cascaded System For Responding In Versecited by 0
  17. 2026CHiME-9 ECHI: A Machine Learning Challenge for Enhancing Conversations to Address Hearing Impairmentcited by 0
  18. 2026YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speechcited by 0