TorchAudio-Squim: Reference-less Speech Quality and Intelligibility measures in TorchAudio
Not on the map. Why?
Abstract (arXiv)
Measuring quality and intelligibility of a speech signal is usually a critical step in development of speech processing systems. To enable this, a variety of metrics to measure quality and intelligibility under different assumptions have been developed. Through this paper, we introduce tools and a set of models to estimate such known metrics using deep neural networks. These models are made available in the well-established TorchAudio library, the core audio and speech processing library within the PyTorch deep learning framework. We refer to it as TorchAudio-Squim, TorchAudio-Speech QUality and Intelligibility Measures. More specifically, in the current version of TorchAudio-squim, we establish and release models for estimating PESQ, STOI and SI-SDR among objective metrics and MOS among subjective metrics. We develop a novel approach for objective metric estimation and use a recently developed approach for subjective metric estimation. These models operate in a ``reference-less" manner, that is they do not require the corresponding clean speech as reference for speech assessment. Given the unavailability of clean speech and the effortful process of subjective evaluation in real-world situations, such easy-to-use tools would greatly benefit speech processing research and development.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 11; 2025: 22; 2026: 21.
56 papers.
Sort:
By area:
- 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
- 2024Natural language guidance of high-fidelity text-to-speech with synthetic annotationscited by 66
- 2025SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Modelcited by 32
- 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidancecited by 26
- 2025Differentiable Reward Optimization for LLM based TTS systemcited by 15
- 2025NanoCodec: Towards High-Quality Ultra Fast Speech LLM Inferencecited by 14
- 2024SpeechPrompt: Prompting Speech Language Models for Speech Processing Taskscited by 12
- 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inferencecited by 11
- 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speechcited by 11
- 2024Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speechcited by 7
- 2024Rethinking MUSHRA: Addressing Modern Challenges in Text-to-Speech Evaluationcited by 7
- 2025TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systemscited by 7
38 more
- 2025Discrete Diffusion for Generative Modeling of Text-Aligned Speech Tokenscited by 7
- 2023AV2Wav: Diffusion-Based Re-synthesis from Continuous Self-supervised Features for Audio-Visual Speech Enhancementcited by 5
- 2024Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensorscited by 5
- 2026Arab Voices: Mapping Standard and Dialectal Arabic Speech Technologycited by 4
- 2025AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencodercited by 3
- 2025MB-RIRs: a Synthetic Room Impulse Response Dataset with Frequency-Dependent Absorption Coefficientscited by 3
- 2026DuplexChat: Constructing Speaker-Separated Full-Duplex Dialogue Speech at Scale for Spoken Dialogue Language Modelingcited by 3
- 2026VoiceChat-TTS: A Low-Latency Continuous Speech Synthesis Model for Interactive Agentscited by 3
- 2026NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilitiescited by 3
- 2024Direction of Arrival Correction through Speech Quality Feedbackcited by 2
- 2025C2AV-TSE: Context and Confidence-aware Audio Visual Target Speaker Extractioncited by 2
- 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversioncited by 2
- 2026From Diet to Free Lunch: Estimating Auxiliary Signal Properties using Dynamic Pruning Masks in Speech Enhancement Networkscited by 2
- 2024Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whispercited by 1
- 2025Revival with Voice: Multi-modal Controllable Text-to-Speech Synthesiscited by 1
- 2025Training-Free Multi-Step Audio Source Separationcited by 1
- 2025WhiSQA: Non-Intrusive Speech Quality Prediction Using Whisper Encoder Featurescited by 1
- 2025OMHBench: Benchmarking Balanced and Grounded Omni-Modal Multi-Hop Reasoningcited by 1
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimizationcited by 1
- 2026Residual Tokens Enhance Masked Autoencoders for Speech Modelingcited by 1
- 2026Calibration-Reasoning Framework for Descriptive Speech Quality Assessmentcited by 1
- 2026OmniACBench: A Benchmark for Evaluating Context-Grounded Acoustic Control in Omni-Modal Modelscited by 1
- 2026Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languagescited by 1
- 2026The Limits of Reference-Free Speech Quality Metrics as Evaluators and Rewards on Modern Text-to-Speechcited by 1
- 2024Objective and subjective evaluation of speech enhancement methods in the UDASE task of the 7th CHiME challengecited by 0
- 2024Diffusion Synthesizer for Efficient Multilingual Speech to Speech Translationcited by 0
- 2024Run-Time Adaptation of Neural Beamforming for Robust Speech Dereverberation and Denoisingcited by 0
- 2025VisualSpeech: Enhancing Prosody Modeling in TTS Using Videocited by 0
- 2025Multi-agent Auditory Scene Analysiscited by 0
- 2025Supporting SENCOTEN Language Documentation Efforts with Automatic Speech Recognitioncited by 0
- 2025Unseen Speaker and Language Adaptation for Lightweight Text-To-Speech with Adapterscited by 0
- 2025LatinX: Aligning a Multilingual TTS Model with Direct Preference Optimizationcited by 0
- 2025Assessing speech quality metrics for evaluation of neural audio codecs under clean speech conditionscited by 0
- 2026When Fine-Tuning Fails and when it Generalises: Role of Data Diversity and Mixed Training in LLM-based TTScited by 0
- 2026Tagarela - A Portuguese speech dataset from podcastscited by 0
- 2026Polyglot: Multilingual Style Preserving Speech-Driven Facial Animationcited by 0
- 20263DAE: Binaural Quality Assessment for Audio Novel View Synthesis with Spatial Maps and Benchmarkcited by 0
- 2026CleanCodec: Efficient and Robust Speech Tokenization via Perceptually Guided Encodingcited by 0
50 most cited of 56 All 56 (JSON)
- 2026Multi-agent Auditory Scene Analysis: Improved Localization Speed and Robustness by Multi-beamformed Speech Quality Feedback30 Sep 2026
- 2026Reconstructing the Vocal Tract with Differentiable Acoustic Simulation29 Sep 2026
- 2026Audio LLMs Know When They Can't Hear You24 Sep 2026
- 2026AcoustiClaim: A Numeric Claim Benchmark with Instrument Ground Truth24 Sep 2026
- 2026NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilities18 Sep 2026
- 2026Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languages28 Aug 2026
- 2026VoiceChat-TTS: A Low-Latency Continuous Speech Synthesis Model for Interactive Agents13 Aug 2026
- 2026DuplexChat: Constructing Speaker-Separated Full-Duplex Dialogue Speech at Scale for Spoken Dialogue Language Modeling6 Jul 2026
- 2026The Limits of Reference-Free Speech Quality Metrics as Evaluators and Rewards on Modern Text-to-Speech2 Jul 2026
- 2026Is Natural Always Appropriate? Investigating Naturalness and Appropriateness Across Different Domains for TTS Evaluation30 Jun 2026
- 2026Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors17 Jun 2026
- 2026CleanCodec: Efficient and Robust Speech Tokenization via Perceptually Guided Encoding3 Jun 2026
38 more
- 20263DAE: Binaural Quality Assessment for Audio Novel View Synthesis with Spatial Maps and Benchmark28 May 2026
- 2026Polyglot: Multilingual Style Preserving Speech-Driven Facial Animation17 Apr 2026
- 2026OmniACBench: A Benchmark for Evaluating Context-Grounded Acoustic Control in Omni-Modal Models25 Mar 2026
- 2026Tagarela - A Portuguese speech dataset from podcasts16 Mar 2026
- 2026When Fine-Tuning Fails and when it Generalises: Role of Data Diversity and Mixed Training in LLM-based TTS11 Mar 2026
- 2026Calibration-Reasoning Framework for Descriptive Speech Quality Assessment10 Mar 2026
- 2026From Diet to Free Lunch: Estimating Auxiliary Signal Properties using Dynamic Pruning Masks in Speech Enhancement Networks11 Feb 2026
- 2026Residual Tokens Enhance Masked Autoencoders for Speech Modeling27 Jan 2026
- 2026Arab Voices: Mapping Standard and Dialectal Arabic Speech Technology19 Jan 2026
- 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversion31 Oct 2025
- 2025Assessing speech quality metrics for evaluation of neural audio codecs under clean speech conditions29 Sep 2025
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimization26 Sep 2025
- 2025Discrete Diffusion for Generative Modeling of Text-Aligned Speech Tokens24 Sep 2025
- 2025LatinX: Aligning a Multilingual TTS Model with Direct Preference Optimization6 Sep 2025
- 2025Unseen Speaker and Language Adaptation for Lightweight Text-To-Speech with Adapters25 Aug 2025
- 2025OMHBench: Benchmarking Balanced and Grounded Omni-Modal Multi-Hop Reasoning22 Aug 2025
- 2025NanoCodec: Towards High-Quality Ultra Fast Speech LLM Inference7 Aug 2025
- 2025WhiSQA: Non-Intrusive Speech Quality Prediction Using Whisper Encoder Features4 Aug 2025
- 2025Supporting SENCOTEN Language Documentation Efforts with Automatic Speech Recognition14 Jul 2025
- 2025MB-RIRs: a Synthetic Room Impulse Response Dataset with Frequency-Dependent Absorption Coefficients13 Jul 2025
- 2025Differentiable Reward Optimization for LLM based TTS system8 Jul 2025
- 2025Multi-agent Auditory Scene Analysis3 Jul 2025
- 2025TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systems24 Jun 2025
- 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech3 Jun 2025
- 2025Training-Free Multi-Step Audio Source Separation26 May 2025
- 2025Revival with Voice: Multi-modal Controllable Text-to-Speech Synthesis25 May 2025
- 2025SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Model21 May 2025
- 2025C2AV-TSE: Context and Confidence-aware Audio Visual Target Speaker Extraction1 Apr 2025
- 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidance7 Feb 2025
- 2025VisualSpeech: Enhancing Prosody Modeling in TTS Using Video31 Jan 2025
- 2025AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder9 Jan 2025
- 2024Rethinking MUSHRA: Addressing Modern Challenges in Text-to-Speech Evaluation19 Nov 2024
- 2024Run-Time Adaptation of Neural Beamforming for Robust Speech Dereverberation and Denoising30 Oct 2024
- 2024Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper20 Sep 2024
- 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inference18 Sep 2024
- 2024SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks23 Aug 2024
- 2024Direction of Arrival Correction through Speech Quality Feedback13 Aug 2024
- 2024Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensors16 Jul 2024
50 newest of 56 All 56 (JSON)
- 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidancecited by 26
- 2025Differentiable Reward Optimization for LLM based TTS systemcited by 15
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimizationcited by 1
- 2026The Limits of Reference-Free Speech Quality Metrics as Evaluators and Rewards on Modern Text-to-Speechcited by 1
- 2025LatinX: Aligning a Multilingual TTS Model with Direct Preference Optimizationcited by 0
- 2026The Limits of Reference-Free Speech Quality Metrics as Evaluators and Rewards on Modern Text-to-Speech2 Jul 2026
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimization26 Sep 2025
- 2025LatinX: Aligning a Multilingual TTS Model with Direct Preference Optimization6 Sep 2025
- 2025Differentiable Reward Optimization for LLM based TTS system8 Jul 2025
- 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidance7 Feb 2025
- 2024Natural language guidance of high-fidelity text-to-speech with synthetic annotationscited by 66
- 2025SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Modelcited by 32
- 2025NanoCodec: Towards High-Quality Ultra Fast Speech LLM Inferencecited by 14
- 2024SpeechPrompt: Prompting Speech Language Models for Speech Processing Taskscited by 12
- 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inferencecited by 11
- 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speechcited by 11
- 2024Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speechcited by 7
- 2024Rethinking MUSHRA: Addressing Modern Challenges in Text-to-Speech Evaluationcited by 7
- 2025TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systemscited by 7
- 2024Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensorscited by 5
- 2026Arab Voices: Mapping Standard and Dialectal Arabic Speech Technologycited by 4
- 2025AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencodercited by 3
12 most cited of 45 All 45 (JSON)
- 2026Multi-agent Auditory Scene Analysis: Improved Localization Speed and Robustness by Multi-beamformed Speech Quality Feedback30 Sep 2026
- 2026Reconstructing the Vocal Tract with Differentiable Acoustic Simulation29 Sep 2026
- 2026Audio LLMs Know When They Can't Hear You24 Sep 2026
- 2026AcoustiClaim: A Numeric Claim Benchmark with Instrument Ground Truth24 Sep 2026
- 2026NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilities18 Sep 2026
- 2026Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languages28 Aug 2026
- 2026DuplexChat: Constructing Speaker-Separated Full-Duplex Dialogue Speech at Scale for Spoken Dialogue Language Modeling6 Jul 2026
- 2026Is Natural Always Appropriate? Investigating Naturalness and Appropriateness Across Different Domains for TTS Evaluation30 Jun 2026
- 2026Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors17 Jun 2026
- 2026CleanCodec: Efficient and Robust Speech Tokenization via Perceptually Guided Encoding3 Jun 2026
- 20263DAE: Binaural Quality Assessment for Audio Novel View Synthesis with Spatial Maps and Benchmark28 May 2026
- 2026Polyglot: Multilingual Style Preserving Speech-Driven Facial Animation17 Apr 2026
12 newest of 45 All 45 (JSON)