ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metric
Not on the map. Why?
Abstract (arXiv)
Estimation of perceptual quality in audio and speech is possible using a variety of methods. The combined v3 release of ViSQOL and ViSQOLAudio (for speech and audio, respectively,) provides improvements upon previous versions, in terms of both design and usage. As an open source C++ library or binary with permissive licensing, ViSQOL can now be deployed beyond the research context into production usage. The feedback from internal production teams at Google has helped to improve this new release, and serves to show cases where it is most applicable, as well as to highlight limitations. The new model is benchmarked against real-world data for evaluation purposes. The trends and direction of future work is discussed.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 9; 2023: 7; 2024: 15; 2025: 25; 2026: 16.
76 papers.
Sort:
By area:
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
- 2022High Fidelity Neural Audio Compressioncited by 673
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
- 2022AudioGen: Textually Guided Audio Generationcited by 292
- 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 189
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
- 2024Music2Latent: Consistency Autoencoders for Latent Audio Compressioncited by 33
- 2024DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factorscited by 31
- 2021EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environmentscited by 29
- 2023From Discrete Tokens to High-Fidelity Audio Using Multi-Band Diffusioncited by 22
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matchingcited by 18
38 more
- 2025TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modelingcited by 15
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 13
- 2023DPM-TSE: A Diffusion Probabilistic Model for Target Sound Extractioncited by 12
- 2024PEAVS: Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers' Opinion Scorescited by 12
- 2023Siamese SIREN: Audio Compression with Implicit Neural Representationscited by 11
- 2024SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformercited by 11
- 2025A2SB: Audio-to-Audio Schrodinger Bridgescited by 11
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
- 2022LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoderscited by 8
- 2023TokenSplit: Using Discrete Speech Representations for Direct, Refined, and Transcript-Conditioned Speech Separation and Recognitioncited by 8
- 2024Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speechcited by 7
- 2025MagiCodec: Simple Masked Gaussian-Injected Codec for High-Fidelity Reconstruction and Generationcited by 7
- 2025CoDiCodec: Unifying Continuous and Discrete Compressed Representations of Audiocited by 7
- 2022Disentangling speech from surroundings with neural embeddingscited by 6
- 2024Variable Bitrate Residual Vector Quantization for Audio Codingcited by 6
- 2025PAST: Phonetic-Acoustic Speech Tokenizercited by 6
- 2022A Text-to-Speech Pipeline, Evaluation Methodology, and Initial Fine-Tuning Results for Child Speech Synthesiscited by 5
- 2022Ultra-Low-Bitrate Speech Coding with Pretrained Transformerscited by 5
- 2024Gull: A Generative Multifunctional Audio Codeccited by 5
- 2025UniWav: Towards Unified Pre-training for Speech Representation Learning and Generationcited by 5
- 2026UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Modelscited by 5
- 2024RT-LA-VocE: Real-Time Low-SNR Audio-Visual Speech Enhancementcited by 4
- 2025Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decodingcited by 4
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancementcited by 4
- 2025SpectroStream: A Versatile Neural Codec for General Audiocited by 4
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generationcited by 4
- 2022NESC: Robust Neural End-2-End Speech Coding with GANscited by 3
- 2024PSCodec: A Series of High-Fidelity Low-bitrate Neural Speech Codecs Leveraging Prompt Encoderscited by 3
- 2024A Closer Look at Neural Codec Resynthesis: Bridging the Gap between Codec and Waveform Generationcited by 3
- 2025Universal Speech Token Learning via Low-Bitrate Neural Codec and Pretrained Representationscited by 3
- 2025EDNet: A Versatile Speech Enhancement Framework with Gating Mamba Mechanism and Phase Shift-Invariant Trainingcited by 3
- 2024Enhancing Out-of-Vocabulary Performance of Indian TTS Systems for Practical Applications through Low-Effort Data Strategiescited by 2
- 2024WaveTransfer: A Flexible End-to-end Multi-instrument Timbre Transfer with Diffusioncited by 2
- 2025High-Fidelity Music Vocoder using Neural Audio Codecscited by 2
- 2025Spectrogram Patch Codec: A 2D Block-Quantized VQ-VAE and HiFi-GAN for Neural Speech Codingcited by 2
- 2025HarmonicAttack: An Adaptive Cross-Domain Audio Watermark Removalcited by 2
- 2022Wideband Audio Waveform Evaluation Networks: Efficient, Accurate Estimation of Speech Qualitiescited by 1
- 2023What You Hear Is What You See: Audio Quality Metrics From Image Quality Metricscited by 1
50 most cited of 76 All 76 (JSON)
- 2026Multichannel Audio Quality Assessment: Extending Pretrained Perceptual Models to Spatial Audio29 Sep 2026
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution21 Sep 2026
- 2026Decoupled Latent Flow Matching for Few-Step Joint Vocal-Accompaniment Separation31 Aug 2026
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs4 Aug 2026
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens31 Jul 2026
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering22 Jul 2026
- 2026Privacy-Preserving Robustness Verification for Neural Networks6 Jul 2026
- 2026Conversational Human Audio-visual Talking Dialogue Generation2 Jul 2026
- 2026LambdaMark: Semantic Audio Watermarking for Robustness and Radioactivity19 Jun 2026
- 2026PHALAR: Phasors for Learned Musical Audio Representations5 May 2026
- 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching10 Apr 2026
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space2 Mar 2026
38 more
- 2026SAM Audio Judge: A Unified Multimodal Framework for Perceptual Evaluation of Audio Separation27 Jan 2026
- 2026ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matching19 Jan 2026
- 2026Do Neural Codecs Generalize? A Controlled Study Across Unseen Languages and Non-Speech Tasks18 Jan 2026
- 2026UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Models4 Jan 2026
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generation29 Dec 2025
- 2025Decoder-Side Semantic Conditioning for Low-Bitrate Neural Speech Compression25 Dec 2025
- 2025Large Speech Model Enabled Semantic Communication4 Dec 2025
- 2025HarmonicAttack: An Adaptive Cross-Domain Audio Watermark Removal26 Nov 2025
- 2025Perceptually Aligning Representations of Music via Noise-Augmented Autoencoders7 Nov 2025
- 2025Enhanced Generative Machine Listener25 Sep 2025
- 2025Audio Super-Resolution with Latent Bridge Models22 Sep 2025
- 2025Spiking Vocos: An Energy-Efficient Neural Vocoder16 Sep 2025
- 2025CoDiCodec: Unifying Continuous and Discrete Compressed Representations of Audio11 Sep 2025
- 2025Spectrogram Patch Codec: A 2D Block-Quantized VQ-VAE and HiFi-GAN for Neural Speech Coding2 Sep 2025
- 2025SpectroStream: A Versatile Neural Codec for General Audio7 Aug 2025
- 2025Balalaika: Data-Centric, Prosody-Aware Annotation Pipeline for Russian Speech17 Jul 2025
- 2025EDNet: A Versatile Speech Enhancement Framework with Gating Mamba Mechanism and Phase Shift-Invariant Training19 Jun 2025
- 2025Neural Spectral Band Generation for Audio Coding7 Jun 2025
- 2025MagiCodec: Simple Masked Gaussian-Injected Codec for High-Fidelity Reconstruction and Generation31 May 2025
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement30 May 2025
- 2025PAST: Phonetic-Acoustic Speech Tokenizer20 May 2025
- 2025Universal Semantic Disentangled Privacy-preserving Speech Representation Learning19 May 2025
- 2025TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling9 Apr 2025
- 2025Universal Speech Token Learning via Low-Bitrate Neural Codec and Pretrained Representations15 Mar 2025
- 2025UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation2 Mar 2025
- 2025High-Fidelity Music Vocoder using Neural Audio Codecs18 Feb 2025
- 2025Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decoding29 Jan 2025
- 2025A2SB: Audio-to-Audio Schrodinger Bridges20 Jan 2025
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan 2025
- 2024A Closer Look at Neural Codec Resynthesis: Bridging the Gap between Codec and Waveform Generation29 Oct 2024
- 2024Non-intrusive Speech Quality Assessment with Diffusion Models Trained on Clean Speech23 Oct 2024
- 2024Variable Bitrate Residual Vector Quantization for Audio Coding8 Oct 2024
- 2024SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer12 Sep 2024
- 2024WaveTransfer: A Flexible End-to-end Multi-instrument Timbre Transfer with Diffusion6 Sep 2024
- 2024Music2Latent: Consistency Autoencoders for Latent Audio Compression12 Aug 2024
- 2024Enhancing Out-of-Vocabulary Performance of Indian TTS Systems for Practical Applications through Low-Effort Data Strategies18 Jul 2024
- 2024RT-LA-VocE: Real-Time Low-SNR Audio-Visual Speech Enhancement10 Jul 2024
- 2024DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors17 Jun 2024
50 newest of 76 All 76 (JSON)
- 2024Music2Latent: Consistency Autoencoders for Latent Audio Compressioncited by 33
- 2024DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factorscited by 31
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matchingcited by 18
- 2023DPM-TSE: A Diffusion Probabilistic Model for Target Sound Extractioncited by 12
- 2024SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformercited by 11
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
- 2025Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decodingcited by 4
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancementcited by 4
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generationcited by 4
- 2024WaveTransfer: A Flexible End-to-end Multi-instrument Timbre Transfer with Diffusioncited by 2
- 2024Non-intrusive Speech Quality Assessment with Diffusion Models Trained on Clean Speechcited by 1
- 2026ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matchingcited by 1
12 most cited of 17 All 17 (JSON)
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution21 Sep 2026
- 2026Decoupled Latent Flow Matching for Few-Step Joint Vocal-Accompaniment Separation31 Aug 2026
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs4 Aug 2026
- 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching10 Apr 2026
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space2 Mar 2026
- 2026ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matching19 Jan 2026
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generation29 Dec 2025
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancement30 May 2025
- 2025Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decoding29 Jan 2025
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan 2025
- 2024Non-intrusive Speech Quality Assessment with Diffusion Models Trained on Clean Speech23 Oct 2024
- 2024SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer12 Sep 2024
12 newest of 17 All 17 (JSON)
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
- 2022High Fidelity Neural Audio Compressioncited by 673
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
- 2022AudioGen: Textually Guided Audio Generationcited by 292
- 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 189
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
- 2021EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environmentscited by 29
- 2023From Discrete Tokens to High-Fidelity Audio Using Multi-Band Diffusioncited by 22
- 2025TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modelingcited by 15
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 13
- 2024PEAVS: Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers' Opinion Scorescited by 12
12 most cited of 58 All 58 (JSON)
- 2026Multichannel Audio Quality Assessment: Extending Pretrained Perceptual Models to Spatial Audio29 Sep 2026
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens31 Jul 2026
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering22 Jul 2026
- 2026Privacy-Preserving Robustness Verification for Neural Networks6 Jul 2026
- 2026Conversational Human Audio-visual Talking Dialogue Generation2 Jul 2026
- 2026LambdaMark: Semantic Audio Watermarking for Robustness and Radioactivity19 Jun 2026
- 2026PHALAR: Phasors for Learned Musical Audio Representations5 May 2026
- 2026SAM Audio Judge: A Unified Multimodal Framework for Perceptual Evaluation of Audio Separation27 Jan 2026
- 2026Do Neural Codecs Generalize? A Controlled Study Across Unseen Languages and Non-Speech Tasks18 Jan 2026
- 2026UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Models4 Jan 2026
- 2025Decoder-Side Semantic Conditioning for Low-Bitrate Neural Speech Compression25 Dec 2025
- 2025Large Speech Model Enabled Semantic Communication4 Dec 2025
12 newest of 58 All 58 (JSON)