End-to-End Text-Dependent Speaker Verification
Not on the map. Why?
Abstract (arXiv)
In this paper we present a data-driven, integrated approach to speaker verification, which maps a test utterance and a few reference utterances directly to a single score for verification and jointly optimizes the system's components using the same evaluation protocol and metric as at test time. Such an approach will result in simple and efficient systems, requiring little domain-specific knowledge and making few model assumptions. We implement the idea by formulating the problem as a single neural network architecture, including the estimation of a speaker model on only a few utterances, and evaluate it on our internal "Ok Google" benchmark for text-dependent speaker verification. The proposed approach appears to be very effective for big data applications like ours that require highly accurate, easy-to-maintain systems with a small footprint.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Sep 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 13; 2023: 8; 2024: 7; 2025: 4; 2026: 3.
49 papers.
Sort:
By area:
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 73
- 2021Textless Speech Emotion Conversion using Discrete and Decomposed Representationscited by 29
- 2023FreqFed: A Frequency Analysis-Based Approach for Mitigating Poisoning Attacks in Federated Learningcited by 25
- 2021fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkitcited by 24
- 2022Bias in Automated Speaker Recognitioncited by 20
- 2021Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learningcited by 16
- 2021Streaming Multi-talker Speech Recognition with Joint Speaker Identificationcited by 12
- 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real Worldcited by 12
- 2021Dr-Vectors: Decision Residual Networks and an Improved Loss for Speaker Recognitioncited by 10
- 2023Zero-shot text-to-speech synthesis conditioned using self-supervised speech representation modelcited by 10
- 2023Disentangling Voice and Content with Self-Supervision for Speaker Recognitioncited by 10
37 more
- 2021What do End-to-End Speech Models Learn about Speaker, Language and Channel Information? A Layer-wise and Neuron-level Analysiscited by 9
- 2026Massive Sound Embedding Benchmark (MSEB)cited by 9
- 2023Text-to-Video: a Two-stage Framework for Zero-shot Identity-agnostic Talking-head Generationcited by 8
- 2023MASTERKEY: Practical Backdoor Attack Against Speaker Verification Systemscited by 8
- 2024RapVerse: Coherent Vocals and Whole-Body Motions Generations from Textcited by 7
- 2022Dictionary Attacks on Speaker Verificationcited by 5
- 2022Ultra-Low-Bitrate Speech Coding with Pretrained Transformerscited by 5
- 2024TinySV: Speaker Verification in TinyML with On-device Learningcited by 5
- 2021Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embeddingcited by 4
- 2022Domain Agnostic Few-shot Learning for Speaker Verificationcited by 4
- 2023Label Aware Speech Representation Learning For Language Identificationcited by 4
- 2024Noise-robust zero-shot text-to-speech synthesis conditioned on self-supervised speech-representation model with adapterscited by 4
- 2025Deep FlexQP: Accelerated Nonlinear Programming via Deep Unfoldingcited by 4
- 2021Real Additive Margin Softmax for Speaker Verificationcited by 3
- 2022Robust Vocal Quality Feature Embeddings for Dysphonic Voice Detectioncited by 3
- 2023Learning Repeatable Speech Embeddings Using An Intra-class Correlation Regularizercited by 3
- 2025CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarkingcited by 3
- 2021Voice Cloning: a Multi-Speaker Text-to-Speech Synthesis Approach based on Transfer Learningcited by 2
- 2021Content-Aware Speaker Embeddings for Speaker Diarisationcited by 2
- 2021SVEva Fair: A Framework for Evaluating Fairness in Speaker Verificationcited by 2
- 2022Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attentioncited by 2
- 2022Parameter-Free Attentive Scoring for Speaker Verificationcited by 2
- 2022Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verificationcited by 2
- 2022SuperVoice: Text-Independent Speaker Verification Using Ultrasound Energy in Human Speechcited by 2
- 2024Is Self-Supervised Learning Enough to Fill in the Gap? A Study on Speech Inpaintingcited by 2
- 2024Lightweight Zero-shot Text-to-Speech with Mixture of Adapterscited by 2
- 2024Improvement and Implementation of a Speech Emotion Recognition Model Based on Dual-Layer LSTMcited by 2
- 2022Defend Data Poisoning Attacks on Voice Authenticationcited by 1
- 2025From Dialect Gaps to Identity Maps: Tackling Variability in Speaker Verificationcited by 1
- 2025Impact of Phonetics on Speaker Identity in Adversarial Voice Attackcited by 1
- 2021Triplet loss based embeddings for forensic speaker identification in Spanishcited by 0
- 2022A Multi-tasking Model of Speaker-Keyword Classification for Keeping Human in the Loop of Drone-assisted Inspectioncited by 0
- 2022Unsupervised Speaker Diarization that is Agnostic to Language, Overlap-Aware, and Tuning Freecited by 0
- 2023MASR: Multi-label Aware Speech Representationcited by 0
- 2024Raw Audio Classification with Cosine Convolutional Neural Network (CosCovNN)cited by 0
- 2026Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Modelscited by 0
- 2026DriveDNA: A Large-Scale Multimodal Naturalistic Driving Dataset and Benchmark for Driving Style Identificationcited by 0
- 2026DriveDNA: A Large-Scale Multimodal Naturalistic Driving Dataset and Benchmark for Driving Style Identification26 Jul 2026
- 2026Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Models18 Jul 2026
- 2026Massive Sound Embedding Benchmark (MSEB)6 Feb 2026
- 2025Deep FlexQP: Accelerated Nonlinear Programming via Deep Unfolding1 Dec 2025
- 2025Impact of Phonetics on Speaker Identity in Adversarial Voice Attack18 Sep 2025
- 2025From Dialect Gaps to Identity Maps: Tackling Variability in Speaker Verification21 Apr 2025
- 2025CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarking2 Mar 2025
- 2024Raw Audio Classification with Cosine Convolutional Neural Network (CosCovNN)30 Nov 2024
- 2024Improvement and Implementation of a Speech Emotion Recognition Model Based on Dual-Layer LSTM14 Nov 2024
- 2024Lightweight Zero-shot Text-to-Speech with Mixture of Adapters1 Jul 2024
- 2024TinySV: Speaker Verification in TinyML with On-device Learning3 Jun 2024
- 2024RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text30 May 2024
37 more
- 2024Is Self-Supervised Learning Enough to Fill in the Gap? A Study on Speech Inpainting30 May 2024
- 2024Noise-robust zero-shot text-to-speech synthesis conditioned on self-supervised speech-representation model with adapters10 Jan 2024
- 2023FreqFed: A Frequency Analysis-Based Approach for Mitigating Poisoning Attacks in Federated Learning7 Dec 2023
- 2023Learning Repeatable Speech Embeddings Using An Intra-class Correlation Regularizer25 Oct 2023
- 2023Disentangling Voice and Content with Self-Supervision for Speaker Recognition2 Oct 2023
- 2023MASTERKEY: Practical Backdoor Attack Against Speaker Verification Systems13 Sep 2023
- 2023Text-to-Video: a Two-stage Framework for Zero-shot Identity-agnostic Talking-head Generation12 Aug 2023
- 2023MASR: Multi-label Aware Speech Representation20 Jul 2023
- 2023Label Aware Speech Representation Learning For Language Identification7 Jun 2023
- 2023Zero-shot text-to-speech synthesis conditioned using self-supervised speech representation model24 Apr 2023
- 2022Robust Vocal Quality Feature Embeddings for Dysphonic Voice Detection17 Nov 2022
- 2022Defend Data Poisoning Attacks on Voice Authentication9 Sep 2022
- 2022Unsupervised Speaker Diarization that is Agnostic to Language, Overlap-Aware, and Tuning Free25 Jul 2022
- 2022A Multi-tasking Model of Speaker-Keyword Classification for Keeping Human in the Loop of Drone-assisted Inspection8 Jul 2022
- 2022Ultra-Low-Bitrate Speech Coding with Pretrained Transformers5 Jul 2022
- 2022Domain Agnostic Few-shot Learning for Speaker Verification28 Jun 2022
- 2022SuperVoice: Text-Independent Speaker Verification Using Ultrasound Energy in Human Speech28 May 2022
- 2022Dictionary Attacks on Speaker Verification24 Apr 2022
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakers20 Apr 2022
- 2022Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verification31 Mar 2022
- 2022Parameter-Free Attentive Scoring for Speaker Verification10 Mar 2022
- 2022Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attention25 Jan 2022
- 2022Bias in Automated Speaker Recognition24 Jan 2022
- 2021Textless Speech Emotion Conversion using Discrete and Decomposed Representations14 Nov 2021
- 2021Real Additive Margin Softmax for Speaker Verification18 Oct 2021
- 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real World20 Sep 2021
- 2021fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkit14 Sep 2021
- 2021SVEva Fair: A Framework for Evaluating Fairness in Speaker Verification26 Jul 2021
- 2021Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding14 Jul 2021
- 2021What do End-to-End Speech Models Learn about Speaker, Language and Channel Information? A Layer-wise and Neuron-level Analysis1 Jul 2021
- 2021Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning1 Jun 2021
- 2021Streaming Multi-talker Speech Recognition with Joint Speaker Identification5 Apr 2021
- 2021Dr-Vectors: Decision Residual Networks and an Improved Loss for Speaker Recognition5 Apr 2021
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representations1 Apr 2021
- 2021Triplet loss based embeddings for forensic speaker identification in Spanish24 Feb 2021
- 2021Content-Aware Speaker Embeddings for Speaker Diarisation12 Feb 2021
- 2021Voice Cloning: a Multi-Speaker Text-to-Speech Synthesis Approach based on Transfer Learning10 Feb 2021
- 2022Defend Data Poisoning Attacks on Voice Authenticationcited by 1
- 2022Defend Data Poisoning Attacks on Voice Authentication9 Sep 2022
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 73
- 2021Textless Speech Emotion Conversion using Discrete and Decomposed Representationscited by 29
- 2023FreqFed: A Frequency Analysis-Based Approach for Mitigating Poisoning Attacks in Federated Learningcited by 25
- 2021fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkitcited by 24
- 2022Bias in Automated Speaker Recognitioncited by 20
- 2021Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learningcited by 16
- 2021Streaming Multi-talker Speech Recognition with Joint Speaker Identificationcited by 12
- 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real Worldcited by 12
- 2021Dr-Vectors: Decision Residual Networks and an Improved Loss for Speaker Recognitioncited by 10
- 2023Zero-shot text-to-speech synthesis conditioned using self-supervised speech representation modelcited by 10
- 2023Disentangling Voice and Content with Self-Supervision for Speaker Recognitioncited by 10
12 most cited of 48 All 48 (JSON)
- 2026DriveDNA: A Large-Scale Multimodal Naturalistic Driving Dataset and Benchmark for Driving Style Identification26 Jul 2026
- 2026Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Models18 Jul 2026
- 2026Massive Sound Embedding Benchmark (MSEB)6 Feb 2026
- 2025Deep FlexQP: Accelerated Nonlinear Programming via Deep Unfolding1 Dec 2025
- 2025Impact of Phonetics on Speaker Identity in Adversarial Voice Attack18 Sep 2025
- 2025From Dialect Gaps to Identity Maps: Tackling Variability in Speaker Verification21 Apr 2025
- 2025CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarking2 Mar 2025
- 2024Raw Audio Classification with Cosine Convolutional Neural Network (CosCovNN)30 Nov 2024
- 2024Improvement and Implementation of a Speech Emotion Recognition Model Based on Dual-Layer LSTM14 Nov 2024
- 2024Lightweight Zero-shot Text-to-Speech with Mixture of Adapters1 Jul 2024
- 2024TinySV: Speaker Verification in TinyML with On-device Learning3 Jun 2024
- 2024RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text30 May 2024
12 newest of 48 All 48 (JSON)