Generalized End-to-End Loss for Speaker Verification
Not on the map. Why?
Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In this paper, we propose a new loss function called generalized end-to-end (GE2E) loss, which makes the training of speaker verification models more efficient than our previous tuple-based end-to-end (TE2E) loss function. Unlike TE2E, the GE2E loss function updates the network in a way that emphasizes examples that are difficult to verify at each step of the training process. Additionally, the GE2E loss does not require an initial stage of example selection. With these properties, our model with the new loss function decreases speaker verification EER by more than 10%, while reducing the training time by 60% at the same time. We also introduce the MultiReader technique, which allows us to do domain adaptation - training a more accurate model that supports multiple keywords (i.e. "OK Google" and "Hey Google") as well as multiple dialects.
Key facts. Cited by 293 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 57; 2022: 64; 2023: 50; 2024: 56; 2025: 39; 2026: 27.
293 papers.
Sort:
By area:
- 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
- 2021AdaSpeech: Adaptive Text to Speech for Custom Voicecited by 98
- 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 74
- 2021Translatotron 2: High-quality direct speech-to-speech translation with voice preservationcited by 71
- 2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
- 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 44
- 2021Neural Dubber: Dubbing for Videos According to Scriptscited by 39
- 2021Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speechcited by 37
- 2021MAAS: Multi-modal Assignation for Active Speaker Detectioncited by 36
38 more
- 2022Guided-TTS 2: A Diffusion Model for High-quality Adaptive Text-to-Speech with Untranscribed Datacited by 35
- 2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesiscited by 34
- 2021Turn-to-Diarize: Online Speaker Diarization Constrained by Transformer Transducer Speaker Turn Detectioncited by 32
- 2022Toward Fairness in Speech Recognition: Discovery and mitigation of performance disparitiescited by 28
- 2023Intelligible Lip-to-Speech Synthesis with Speech Unitscited by 28
- 2022Towards Building Text-To-Speech Systems for the Next Billion Userscited by 27
- 2021SwissDial: Parallel Multidialectal Corpus of Spoken Swiss Germancited by 26
- 2025CARES: Comprehensive Evaluation of Safety and Adversarial Robustness in Medical LLMscited by 26
- 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wildcited by 25
- 2021V2C: Visual Voice Cloningcited by 24
- 2021CLSRIL-23: Cross Lingual Speech Representations for Indic Languagescited by 22
- 2021Meta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-Speechcited by 22
- 2023DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embeddingcited by 22
- 2024ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf modelscited by 22
- 2022Going In Style: Audio Backdoors Through Stylistic Transformationscited by 21
- 2024StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbingcited by 21
- 2021Multimodal Emotion Recognition with High-level Speech and Text Featurescited by 20
- 2022Detecting Individual Decision-Making Style: Exploring Behavioral Stylometry in Chesscited by 18
- 2021AdaSpeech 2: Adaptive Text to Speech with Untranscribed Datacited by 17
- 2021Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularizationcited by 17
- 2023DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Trainingcited by 16
- 2024DiarizationLM: Speaker Diarization Post-Processing with Large Language Modelscited by 16
- 2023UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Datacited by 15
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speechcited by 14
- 2021Voice Conversion Can Improve ASR in Very Low-Resource Settingscited by 14
- 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systemscited by 14
- 2023AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representationcited by 14
- 2024TTSDS -- Text-to-Speech Distribution Scorecited by 14
- 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real Worldcited by 12
- 2021Emotional Prosody Control for Speech Generationcited by 12
- 2021More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speechcited by 12
- 2022Personal VAD 2.0: Optimizing Personal Voice Activity Detection for On-Device Speech Recognitioncited by 12
- 2025AudioGen-Omni: A Unified Multimodal Diffusion Transformer for Video-Synchronized Audio, Speech, and Song Generationcited by 12
- 2021Expressive Neural Voice Cloningcited by 11
- 2024The Impact of Speech Anonymization on Pathology and Its Limitscited by 11
- 2024Look Once to Hear: Target Speech Hearing with Noisy Examplescited by 11
- 2021High Fidelity Speech Regeneration with Application to Speech Enhancementcited by 10
- 2021Dr-Vectors: Decision Residual Networks and an Improved Loss for Speaker Recognitioncited by 10
50 most cited of 293 All 293 (JSON)
- 2026Refinement Buys Intelligibility, Search Buys Identity: What Test-Time Compute Buys in Masked-Diffusion TTS2 Oct 2026
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026Listen Before You Speak: Response Planning from Listener Facial Reactions for Conversational Speech Generation18 Sep 2026
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation1 Sep 2026
- 2026Adding Voice Cloning to Text-to-Audio-Video Models with a Single Zero-Initialised Layer16 Aug 2026
- 2026A survey of AI-generated voices and their detection15 Aug 2026
- 2026UniSwap: Streaming Audio-Visual Identity Swapping for Talking Videos12 Aug 2026
- 2026Domain-Specific Evaluation of Text-to-Speech Systems: A Multi-Metric Benchmarking Study3 Aug 2026
- 2026Zero-Shot Face-to-Speech Synthesis via Latent Space Adaptation of a Style-Diffusion TTS Model29 Jul 2026
- 2026Beyond Short Segments : Expanding Speaker Embeddings with Vector Archives26 Jul 2026
- 2026Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Models18 Jul 2026
- 2026UniSAE: Unified Speech Attribute Editing on Speaker, Emotion and Low-Level Content via Discrete Phonetic Posteriorgram Modelling30 Jun 2026
38 more
- 2026L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verification16 Jun 2026
- 2026OpenSTBench: Beyond Semantic Evaluation for Speech Translation29 May 2026
- 2026Chatterbox-Flash: Prior-Calibrated Block Diffusion for Streaming Zero-Shot TTS29 May 2026
- 2026Archon: A Unified Multimodal Model for Holistic Digital Human Generation28 May 2026
- 2026Hierarchical Codec Diffusion for Video-to-Speech Generation17 Apr 2026
- 2026CoSyncDiT: Cognitive Synchronous Diffusion Transformer for Movie Dubbing14 Apr 2026
- 2026Disentangling Speaker Traits for Deepfake Source Verification via Chebyshev Polynomial and Riemannian Metric Learning23 Mar 2026
- 2026Mask2Flow-TSE: Two-Stage Target Speaker Extraction with Masking and Flow Matching13 Mar 2026
- 2026Visual-Informed Speech Enhancement Using Attention-Based Beamforming5 Mar 2026
- 2026Scores Know Bobs Voice: Speaker Impersonation Attack3 Mar 2026
- 2026SLD-L2S: Hierarchical Subspace Latent Diffusion for High-Fidelity Lip to Speech Synthesis12 Feb 2026
- 2026Mixture of Masters: Sparse Chess Language Models with Player Routing4 Feb 2026
- 2026VoxMorph: Scalable Zero-shot Voice Identity Morphing via Disentangled Embeddings27 Jan 2026
- 2026Residual Tokens Enhance Masked Autoencoders for Speech Modeling27 Jan 2026
- 2026Lightweight and perceptually-guided voice conversion for electro-laryngeal speech7 Jan 2026
- 2025NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversion31 Oct 2025
- 2025HyWA: Architecture-Preserving Personalized Voice Activity Detection for Full-Duplex Voice Assistants14 Oct 2025
- 2025Provable Speech Attributes Conversion via Latent Independence6 Oct 2025
- 2025LTA-L2S: Lexical Tone-Aware Lip-to-Speech Synthesis for Mandarin with Cross-Lingual Transfer Learning30 Sep 2025
- 2025AUDDT: A Unified Benchmark Toolkit for Audio and Speech Deepfake Detectors25 Sep 2025
- 2025Finding My Voice: Generative Reconstruction of Disordered Speech for Automated Clinical Evaluation23 Sep 2025
- 2025LatentVoiceGrad: Nonparallel Voice Conversion with Latent Diffusion/Flow-Matching Models10 Sep 2025
- 2025Unseen Speaker and Language Adaptation for Lightweight Text-To-Speech with Adapters25 Aug 2025
- 2025AudioGen-Omni: A Unified Multimodal Diffusion Transformer for Video-Synchronized Audio, Speech, and Song Generation1 Aug 2025
- 2025De-AntiFake: Rethinking the Protective Perturbations Against Voice Cloning Attacks3 Jul 2025
- 2025Analyzing and Improving Speaker Similarity Assessment for Speech Synthesis2 Jul 2025
- 2025MuteSwap: Visual-informed Silent Video Identity Conversion1 Jul 2025
- 2025TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systems24 Jun 2025
- 2025Exploring Speaker Diarization with Mixture of Experts17 Jun 2025
- 2025An Exploration of Mamba for Speech Self-Supervised Models14 Jun 2025
- 2025CoLMbo: Speaker Language Model for Descriptive Profiling11 Jun 2025
- 2025SPBA: Utilizing Speech Large Language Model for Backdoor Attacks on Speech Classification Models10 Jun 2025
- 2025Synthetic Speech Source Tracing using Metric Learning3 Jun 2025
- 2025DiffDSR: Dysarthric Speech Reconstruction Using Latent Diffusion Model31 May 2025
- 2025Eta-WavLM: Efficient Speaker Identity Removal in Self-Supervised Speech Representations Using a Simple Linear Equation25 May 2025
- 2025MM-MovieDubber: Towards Multi-Modal Learning for Multi-Modal Movie Dubbing22 May 2025
- 2025RoVo: Robust Voice Protection Against Unauthorized Speech Synthesis with Embedding-Level Perturbations19 May 2025
- 2025CARES: Comprehensive Evaluation of Safety and Adversarial Robustness in Medical LLMs16 May 2025
50 newest of 293 All 293 (JSON)
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2022Guided-TTS 2: A Diffusion Model for High-quality Adaptive Text-to-Speech with Untranscribed Datacited by 35
- 2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesiscited by 34
- 2023DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embeddingcited by 22
- 2023DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Trainingcited by 16
- 2023UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Datacited by 15
- 2025AudioGen-Omni: A Unified Multimodal Diffusion Transformer for Video-Synchronized Audio, Speech, and Song Generationcited by 12
- 2024ED-TTS: Multi-Scale Emotion Modeling using Cross-Domain Emotion Diarization for Emotional Speech Synthesiscited by 9
- 2024V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flowcited by 5
- 2025DiffDSR: Dysarthric Speech Reconstruction Using Latent Diffusion Modelcited by 5
- 2023Comparing normalizing flows and diffusion models for prosody and acoustic modelling in text-to-speechcited by 2
- 2024Landmark-guided Diffusion Model for High-fidelity and Temporally Coherent Talking Head Generationcited by 2
12 most cited of 19 All 19 (JSON)
- 2026CoSyncDiT: Cognitive Synchronous Diffusion Transformer for Movie Dubbing14 Apr 2026
- 2026Mask2Flow-TSE: Two-Stage Target Speaker Extraction with Masking and Flow Matching13 Mar 2026
- 2026SLD-L2S: Hierarchical Subspace Latent Diffusion for High-Fidelity Lip to Speech Synthesis12 Feb 2026
- 2025LTA-L2S: Lexical Tone-Aware Lip-to-Speech Synthesis for Mandarin with Cross-Lingual Transfer Learning30 Sep 2025
- 2025LatentVoiceGrad: Nonparallel Voice Conversion with Latent Diffusion/Flow-Matching Models10 Sep 2025
- 2025AudioGen-Omni: A Unified Multimodal Diffusion Transformer for Video-Synchronized Audio, Speech, and Song Generation1 Aug 2025
- 2025DiffDSR: Dysarthric Speech Reconstruction Using Latent Diffusion Model31 May 2025
- 2024V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow29 Nov 2024
- 2024Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASR16 Oct 2024
- 2024Landmark-guided Diffusion Model for High-fidelity and Temporally Coherent Talking Head Generation3 Aug 2024
- 2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesis8 Jun 2024
- 2024Converting Anyone's Voice: End-to-End Expressive Voice Conversion with a Conditional Diffusion Model2 May 2024
12 newest of 19 All 19 (JSON)
- 2025CARES: Comprehensive Evaluation of Safety and Adversarial Robustness in Medical LLMscited by 26
- 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systemscited by 14
- 2023Enrollment-stage Backdoor Attacks on Speaker Recognition Systems via Adversarial Ultrasoundcited by 5
- 2024EmoAttack: Utilizing Emotional Voice Conversion for Speech Backdoor Attacks on Deep Speech Classification Modelscited by 2
- 2025SPBA: Utilizing Speech Large Language Model for Backdoor Attacks on Speech Classification Modelscited by 0
- 2025SPBA: Utilizing Speech Large Language Model for Backdoor Attacks on Speech Classification Models10 Jun 2025
- 2025CARES: Comprehensive Evaluation of Safety and Adversarial Robustness in Medical LLMs16 May 2025
- 2024EmoAttack: Utilizing Emotional Voice Conversion for Speech Backdoor Attacks on Deep Speech Classification Models28 Aug 2024
- 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systems14 Sep 2023
- 2023Enrollment-stage Backdoor Attacks on Speaker Recognition Systems via Adversarial Ultrasound28 Jun 2023
- 2024Speaker Verification in Agent-Generated Conversationscited by 4
- 2024Speaker Verification in Agent-Generated Conversations16 May 2024
- 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
- 2021AdaSpeech: Adaptive Text to Speech for Custom Voicecited by 98
- 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 74
- 2021Translatotron 2: High-quality direct speech-to-speech translation with voice preservationcited by 71
- 2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
- 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 44
- 2021Neural Dubber: Dubbing for Videos According to Scriptscited by 39
- 2021Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speechcited by 37
- 2021MAAS: Multi-modal Assignation for Active Speaker Detectioncited by 36
- 2021Turn-to-Diarize: Online Speaker Diarization Constrained by Transformer Transducer Speaker Turn Detectioncited by 32
12 most cited of 261 All 261 (JSON)
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026Listen Before You Speak: Response Planning from Listener Facial Reactions for Conversational Speech Generation18 Sep 2026
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation1 Sep 2026
- 2026Adding Voice Cloning to Text-to-Audio-Video Models with a Single Zero-Initialised Layer16 Aug 2026
- 2026A survey of AI-generated voices and their detection15 Aug 2026
- 2026UniSwap: Streaming Audio-Visual Identity Swapping for Talking Videos12 Aug 2026
- 2026Domain-Specific Evaluation of Text-to-Speech Systems: A Multi-Metric Benchmarking Study3 Aug 2026
- 2026Zero-Shot Face-to-Speech Synthesis via Latent Space Adaptation of a Style-Diffusion TTS Model29 Jul 2026
- 2026Beyond Short Segments : Expanding Speaker Embeddings with Vector Archives26 Jul 2026
- 2026Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Models18 Jul 2026
- 2026UniSAE: Unified Speech Attribute Editing on Speaker, Emotion and Low-Level Content via Discrete Phonetic Posteriorgram Modelling30 Jun 2026
- 2026L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verification16 Jun 2026
12 newest of 261 All 261 (JSON)