ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification
Not on the map. Why?
Cited by 37 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Current speaker verification techniques rely on a neural network to extract speaker representations. The successful x-vector architecture is a Time Delay Neural Network (TDNN) that applies statistics pooling to project variable-length utterances into fixed-length speaker characterizing embeddings. In this paper, we propose multiple enhancements to this architecture based on recent trends in the related fields of face verification and computer vision. Firstly, the initial frame layers can be restructured into 1-dimensional Res2Net modules with impactful skip connections. Similarly to SE-ResNet, we introduce Squeeze-and-Excitation blocks in these modules to explicitly model channel interdependencies. The SE block expands the temporal context of the frame layer by rescaling the channels according to global properties of the recording. Secondly, neural networks are known to learn hierarchical features, with each layer operating on a different level of complexity. To leverage this complementary information, we aggregate and propagate features of different hierarchical levels. Finally, we improve the statistics pooling module with channel-dependent frame attention. This enables the network to focus on different subsets of frames during each of the channel's statistics estimation. The proposed ECAPA-TDNN architecture significantly outperforms state-of-the-art TDNN based systems on the VoxCeleb test sets and the 2019 VoxCeleb Speaker Recognition Challenge.
Key facts. Cited by 606 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 73; 2023: 95; 2024: 120; 2025: 124; 2026: 170.
606 papers.
Sort:
By area:
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 109
- 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 109
- 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
- 2021A Fine-tuned Wav2vec 2.0/HuBERT Benchmark For Speech Emotion Recognition, Speaker Verification and Spoken Language Understandingcited by 82
- 2021Neural Analysis and Synthesis: Reconstructing Speech from Self-Supervised Representationscited by 81
- 2024AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encodingcited by 67
- 2024Open-Source Conversational AI with SpeechBrain 1.0cited by 55
- 2022Speech Emotion Recognition using Self-Supervised Featurescited by 52
- 2023AutoAD: Movie Description in Contextcited by 50
38 more
- 2022Pushing the limits of raw waveform speaker recognitioncited by 49
- 2024The VoicePrivacy 2024 Challenge Evaluation Plancited by 39
- 2021Fine-tuning wav2vec2 for speaker recognitioncited by 35
- 2024DASB - Discrete Audio and Speech Benchmarkcited by 32
- 2023Speech Self-Supervised Representation Benchmarking: Are We Doing it Right?cited by 28
- 2022Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition?cited by 27
- 2024Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveycited by 27
- 2021Learning Audio-Visual Dereverberationcited by 26
- 2024How Should We Extract Discrete Audio Tokens from Self-Supervised Models?cited by 24
- 2023Multi-modal Facial Affective Analysis based on Masked Autoencodercited by 23
- 2024SpoofCeleb: Speech Deepfake Detection and SASV In The Wildcited by 22
- 2024Building a Taiwanese Mandarin Spoken Language Model: A First Attemptcited by 22
- 2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 22
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 22
- 2024Preference Alignment Improves Language Model-Based TTScited by 21
- 2022Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Featurescited by 20
- 2022Anonymizing Speech with Generative Adversarial Networks to Preserve Speaker Privacycited by 20
- 2025AudioJudge: Understanding What Works in Large Audio Model Based Speech Evaluationcited by 20
- 2023CommonAccent: Exploring Large Acoustic Pretrained Models for Accent Classification Based on Common Voicecited by 19
- 2025LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancementcited by 19
- 2023LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speechcited by 17
- 2023Weakly-Supervised Emotion Transition Learning for Diverse 3D Co-speech Gesture Generationcited by 17
- 2024Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detectioncited by 17
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
- 2021Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learningcited by 16
- 2023Speech Self-Supervised Representations Benchmarking: a Case for Larger Probing Headscited by 16
- 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTScited by 15
- 2022Speaking Style Conversion in the Waveform Domain Using Discrete Self-Supervised Unitscited by 15
- 20233D-Speaker: A Large-Scale Multi-Device, Multi-Distance, and Multi-Dialect Corpus for Speech Representation Disentanglementcited by 15
- 2025VoiceAgentBench: Are Voice Assistants ready for agentic tasks?cited by 15
- 2021Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularizationcited by 14
- 2023ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpuscited by 14
- 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systemscited by 14
- 2023AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representationcited by 14
- 2022Exact Prosody Cloning in Zero-Shot Multispeaker Text-to-Speechcited by 13
- 2024Enabling Auditory Large Language Models for Automatic Speech Quality Evaluationcited by 13
- 2024StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identificationcited by 13
- 2022MFA: TDNN with Multi-scale Frequency-channel Attention for Text-independent Speaker Verification with Short Utterancescited by 12
50 most cited of 606 All 606 (JSON)
- 2026Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization1 Oct 2026
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026VOSSA: Voiceprint Optimization for Streaming Speech Architectures30 Sep 2026
- 2026Reconstructing the Vocal Tract with Differentiable Acoustic Simulation29 Sep 2026
- 2026InterBias-SV: Compound Conditions in Speaker Verification29 Sep 2026
- 2026ORAV: Benchmarking Audio-Video Generation from Multimodal Contexts28 Sep 2026
- 2026Controlling Speaking Rate in Autoregressive TTS via Activation Steering27 Sep 2026
- 2026CoLMbo-SV: A Grounded Language Model for Explainable Speaker Verification27 Sep 2026
- 2026Beyond Dyadic Memory: Interaction-Aware Multimodal Memory with Adaptive Agentic Retrieval for Multi-Party Spoken Conversations26 Sep 2026
- 2026NVAlign: Direct-Gradient Optimization for Non-Verbal Control in Continuous Autoregressive Flow Matching Text-to-Speech25 Sep 2026
- 2026A Comprehensive Study of Content Representations for Speech Synthesis25 Sep 2026
- 2026Controlling Backchannels in Streamable Full-duplex Models24 Sep 2026
38 more
- 2026BanglaKontho: Closing the Long-Form Gap in Bangla Text-to-Speech24 Sep 2026
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task22 Sep 2026
- 2026Training Intelligent Voice Assistant Wakeup with Controllable Synthetic Conversations22 Sep 2026
- 2026A Practical Recipe for Semi-Supervised Federated ASR: Online Pseudo-Labels with Server Update Stabilization21 Sep 2026
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026The Spoken Wikipedia Presentation Corpus18 Sep 2026
- 2026Model-Agnostic and Language-Agnostic Voice Pipeline Improvement for the Agriculture Domain17 Sep 2026
- 2026DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization15 Sep 2026
- 2026CLASH: Counterfactual Auditing of Lexical and Prosodic Reliance in Spoken Sarcasm Detection15 Sep 2026
- 2026CVSS-X: A Multilingual Speech-to-Speech Translation Corpus for 28 Languages11 Sep 2026
- 2026Deterministic Prompting for Speaker-Stable Low-Resource Greek TTS9 Sep 2026
- 2026ICM-Bench: Person-Level Identity Reasoning in Multimodal Agents with Long-Term Memory3 Sep 2026
- 2026Building and Evaluating Fixed-Voice Thai TTS from Synthetic Speech3 Sep 2026
- 2026Hearing the Whispers: Black-Box Membership Inference Attacks on Finetuned TTS Models1 Sep 2026
- 2026SISER: Speaker-Invariant Speech Emotion Recognition with Entropy-Based Adversarial Training31 Aug 2026
- 2026Cooperative Multi-Agent Reinforcement Learning for Adaptive Aggregation in Semi-Supervised Federated Learning with non-IID Data26 Aug 2026
- 2026LibriBrain100: One Hundred Hours of Broad and Deep MEG Data for Neural Speech Decoding at Scale25 Aug 2026
- 2026X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritance19 Aug 2026
- 2026Beyond receptive fields: sequence-pooled normalization can supply most of a sequence labeler's context19 Aug 2026
- 2026INSPIRE: A Benchmark for Instruction-Aware Speech Retrieval17 Aug 2026
- 2026Adding Voice Cloning to Text-to-Audio-Video Models with a Single Zero-Initialised Layer16 Aug 2026
- 2026Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder12 Aug 2026
- 2026Ex-Omni-2D: Expressive Omni-Modal Dialogue Models with Native Visual Presence11 Aug 2026
- 2026MADBench: A Benchmark for Modality-Aware Audio Deepfake Detection10 Aug 2026
- 2026CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latents9 Aug 2026
- 2026The Voiceprint Fallacy: Why Voices Are Not Unique Biometric Imprints8 Aug 2026
- 2026Bias Analysis of L2 Speaking Assessment Systems Using Concept Activation Vectors6 Aug 2026
- 2026MERaLiON-GR: Speech Gender Recognition Model for English and SEA Languages5 Aug 2026
- 2026Towards Real-world Environment-aware Zero-shot Text-to-speech Synthesis via Disentangled Audio Infilling4 Aug 2026
- 2026TIDES: A Longitudinal Bilingual Dataset for Modeling Multi-Party Social Dynamics3 Aug 2026
- 2026dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model2 Aug 2026
- 2026InteracVid: Building a Real Interactive Audio-Visual Response Dataset from Live-Chat Videos2 Aug 2026
- 2026Face and Voice Cross-modal Association with Learning Convex Feature Embedding30 Jul 2026
- 2026Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models28 Jul 2026
- 2026Beyond Short Segments : Expanding Speaker Embeddings with Vector Archives26 Jul 2026
- 2026Simple Language Normalization Wins: Cross-Lingual Speaker Verification for the TidyVoice 2026 Challenge24 Jul 2026
- 2026Probing Speaker Identity Sensitivity in Audio Deepfake Detectors23 Jul 2026
- 2026Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUs23 Jul 2026
50 newest of 606 All 606 (JSON)
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 22
- 2024High-Resolution Speech Restoration with Latent Diffusion Modelcited by 8
- 2023SE-Bridge: Speech Enhancement with Consistent Brownian Bridgecited by 7
- 2024FastVoiceGrad: One-step Diffusion-Based Voice Conversion with Adversarial Conditional Diffusion Distillationcited by 7
- 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matchingcited by 7
- 2025M3-TTS: Multi-modal DiT Alignment & Mel-latent for Zero-shot High-fidelity Speech Synthesiscited by 6
- 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesiscited by 5
- 2023Conditional Diffusion Model for Target Speaker Extractioncited by 4
- 2024SF-Speech: Straightened Flow for Zero-Shot Voice Clonecited by 4
- 2025UniFlow: Unifying Speech Front-End Tasks via Continuous Generative Modelingcited by 4
- 2025MeanFlow-TSE: One-Step Generative Target Speaker Extraction with Mean Flowcited by 4
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generationcited by 4
12 most cited of 37 All 37 (JSON)
- 2026NVAlign: Direct-Gradient Optimization for Non-Verbal Control in Continuous Autoregressive Flow Matching Text-to-Speech25 Sep 2026
- 2026CuteTTS: Efficient and High-Quality Speech Synthesis via Autoregressive Modeling of Continuous Latents9 Aug 2026
- 2026Towards Real-world Environment-aware Zero-shot Text-to-speech Synthesis via Disentangled Audio Infilling4 Aug 2026
- 2026Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUs23 Jul 2026
- 2026Staged Depth-Pruning Distillation of a Flow-Matching Text-to-Speech Teacher: A Compact Hindi Speech Synthesizer19 Jul 2026
- 2026ZipL-Dialog: Memory-Efficient Long-Form Spoken Dialog Synthesis via Latent Flow Matching14 Jul 2026
- 2026FreyaTTS: A Compact Tokenizer-Free Flow-Matching Transformer for Turkish-First Speech Synthesis10 Jul 2026
- 2026DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speech5 Jul 2026
- 2026Transcript-Free Flow-Matching Text-to-Speech via Speech Feature Conditioning18 Jun 2026
- 2026PoDAR: Power-Disentangled Audio Representation for Generative Modeling11 May 2026
- 2026MMControl: Unified Multi-Modal Control for Joint Audio-Video Generation21 Apr 2026
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models1 Apr 2026
12 newest of 37 All 37 (JSON)
- 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systemscited by 14
- 2023Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversioncited by 9
- 2025VoxGuard: Evaluating User and Attribute Privacy in Speech via Membership Inference Attackscited by 1
- 2025SPBA: Utilizing Speech Large Language Model for Backdoor Attacks on Speech Classification Modelscited by 0
- 2026DRL-CLBA: A Clean Label Backdoor Attack for Speech Classification via DDPG Reinforcement Learningcited by 0
- 2026Hearing the Whispers: Black-Box Membership Inference Attacks on Finetuned TTS Modelscited by 0
- 2026Hearing the Whispers: Black-Box Membership Inference Attacks on Finetuned TTS Models1 Sep 2026
- 2026DRL-CLBA: A Clean Label Backdoor Attack for Speech Classification via DDPG Reinforcement Learning2 Jul 2026
- 2025VoxGuard: Evaluating User and Attribute Privacy in Speech via Membership Inference Attacks22 Sep 2025
- 2025SPBA: Utilizing Speech Large Language Model for Backdoor Attacks on Speech Classification Models10 Jun 2025
- 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systems14 Sep 2023
- 2023Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion28 Jun 2023
- 2024DASB - Discrete Audio and Speech Benchmarkcited by 32
- 2024StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identificationcited by 13
- 2025TICL: Text-Embedding KNN For Speech In-Context Learning Unlocks Speech Recognition Abilities of Large Multimodal Modelscited by 3
- 2026Alignment Is All You Need: Instruction-Free Training for General Audio-Language Modelscited by 0
- 2026Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models28 Jul 2026
- 2025TICL: Text-Embedding KNN For Speech In-Context Learning Unlocks Speech Recognition Abilities of Large Multimodal Models16 Sep 2025
- 2024StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identification11 Nov 2024
- 2024DASB - Discrete Audio and Speech Benchmark20 Jun 2024
- 2025Noise-Conditioned Mixture-of-Experts Framework for Robust Speaker Verificationcited by 1
- 2026Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approachcited by 0
- 2026ZONOS2 Technical Reportcited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verificationcited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026ZONOS2 Technical Report23 Jun 2026
- 2026Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach19 Jun 2026
- 2025Noise-Conditioned Mixture-of-Experts Framework for Robust Speaker Verification21 Oct 2025
- 2025An Exploration of Mamba for Speech Self-Supervised Models14 Jun 2025
- 2024MASV: Speaker Verification with Global and Local Context Mamba14 Dec 2024
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 109
- 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 109
- 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
- 2021A Fine-tuned Wav2vec 2.0/HuBERT Benchmark For Speech Emotion Recognition, Speaker Verification and Spoken Language Understandingcited by 82
- 2021Neural Analysis and Synthesis: Reconstructing Speech from Self-Supervised Representationscited by 81
- 2024AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encodingcited by 67
- 2024Open-Source Conversational AI with SpeechBrain 1.0cited by 55
- 2022Speech Emotion Recognition using Self-Supervised Featurescited by 52
- 2023AutoAD: Movie Description in Contextcited by 50
12 most cited of 544 All 544 (JSON)
- 2026Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization1 Oct 2026
- 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetings30 Sep 2026
- 2026VOSSA: Voiceprint Optimization for Streaming Speech Architectures30 Sep 2026
- 2026Reconstructing the Vocal Tract with Differentiable Acoustic Simulation29 Sep 2026
- 2026InterBias-SV: Compound Conditions in Speaker Verification29 Sep 2026
- 2026ORAV: Benchmarking Audio-Video Generation from Multimodal Contexts28 Sep 2026
- 2026Controlling Speaking Rate in Autoregressive TTS via Activation Steering27 Sep 2026
- 2026CoLMbo-SV: A Grounded Language Model for Explainable Speaker Verification27 Sep 2026
- 2026A Comprehensive Study of Content Representations for Speech Synthesis25 Sep 2026
- 2026Controlling Backchannels in Streamable Full-duplex Models24 Sep 2026
- 2026BanglaKontho: Closing the Long-Form Gap in Bangla Text-to-Speech24 Sep 2026
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task22 Sep 2026
12 newest of 544 All 544 (JSON)