CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking
Not on the map. Why?
Abstract (arXiv)
Time delay neural network (TDNN) has been proven to be efficient for speaker verification. One of its successful variants, ECAPA-TDNN, achieved state-of-the-art performance at the cost of much higher computational complexity and slower inference speed. This makes it inadequate for scenarios with demanding inference rate and limited computational resources. We are thus interested in finding an architecture that can achieve the performance of ECAPA-TDNN and the efficiency of vanilla TDNN. In this paper, we propose an efficient network based on context-aware masking, namely CAM++, which uses densely connected time delay neural network (D-TDNN) as backbone and adopts a novel multi-granularity pooling to capture contextual information at different levels. Extensive experiments on two public benchmarks, VoxCeleb and CN-Celeb, demonstrate that the proposed architecture outperforms other mainstream speaker verification systems with lower computational cost and faster inference speed.
Key facts. Cited by 95 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Mar 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 4; 2024: 19; 2025: 32; 2026: 40.
95 papers.
Sort:
By area:
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
- 2024Zero-shot Voice Conversion with Diffusion Transformerscited by 39
- 20233D-Speaker: A Large-Scale Multi-Device, Multi-Distance, and Multi-Dialect Corpus for Speech Representation Disentanglementcited by 15
- 2025OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interactioncited by 14
- 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 14
- 2024StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identificationcited by 13
- 2024A Benchmark for Multi-speaker Anonymizationcited by 7
- 2024Takin: A Cohort of Superior Quality Zero-shot Speech Generation Modelscited by 7
- 2025WenetSpeech-Chuan: A Large-Scale Sichuanese Corpus with Rich Annotation for Dialectal Speech Processingcited by 7
- 2024Certification of Speaker Recognition Models to Additive Perturbationscited by 6
- 2024LDM-SVC: Latent Diffusion Model Based Zero-Shot Any-to-Any Singing Voice Conversion with Singer Guidancecited by 6
- 2024Malacopula: adversarial automatic speaker verification attacks using a neural-based generalised Hammerstein modelcited by 6
38 more
- 2025SynParaSpeech: Automated Synthesis of Paralinguistic Datasets for Speech Generation and Understandingcited by 6
- 2024Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognitioncited by 5
- 2024SaMoye: Zero-shot Singing Voice Conversion Model Based on Feature Disentanglement and Enhancementcited by 5
- 2025The First VoicePrivacy Attacker Challengecited by 4
- 2025Voice Cloning: Comprehensive Surveycited by 4
- 2025SpeechRole: A Large-Scale Dataset and Benchmark for Evaluating Speech Role-Playing Agentscited by 4
- 2026Stream-Voice-Anon: Enhancing Utility of Real-Time Speaker Anonymization via Neural Audio Codec and Language Modelscited by 4
- 2026Logics-Parsing-Omni Technical Reportcited by 4
- 2023Improving Speaker Diarization using Semantic Information: Joint Pairwise Constraints Propagationcited by 3
- 2024PSCodec: A Series of High-Fidelity Low-bitrate Neural Speech Codecs Leveraging Prompt Encoderscited by 3
- 2024Zero-Shot Voice Conversion via Content-Aware Timbre Ensemble and Conditional Flow Matchingcited by 3
- 2025CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarkingcited by 3
- 2025ClapFM-EVC: High-Fidelity and Flexible Emotional Voice Conversion with Dual Control from Natural Language and Speechcited by 3
- 2025FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for "U-Tsang, Amdo and Kham Speech Dataset Generationcited by 3
- 2026FunCineForge: A Unified Dataset Toolkit and Model for Zero-Shot Movie Dubbing in Diverse Cinematic Scenescited by 3
- 2026dots.tts Technical Reportcited by 3
- 2026Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesiscited by 3
- 2023VoiceExtender: Short-utterance Text-independent Speaker Verification with Guided Diffusion Modelcited by 2
- 2024Robust Channel Learning for Large-Scale Radio Speaker Verificationcited by 2
- 2024Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarizationcited by 2
- 2024LCM-SVC: Latent Diffusion Model Based Singing Voice Conversion with Inference Acceleration via Latent Consistency Distillationcited by 2
- 2025Unispeaker: A Unified Approach for Multimodality-driven Speaker Generationcited by 2
- 2025A Unified Speech LLM for Diarization and Speech Recognition in Multilingual Conversationscited by 2
- 2025DAFMSVC: One-Shot Singing Voice Conversion with Dual Attention Mechanism and Flow Matchingcited by 2
- 2025Mitigating Hallucinations in LM-Based TTS Models via Distribution Alignment Using GFlowNetscited by 2
- 2025DRASP: A Dual-Resolution Attentive Statistics Pooling Framework for Automatic MOS Predictioncited by 2
- 2025Domain-Aware Speaker Diarization On African-Accented Englishcited by 2
- 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarioscited by 2
- 2026Scores Know Bobs Voice: Speaker Impersonation Attackcited by 2
- 2024ICMC-ASR: The ICASSP 2024 In-Car Multi-Channel Automatic Speech Recognition Challengecited by 1
- 2025AutoStyle-TTS: Retrieval-Augmented Generation based Automatic Style Matching Text-to-Speech Synthesiscited by 1
- 2025VoxAging: Continuously Tracking Speaker Aging with a Large-Scale Longitudinal Dataset in English and Mandarincited by 1
- 2025Towards Robust Overlapping Speech Detection: A Speaker-Aware Progressive Approach Using WavLMcited by 1
- 2025eMotions: A Large-Scale Dataset and Audio-Visual Fusion Network for Emotion Analysis in Short-form Videoscited by 1
- 2025Noise-Conditioned Mixture-of-Experts Framework for Robust Speaker Verificationcited by 1
- 2025R2-SVC: Towards Real-World Robust and Expressive Zero-shot Singing Voice Conversioncited by 1
- 2025TAVID: Text-Driven Audio-Visual Interactive Dialogue Generationcited by 1
- 2026TASTE-Streaming: Towards Streamable Text-Aligned Speech Tokenization and Embedding for Spoken Language Modelingcited by 1
50 most cited of 95 All 95 (JSON)
- 2026Tacit-TTS: From Autoregressive Decoding to Masked Prediction for Efficient Transcript-Free Voice Cloning29 Sep 2026
- 2026InterBias-SV: Compound Conditions in Speaker Verification29 Sep 2026
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026Xiaomi-CocktailASR-1 Technical Report10 Sep 2026
- 2026Agentic-DuplexGen: Decoupling Content, Timing, and Acoustics for Synthetic Dialogue Speech17 Aug 2026
- 2026Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder12 Aug 2026
- 2026dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model2 Aug 2026
- 2026Experience-Calibrated Contrastive Decoding for Mitigating Hallucinations in LM-Based Text-to-Speech1 Aug 2026
- 2026Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agents30 Jul 2026
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge24 Jul 2026
- 2026Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUs23 Jul 2026
- 2026X-Translator: A Real-Time Multilingual Speaker-Aware Speech-to-Speech Translation System20 Jul 2026
38 more
- 2026Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Models18 Jul 2026
- 2026An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challenge14 Jul 2026
- 2026Diarization-Guided Qwen-ASR Adaptation for Multilingual Two-Speaker Conversational Speech9 Jul 2026
- 2026NouveauVoice: Generating Novel Pseudo Speakers for Voice Anonymization4 Jul 2026
- 2026Reasoning LLM Improves Speaker Recognition in Long-form TV Dramas2 Jul 2026
- 2026DRL-CLBA: A Clean Label Backdoor Attack for Speech Classification via DDPG Reinforcement Learning2 Jul 2026
- 2026Pmeta-TLA: Backdoor Attacks for Speech Classification Models via Meta-Learning with Timbre Leakage Attack2 Jul 2026
- 2026Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis1 Jul 2026
- 2026STEB: A Speech-to-Speech Translation Expressiveness Benchmark for Evaluating Beyond Translation Fidelity24 Jun 2026
- 2026Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesis24 Jun 2026
- 2026Imitation Learning for Elder-Facing Speech Synthesis19 Jun 2026
- 2026L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verification16 Jun 2026
- 2026Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speech8 Jun 2026
- 2026dots.tts Technical Report5 Jun 2026
- 2026Towards Unified Song Generation and Singing Voice Conversion with Accompaniment Co-Generation5 Jun 2026
- 2026UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception29 May 2026
- 2026PilotTTS: A Disciplined Modular Recipe for Competitive Speech Synthesis26 May 2026
- 2026VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singing7 May 2026
- 2026Anonymization, Not Elimination: Utility-Preserved Speech Anonymization18 Apr 2026
- 2026Controllable Singing Style Conversion with Boundary-Aware Information Bottleneck7 Apr 2026
- 2026TASTE-Streaming: Towards Streamable Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling12 Mar 2026
- 2026Logics-Parsing-Omni Technical Report10 Mar 2026
- 2026Scores Know Bobs Voice: Speaker Impersonation Attack3 Mar 2026
- 2026Tutti: Expressive Multi-Singer Synthesis via Structure-Level Timbre Control and Vocal Texture Modeling9 Feb 2026
- 2026VoxMorph: Scalable Zero-shot Voice Identity Morphing via Disentangled Embeddings27 Jan 2026
- 2026FunCineForge: A Unified Dataset Toolkit and Model for Zero-Shot Movie Dubbing in Diverse Cinematic Scenes21 Jan 2026
- 2026Stream-Voice-Anon: Enhancing Utility of Real-Time Speaker Anonymization via Neural Audio Codec and Language Models20 Jan 2026
- 2026On the Fallacy of Global Token Perplexity in Spoken Language Model Evaluation9 Jan 2026
- 2025TAVID: Text-Driven Audio-Visual Interactive Dialogue Generation23 Dec 2025
- 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarios11 Nov 2025
- 2025E2E-VGuard: Adversarial Prevention for Production LLM-based End-To-End Speech Synthesis10 Nov 2025
- 2025Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Training29 Oct 2025
- 2025R2-SVC: Towards Real-World Robust and Expressive Zero-shot Singing Voice Conversion23 Oct 2025
- 2025Noise-Conditioned Mixture-of-Experts Framework for Robust Speaker Verification21 Oct 2025
- 2025Domain-Aware Speaker Diarization On African-Accented English25 Sep 2025
- 2025WenetSpeech-Chuan: A Large-Scale Sichuanese Corpus with Rich Annotation for Dialectal Speech Processing22 Sep 2025
- 2025SynParaSpeech: Automated Synthesis of Paralinguistic Datasets for Speech Generation and Understanding18 Sep 2025
- 2025Self Identity Mapping17 Sep 2025
50 newest of 95 All 95 (JSON)
- 2024Zero-shot Voice Conversion with Diffusion Transformerscited by 39
- 2024LDM-SVC: Latent Diffusion Model Based Zero-Shot Any-to-Any Singing Voice Conversion with Singer Guidancecited by 6
- 2024Zero-Shot Voice Conversion via Content-Aware Timbre Ensemble and Conditional Flow Matchingcited by 3
- 2026dots.tts Technical Reportcited by 3
- 2023VoiceExtender: Short-utterance Text-independent Speaker Verification with Guided Diffusion Modelcited by 2
- 2024LCM-SVC: Latent Diffusion Model Based Singing Voice Conversion with Inference Acceleration via Latent Consistency Distillationcited by 2
- 2026Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speechcited by 0
- 2026Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesiscited by 0
- 2026Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUscited by 0
- 2026Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUs23 Jul 2026
- 2026Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis1 Jul 2026
- 2026Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speech8 Jun 2026
- 2026dots.tts Technical Report5 Jun 2026
- 2024Zero-shot Voice Conversion with Diffusion Transformers15 Nov 2024
- 2024Zero-Shot Voice Conversion via Content-Aware Timbre Ensemble and Conditional Flow Matching4 Nov 2024
- 2024LCM-SVC: Latent Diffusion Model Based Singing Voice Conversion with Inference Acceleration via Latent Consistency Distillation22 Aug 2024
- 2024LDM-SVC: Latent Diffusion Model Based Zero-Shot Any-to-Any Singing Voice Conversion with Singer Guidance8 Jun 2024
- 2023VoiceExtender: Short-utterance Text-independent Speaker Verification with Guided Diffusion Model7 Oct 2023
- 2025OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interactioncited by 14
- 2025SpeechRole: A Large-Scale Dataset and Benchmark for Evaluating Speech Role-Playing Agentscited by 4
- 2026Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agentscited by 0
- 2026Agentic-DuplexGen: Decoupling Content, Timing, and Acoustics for Synthetic Dialogue Speechcited by 0
- 2026Agentic-DuplexGen: Decoupling Content, Timing, and Acoustics for Synthetic Dialogue Speech17 Aug 2026
- 2026Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agents30 Jul 2026
- 2025SpeechRole: A Large-Scale Dataset and Benchmark for Evaluating Speech Role-Playing Agents4 Aug 2025
- 2025OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction26 May 2025
- 2024Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognitioncited by 5
- 2026Pmeta-TLA: Backdoor Attacks for Speech Classification Models via Meta-Learning with Timbre Leakage Attackcited by 0
- 2026DRL-CLBA: A Clean Label Backdoor Attack for Speech Classification via DDPG Reinforcement Learningcited by 0
- 2026DRL-CLBA: A Clean Label Backdoor Attack for Speech Classification via DDPG Reinforcement Learning2 Jul 2026
- 2026Pmeta-TLA: Backdoor Attacks for Speech Classification Models via Meta-Learning with Timbre Leakage Attack2 Jul 2026
- 2024Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognition16 Jun 2024
- 2026Imitation Learning for Elder-Facing Speech Synthesiscited by 0
- 2026Imitation Learning for Elder-Facing Speech Synthesis19 Jun 2026
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 118
- 20233D-Speaker: A Large-Scale Multi-Device, Multi-Distance, and Multi-Dialect Corpus for Speech Representation Disentanglementcited by 15
- 2024A Benchmark for Multi-speaker Anonymizationcited by 7
- 2024Takin: A Cohort of Superior Quality Zero-shot Speech Generation Modelscited by 7
- 2025WenetSpeech-Chuan: A Large-Scale Sichuanese Corpus with Rich Annotation for Dialectal Speech Processingcited by 7
- 2024Certification of Speaker Recognition Models to Additive Perturbationscited by 6
- 2024Malacopula: adversarial automatic speaker verification attacks using a neural-based generalised Hammerstein modelcited by 6
- 2025SynParaSpeech: Automated Synthesis of Paralinguistic Datasets for Speech Generation and Understandingcited by 6
- 2024SaMoye: Zero-shot Singing Voice Conversion Model Based on Feature Disentanglement and Enhancementcited by 5
- 2025The First VoicePrivacy Attacker Challengecited by 4
- 2025Voice Cloning: Comprehensive Surveycited by 4
- 2026Stream-Voice-Anon: Enhancing Utility of Real-Time Speaker Anonymization via Neural Audio Codec and Language Modelscited by 4
12 most cited of 70 All 70 (JSON)
- 2026Tacit-TTS: From Autoregressive Decoding to Masked Prediction for Efficient Transcript-Free Voice Cloning29 Sep 2026
- 2026InterBias-SV: Compound Conditions in Speaker Verification29 Sep 2026
- 2026Xiaomi-CocktailASR-1 Technical Report10 Sep 2026
- 2026Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder12 Aug 2026
- 2026dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model2 Aug 2026
- 2026Experience-Calibrated Contrastive Decoding for Mitigating Hallucinations in LM-Based Text-to-Speech1 Aug 2026
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge24 Jul 2026
- 2026X-Translator: A Real-Time Multilingual Speaker-Aware Speech-to-Speech Translation System20 Jul 2026
- 2026Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Models18 Jul 2026
- 2026An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challenge14 Jul 2026
- 2026Diarization-Guided Qwen-ASR Adaptation for Multilingual Two-Speaker Conversational Speech9 Jul 2026
- 2026NouveauVoice: Generating Novel Pseudo Speakers for Voice Anonymization4 Jul 2026
12 newest of 70 All 70 (JSON)