Attentive Statistics Pooling for Deep Speaker Embedding
Not on the map. Why?
Abstract (arXiv)
This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an utterance-level feature. Our method utilizes an attention mechanism to give different weights to different frames and generates not only weighted means but also weighted standard deviations. In this way, it can capture long-term variations in speaker characteristics more effectively. An evaluation on the NIST SRE 2012 and the VoxCeleb data sets shows that it reduces equal error rates (EERs) from the conventional method by 7.5% and 8.1%, respectively.
Key facts. Cited by 108 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 17; 2023: 17; 2024: 22; 2025: 15; 2026: 20.
108 papers.
Sort:
By area:
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2024A Large-Scale Evaluation of Speech Foundation Modelscited by 38
- 2024ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf modelscited by 22
- 2023CommonAccent: Exploring Large Acoustic Pretrained Models for Accent Classification Based on Common Voicecited by 19
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
- 2021Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularizationcited by 14
- 2022Partially Fake Audio Detection by Self-attention-based Fake Span Discoverycited by 14
- 2021Voting for the right answer: Adversarial defense for speaker verificationcited by 12
- 2022Deepfake audio detection by speaker verificationcited by 11
- 2023Disentangling Voice and Content with Self-Supervision for Speaker Recognitioncited by 10
- 2022Improving the Training Recipe for a Robust Conformer-based Hybrid Modelcited by 9
- 2024Boosting Graph Pooling with Persistent Homologycited by 9
38 more
- 2024Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanismcited by 9
- 2024The VoxCeleb Speaker Recognition Challenge: A Retrospectivecited by 9
- 2021Multi-task Voice Activated Framework using Self-supervised Learningcited by 8
- 2021Multi-View Self-Attention Based Transformer for Speaker Recognitioncited by 8
- 2023VoxSRC 2022: The Fourth VoxCeleb Speaker Recognition Challengecited by 8
- 2021STC speaker recognition systems for the NIST SRE 2021cited by 6
- 2022Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detectioncited by 6
- 2023CoverHunter: Cover Song Identification with Refined Attention and Alignmentscited by 6
- 2023Towards Effective and Compact Contextual Representation for Conformer Transducer Speech Recognition Systemscited by 6
- 2024USAT: A Universal Speaker-Adaptive Text-to-Speech Approachcited by 6
- 2022ECAPA-TDNN for Multi-speaker Text-to-speech Synthesiscited by 5
- 2022Multi-Frequency Information Enhanced Channel Attention Module for Speaker Representation Learningcited by 5
- 2023Generalizable Zero-Shot Speaker Adaptive Speech Synthesis with Disentangled Representationscited by 5
- 2024Exploring Pathological Speech Quality Assessment with ASR-Powered Wav2Vec2 in Data-Scarce Contextcited by 5
- 2021Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embeddingcited by 4
- 2021SVSNet: An End-to-end Speaker Voice Similarity Assessment Modelcited by 4
- 2022Large-scale learning of generalised representations for speaker recognitioncited by 4
- 2023Audio-Visual Speaker Verification via Joint Cross-Attentioncited by 4
- 2024Adapting WavLM for Speech Emotion Recognitioncited by 4
- 2025Privacy-Preserving Biometric Verification with Handwritten Random Digit Stringcited by 4
- 2022DT-SV: A Transformer-based Time-domain Approach for Speaker Verificationcited by 3
- 2023Improving Transformer-based Networks With Locality For Automatic Speaker Verificationcited by 3
- 2023Cross-modal Audio-visual Co-learning for Text-independent Speaker Verificationcited by 3
- 2024DIFFRENT: A Diffusion Model for Recording Environment Transfer of Speechcited by 3
- 2024Audio-Visual Person Verification based on Recursive Fusion of Joint Cross-Attentioncited by 3
- 2024Dynamic Cross Attention for Audio-Visual Person Verificationcited by 3
- 2024PDAF: A Phonetic Debiasing Attention Framework For Speaker Verificationcited by 3
- 2021The NPU System for the 2020 Personalized Voice Trigger Challengecited by 2
- 2021Phoneme-aware and Channel-wise Attentive Learning for Text DependentSpeaker Verificationcited by 2
- 2021MACCIF-TDNN: Multi aspect aggregation of channel and context interdependence features in TDNN-based speaker verificationcited by 2
- 2021Optimized Power Normalized Cepstral Coefficients towards Robust Deep Speaker Verificationcited by 2
- 2022Spoofing-Aware Speaker Verification with Unsupervised Domain Adaptationcited by 2
- 2022Spoofing-Aware Speaker Verification by Multi-Level Fusioncited by 2
- 2022Pretraining Approaches for Spoken Language Recognition: TalTech Submission to the OLR 2021 Challengecited by 2
- 2022Learning Audio-Visual embedding for Person Verification in the Wildcited by 2
- 2023Automatic Modulation Classification with Deep Neural Networkscited by 2
- 2024Layer-aware TDNN: Speaker Recognition Using Multi-Layer Features from Pre-Trained Modelscited by 2
- 2024Exploring SSL Discrete Speech Features for Zipformer-based Contextual ASRcited by 2
50 most cited of 108 All 108 (JSON)
- 2026VOSSA: Voiceprint Optimization for Streaming Speech Architectures30 Sep 2026
- 2026GLAD: Global-Local Adaptive Detector for Robust Speech Deepfake Detection28 Sep 2026
- 2026Trajectory-Aware Benchmark Subset Selection for Cost-Efficient Software Engineering Agent Regression Testing21 Sep 2026
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026A New Transformer-Based Approach for Audio-Based Kinship Verification and a New Uncontrolled Mandarin Kinship Speech Dataset12 Sep 2026
- 2026SISER: Speaker-Invariant Speech Emotion Recognition with Entropy-Based Adversarial Training31 Aug 2026
- 2026Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder12 Aug 2026
- 2026Teffic-Audio: Tell Fact from Fiction30 Jul 2026
- 2026MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognition27 Jul 2026
- 2026Beyond Short Segments : Expanding Speaker Embeddings with Vector Archives26 Jul 2026
- 2026Geometric Second-Order Feature Correlation Learning for Self-Supervised Speech Emotion Recognition4 Jun 2026
- 2026CleanCodec: Efficient and Robust Speech Tokenization via Perceptually Guided Encoding3 Jun 2026
38 more
- 2026A Multimodal Framework for Dementia Detection via Linguistic and Acoustic Representation Learning25 May 2026
- 2026Variational Encoder--Multi-Decoder (VE-MD) for Privacy-by-functional-design (Group) Emotion Recognition2 Apr 2026
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversion23 Feb 2026
- 2026Self-Supervised Learning for Speaker Recognition: A study and review11 Feb 2026
- 2026Speech Emotion Recognition Leveraging OpenAI's Whisper Representations and Attentive Pooling Methods5 Feb 2026
- 2026Multilingual Extraction and Recognition of Implicit Discourse Relations in Speech and Text4 Feb 2026
- 2026A Systematic Evaluation of Co-folding Model Representations for Small-Molecule Learning2 Feb 2026
- 2026Performance and Complexity Trade-off Optimization of Speech Models During Training20 Jan 2026
- 2025Rethinking Leveraging Pre-Trained Multi-Layer Representations for Speaker Verification15 Dec 2025
- 2025On Deepfake Voice Detection -- It's All in the Presentation30 Sep 2025
- 2025Joint Learning using Mixture-of-Expert-Based Representation for Speech Enhancement and Robust Emotion Recognition10 Sep 2025
- 2025DRASP: A Dual-Resolution Attentive Statistics Pooling Framework for Automatic MOS Prediction29 Aug 2025
- 2025Geolocation-Aware Robust Spoken Language Identification23 Aug 2025
- 2025An Enhanced Audio Feature Tailored for Anomalous Sound Detection Based on Pre-trained Models21 Aug 2025
- 2025Auditory Intelligence: Understanding the World Through Sound11 Aug 2025
- 2025Cross-Modal Distillation For Widely Differing Modalities22 Jul 2025
- 2025MATER: Multi-level Acoustic and Textual Emotion Representation for Interpretable Speech Emotion Recognition24 Jun 2025
- 2025On-the-fly Routing for Zero-shot MoE Speaker Adaptation of Speech Foundation Models for Dysarthric Speech Recognition28 May 2025
- 2025EmoSphere-SER: Enhancing Speech Emotion Recognition Through Spherical Representation with Auxiliary Classification26 May 2025
- 2025ABHINAYA -- A System for Speech Emotion Recognition In Naturalistic Conditions Challenge23 May 2025
- 2025Speaker Retrieval in the Wild: Challenges, Effectiveness and Robustness26 Apr 2025
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing8 Apr 2025
- 2025Privacy-Preserving Biometric Verification with Handwritten Random Digit String17 Mar 2025
- 2024Memory-Efficient Training for Deep Speaker Embedding Learning in Speaker Verification2 Dec 2024
- 2024JOOCI: a Framework for Learning Comprehensive Speech Representations14 Oct 2024
- 2024Exploring SSL Discrete Speech Features for Zipformer-based Contextual ASR13 Sep 2024
- 2024Layer-aware TDNN: Speaker Recognition Using Multi-Layer Features from Pre-Trained Models12 Sep 2024
- 2024PDAF: A Phonetic Debiasing Attention Framework For Speaker Verification9 Sep 2024
- 2024Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning27 Aug 2024
- 2024The VoxCeleb Speaker Recognition Challenge: A Retrospective27 Aug 2024
- 2024Toward Improving Synthetic Audio Spoofing Detection Robustness via Meta-Learning and Disentangled Training With Adversarial Examples23 Aug 2024
- 2024Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanism31 Jul 2024
- 2024MR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms11 Jun 2024
- 2024Source -Free Domain Adaptation for Speaker Verification in Data-Scarce Languages and Noisy Channels9 Jun 2024
- 2024Adapting WavLM for Speech Emotion Recognition7 May 2024
- 2024USAT: A Universal Speaker-Adaptive Text-to-Speech Approach28 Apr 2024
- 2024A Large-Scale Evaluation of Speech Foundation Models15 Apr 2024
- 2024Exploring Pathological Speech Quality Assessment with ASR-Powered Wav2Vec2 in Data-Scarce Context29 Mar 2024
50 newest of 108 All 108 (JSON)
- 2025On-the-fly Routing for Zero-shot MoE Speaker Adaptation of Speech Foundation Models for Dysarthric Speech Recognitioncited by 0
- 2025Joint Learning using Mixture-of-Expert-Based Representation for Speech Enhancement and Robust Emotion Recognitioncited by 0
- 2026MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognitioncited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verificationcited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognition27 Jul 2026
- 2025Joint Learning using Mixture-of-Expert-Based Representation for Speech Enhancement and Robust Emotion Recognition10 Sep 2025
- 2025On-the-fly Routing for Zero-shot MoE Speaker Adaptation of Speech Foundation Models for Dysarthric Speech Recognition28 May 2025
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2024A Large-Scale Evaluation of Speech Foundation Modelscited by 38
- 2024ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf modelscited by 22
- 2023CommonAccent: Exploring Large Acoustic Pretrained Models for Accent Classification Based on Common Voicecited by 19
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 17
- 2021Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularizationcited by 14
- 2022Partially Fake Audio Detection by Self-attention-based Fake Span Discoverycited by 14
- 2021Voting for the right answer: Adversarial defense for speaker verificationcited by 12
- 2022Deepfake audio detection by speaker verificationcited by 11
- 2023Disentangling Voice and Content with Self-Supervision for Speaker Recognitioncited by 10
- 2022Improving the Training Recipe for a Robust Conformer-based Hybrid Modelcited by 9
- 2024Boosting Graph Pooling with Persistent Homologycited by 9
12 most cited of 102 All 102 (JSON)
- 2026VOSSA: Voiceprint Optimization for Streaming Speech Architectures30 Sep 2026
- 2026GLAD: Global-Local Adaptive Detector for Robust Speech Deepfake Detection28 Sep 2026
- 2026A New Transformer-Based Approach for Audio-Based Kinship Verification and a New Uncontrolled Mandarin Kinship Speech Dataset12 Sep 2026
- 2026SISER: Speaker-Invariant Speech Emotion Recognition with Entropy-Based Adversarial Training31 Aug 2026
- 2026Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder12 Aug 2026
- 2026Teffic-Audio: Tell Fact from Fiction30 Jul 2026
- 2026Beyond Short Segments : Expanding Speaker Embeddings with Vector Archives26 Jul 2026
- 2026Geometric Second-Order Feature Correlation Learning for Self-Supervised Speech Emotion Recognition4 Jun 2026
- 2026CleanCodec: Efficient and Robust Speech Tokenization via Perceptually Guided Encoding3 Jun 2026
- 2026A Multimodal Framework for Dementia Detection via Linguistic and Acoustic Representation Learning25 May 2026
- 2026Variational Encoder--Multi-Decoder (VE-MD) for Privacy-by-functional-design (Group) Emotion Recognition2 Apr 2026
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversion23 Feb 2026
12 newest of 102 All 102 (JSON)