# Deep Speaker Embedding Learning with Multi-Level Pooling for Text-Independent Speaker Verification

arXiv: https://arxiv.org/abs/1902.07821 · HTML: https://mlsanity.com/paper/1902.07821/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Feb 2019.

## Built on by (most cited first, 7 of 7)

- [Improving Transformer-based Networks With Locality For Automatic Speaker Verification](https://mlsanity.com/paper/2302.08639/) (2023)
- [Learning Repeatable Speech Embeddings Using An Intra-class Correlation Regularizer](https://mlsanity.com/paper/2310.17049/) (2023)
- [Constraining Representations Yields Models That Know What They Don't Know](https://mlsanity.com/paper/2208.14488/) (2022)
- [Dynamic Kernels and Channel Attention for Low Resource Speaker Verification](https://mlsanity.com/paper/2211.02000/) (2022)
- [Analyzing And Improving Neural Speaker Embeddings for ASR](https://mlsanity.com/paper/2301.04571/) (2023)
- [LightCAM: A Fast and Light Implementation of Context-Aware Masking based D-TDNN for Speaker Verification](https://mlsanity.com/paper/2402.06073/) (2024)
- [Towards stable AI systems for Evaluating Arabic Pronunciations](https://mlsanity.com/paper/2508.19587/) (2025)

## Abstract (arXiv)

This paper aims to improve the widely used deep speaker embedding x-vector model. We propose the following improvements: (1) a hybrid neural network structure using both time delay neural network (TDNN) and long short-term memory neural networks (LSTM) to generate complementary speaker information at different levels; (2) a multi-level pooling strategy to collect speaker information from both TDNN and LSTM layers; (3) a regularization scheme on the speaker embedding extraction layer to make the extracted embeddings suitable for the following fusion step. The synergy of these improvements are shown on the NIST SRE 2016 eval test (with a 19% EER reduction) and SRE 2018 dev test (with a 9% EER reduction), as well as more than 10% DCF scores reduction on these two test sets over the x-vector baseline.
