# VBx for End-to-End Neural and Clustering-based Diarization

arXiv: https://arxiv.org/abs/2510.19572 · HTML: https://mlsanity.com/paper/2510.19572/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Oct 2025.

## Built on by (most cited first, 3 of 3)

- [Make It Hard to Hear, Easy to Learn: Long-Form Bengali ASR and Speaker Diarization via Extreme Augmentation and Perfect Alignment](https://mlsanity.com/paper/2602.23070/) (2026)
- [Emputation: Identification-Guided Neural Imputation Framework](https://mlsanity.com/paper/2607.05279/) (2026)
- [Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge](https://mlsanity.com/paper/2609.20833/) (2026)

## Abstract (arXiv)

We present improvements to speaker diarization in the two-stage end-to-end neural diarization with vector clustering (EEND-VC) framework. The first stage employs a Conformer-based EEND model with WavLM features to infer frame-level speaker activity within short windows. The identities and counts of global speakers are then derived in the second stage by clustering speaker embeddings across windows. The focus of this work is to improve the second stage; we filter unreliable embeddings from short segments and reassign them after clustering. We also integrate the VBx clustering to improve robustness when the number of speakers is large and individual speaking durations are limited. Evaluation on a compound benchmark spanning multiple domains is conducted without fine-tuning the EEND model or tuning clustering parameters per dataset. Despite this, the system generalizes well and matches or exceeds recent state-of-the-art performance.
