# Speaker Fuzzy Fingerprints: Benchmarking Text-Based Identification in Multiparty Dialogues

arXiv: https://arxiv.org/abs/2504.14963 · HTML: https://mlsanity.com/paper/2504.14963/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 5 of its 12 references that are in the map.
- First posted on arXiv 21 Apr 2025.

## Builds on (most cited first, 5 of 5)

- [VoxCeleb2: Deep Speaker Recognition](https://mlsanity.com/paper/1806.05622/) (2018)
- [Fine-tuning wav2vec2 for speaker recognition](https://mlsanity.com/paper/2109.15053/) (2021)
- [Bias in Automated Speaker Recognition](https://mlsanity.com/paper/2201.09486/) (2022)
- [Towards End-to-End Private Automatic Speaker Recognition](https://mlsanity.com/paper/2206.11750/) (2022)
- [Fuzzy Fingerprinting Transformer Language-Models for Emotion Recognition in Conversations](https://mlsanity.com/paper/2309.04292/) (2023)

## Abstract (arXiv)

Speaker identification using voice recordings leverages unique acoustic features, but this approach fails when only textual data is available. Few approaches have attempted to tackle the problem of identifying speakers solely from text, and the existing ones have primarily relied on traditional methods. In this work, we explore the use of fuzzy fingerprints from large pre-trained models to improve text-based speaker identification. We integrate speaker-specific tokens and context-aware modeling, demonstrating that conversational context significantly boosts accuracy, reaching 70.6% on the Friends dataset and 67.7% on the Big Bang Theory dataset. Additionally, we show that fuzzy fingerprints can approximate full fine-tuning performance with fewer hidden units, offering improved interpretability. Finally, we analyze ambiguous utterances and propose a mechanism to detect speaker-agnostic lines. Our findings highlight key challenges and provide insights for future improvements in text-based speaker identification.
