mlsanityData to 19 Oct 2026

Rhythm Features for Speaker Identification

arXiv 2506.06834 ↗First posted 7 Jun 2025eess.AScited by 1

On the map: Speech and audio language models → Speaker recognition and diarization

Abstract (arXiv)

While deep learning models have demonstrated robust performance in speaker recognition tasks, they primarily rely on low-level audio features learned empirically from spectrograms or raw waveforms. However, prior work has indicated that idiosyncratic speaking styles heavily influence the temporal structure of linguistic units in speech signals (rhythm). This makes rhythm a strong yet largely overlooked candidate for a speech identity feature. In this paper, we test this hypothesis by applying deep learning methods to perform text-independent speaker identification from rhythm features. Our findings support the usefulness of rhythmic information for speaker recognition tasks but also suggest that high intra-subject variability in ad-hoc speech can degrade its effectiveness.

Key facts. Cited by 1 paper in the map (data through 19 Oct 2026). Placed in Speaker recognition and diarization, one of 11 directions in Speech and audio language models. Builds on 9 of its 23 references that are in the map. First posted on arXiv 7 Jun 2025.

Builds on

9 of 23 references.

References · 9

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,661
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 2,135
  3. 2017VoxCeleb: a large-scale speaker identification datasetcited by 985
  4. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 359
  5. 2020Metrics for Multi-Class Classification: an Overviewcited by 149
  6. 2019Probing the Information Encoded in X-vectorscited by 35
  7. 2024Analysis of Speech Temporal Dynamics in the Context of Speaker Verification and Voice Anonymizationcited by 6
  8. 2020An empirical analysis of information encoded in disentangled neural speaker representationscited by 5
  9. 2013Improving Automatic Emotion Recognition from speech using Rhythm and Temporal featurecited by 4

Built on by

Cited by year (2026 to 19 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Speech Rhythm-Based Speaker Embeddings Extraction from Phonemes and Phoneme Duration for Multi-Speaker Speech Synthesis
  2. 2023Deep Neural Networks for Automatic Speaker Recognition Do Not Learn Supra-Segmental Temporal Features
  3. 2023Time-frequency Network for Robust Speaker Recognition
  4. 2021A Review of Speaker Diarization: Recent Advances with Deep Learning
  5. 2024Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognition
  6. 2024VoxBlink2: A 100K+ Speaker Recognition Corpus and the Open-Set Speaker-Identification Benchmark
  7. 2021Learning spectro-temporal representations of complex sounds with parameterized neural networks
  8. 2025Unsupervised Rhythm and Voice Conversion to Improve ASR on Dysarthric Speech