Unsupervised Cross-device Speaker Diarization And Linking Through Spatiotemporal Structure
On the map: Speech and audio language models → Speaker recognition and diarization
Abstract (arXiv)
Linking speakers across independently recorded rooms is difficult because microphone, room, and codec mismatch distort speaker embeddings. We study visitor linking without visitor enrollment or identity labels in simulated outpatient workflows. The proposed method combines per-device embedding centering, concurrency constraints, room-type-specific visit constraints, and a clustering threshold calibrated from concurrent visitors and identified staff voices. On simulated days built from VOiCES recordings, with companions, return visits, walk-ins, silent visits, and acoustic leakage, it improves B3-F1 over the best label-free baseline for all 11 extractors, by 5.3-14.6 points (all 95% intervals exclude zero). ECAPA-TDNN reaches 86.6, compared with 76.4 for the best label-free baseline and 87.7 for the best oracle-informed baseline. Gains persist across the reported workflow perturbations, but depend on removing duplicated cross-room speech: without this step, the method wins for only 2 of 11 extractors. Single-visit patients also remain vulnerable to false merges. These results support structure-aware linking while identifying preprocessing and identity-safety limitations that must be addressed before clinical deployment.
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speaker recognition and diarization, one of 11 directions in Speech and audio language models. Builds on 17 of its 28 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
17 of 28 references.
Closest ancestors · 8
Same direction, newest first
- 2026On Low-Bit Quantization Errors in Speaker Verification: Diagnostic and Mitigation6 Jun
- 2026ReDimNet2: Scaling Speaker Verification via Time-Pooled Dimension Reshaping12 Mar
- 2026Speaker Verification with Speech-Aware LLMs: Evaluation and Augmentation11 Mar
- 2025Enhancing Speaker Verification with w2v-BERT 2.0 and Knowledge Distillation guided Structured Pruning5 Oct
- 2024Reshape Dimensions Network for Speaker Recognition25 Jul
- 2023An Enhanced Res2Net with Local and Global Feature Fusion for Speaker Verification22 May
- 2022Multimodal Clustering with Role Induced Constraints for Speaker Diarization1 Apr
- 2021TitaNet: Neural Model for speaker representation with 1D Depth-wise separable convolutions and global context8 Oct
Other references · 9
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 980
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 532
- 2020Integrating end-to-end neural and clustering-based diarization: Getting the best of both worldscited by 75
- 2020Auto-Tuning Spectral Clustering for Speaker Diarization Using Normalized Maximum Eigengapcited by 64
- 2018Voices Obscured in Complex Environmental Settings (VOICES) corpuscited by 47
- 20233D-Speaker: A Large-Scale Multi-Device, Multi-Distance, and Multi-Dialect Corpus for Speech Representation Disentanglementcited by 31
- 2018The CORAL+ Algorithm for Unsupervised Domain Adaptation of PLDAcited by 29
- 2020The INTERSPEECH 2020 Far-Field Speaker Verification Challengecited by 22
- 2019Progressive Unsupervised Person Re-identification by Tracklet Association with Spatio-Temporal Regularizationcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022In search of strong embedding extractors for speaker diarisation
- 2026Beyond Cross-Reconstruction: Probing-Based Disentanglement Evaluation for Acoustic Teleportation Codecs
- 2026Fast and Robust On-Device Speaker Diarization: Relative Minimum Cluster Size for Stride-Accelerated Pipelines
- 2026Echo: A Joint-Embedding Predictive Architecture for Speaker Diarization and Speech Recognition in a Shared Latent Space
- 2026Toward accurate speaker inventories for online speaker diarization
- 2021Neural Speaker Embeddings for Ultrasound-based Silent Speech Interfaces
- 2024Rethinking Speaker Embeddings for Speech Generation: Sub-Center Modeling for Capturing Intra-Speaker Diversity
- 2025Towards Low-Latency Tracking of Multiple Speakers With Short-Context Speaker Embeddings