mlsanityData to 14 Oct 2026

End-to-End Speaker Diarization for an Unknown Number of Speakers with Encoder-Decoder Based Attractors

arXiv 2005.09921 ↗First posted 20 May 2020eess.AS cs.CL cs.SDcited by 71

Not on the map. Why?

Abstract (arXiv)

End-to-end speaker diarization for an unknown number of speakers is addressed in this paper. Recently proposed end-to-end speaker diarization outperformed conventional clustering-based speaker diarization, but it has one drawback: it is less flexible in terms of the number of speakers. This paper proposes a method for encoder-decoder based attractor calculation (EDA), which first generates a flexible number of attractors from a speech embedding sequence. Then, the generated multiple attractors are multiplied by the speech embedding sequence to produce the same number of speaker activities. The speech embedding sequence is extracted using the conventional self-attentive end-to-end neural speaker diarization (SA-EEND) network. In a two-speaker condition, our method achieved a 2.69 % diarization error rate (DER) on simulated mixtures and a 8.07 % DER on the two-speaker subset of CALLHOME, while vanilla SA-EEND attained 4.56 % and 9.54 %, respectively. In unknown numbers of speakers conditions, our method attained a 15.29 % DER on CALLHOME, while the x-vector-based clustering method achieved a 19.43 % DER.

Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 18; 2022: 17; 2023: 11; 2024: 12; 2025: 9; 2026: 4.

71 papers.

Sort:

By area:

  1. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  2. 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
  3. 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 111
  4. 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wildcited by 25
  5. 2021Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASRcited by 22
  6. 2021VoxCeleb Enrichment for Age and Gender Recognitioncited by 20
  7. 2024DiarizationLM: Speaker Diarization Post-Processing with Large Language Modelscited by 16
  8. 2021Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractorscited by 15
  9. 2024Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systemscited by 15
  10. 2021BERTraffic: BERT-based Joint Speaker Role and Speaker Change Detection for Air Traffic Control Communicationscited by 13
  11. 2022Multi-scale Speaker Diarization with Dynamic Scale Weightingcited by 11
  12. 2023Leveraging Pretrained Representations with Task-related Keywords for Alzheimer's Disease Detectioncited by 11
38 more
  1. 2024The VoxCeleb Speaker Recognition Challenge: A Retrospectivecited by 9
  2. 2021The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lapcited by 8
  3. 2022Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractorscited by 8
  4. 2024Look, Listen and Recognise: Character-Aware Audio-Visual Subtitlingcited by 8
  5. 2021End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddingscited by 7
  6. 2021Multi-scale speaker embedding-based graph attention networks for speaker diarisationcited by 7
  7. 2022Improving the Naturalness of Simulated Conversations for End-to-End Neural Diarizationcited by 7
  8. 2022Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarizationcited by 7
  9. 2023Supervised Hierarchical Clustering using Graph Neural Networks for Speaker Diarizationcited by 7
  10. 2023Unified Modeling of Multi-Talker Overlapped Speech Recognition and Diarization with a Sidecar Separatorcited by 7
  11. 2025From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understandingcited by 6
  12. 2021DIVE: End-to-end Speech Diarization via Iterative Speaker Embeddingcited by 5
  13. 2022A Comparative Study on Speaker-attributed Automatic Speech Recognition in Multi-party Meetingscited by 5
  14. 2022In search of strong embedding extractors for speaker diarisationcited by 5
  15. 2023Exploring Speaker-Related Information in Spoken Language Understanding for Better Speaker Diarizationcited by 5
  16. 2026TagSpeech: End-to-End Multi-Speaker ASR and Diarization with Fine-Grained Temporal Groundingcited by 5
  17. 2022ASR-Aware End-to-end Neural Diarizationcited by 4
  18. 2024Focus Agent: LLM-Powered Virtual Focus Groupcited by 4
  19. 2025Demographic Attributes Prediction from Speech Using WavLM Embeddingscited by 4
  20. 2021Contrastive Separative Coding for Self-supervised Representation Learningcited by 3
  21. 2021Multi-Channel End-to-End Neural Diarization with Distributed Microphonescited by 3
  22. 2022Tight integration of neural- and clustering-based diarization through deep unfolding of infinite Gaussian mixture modelcited by 3
  23. 2022Self-supervised Speaker Diarizationcited by 3
  24. 2022Reformulating Speaker Diarization as Community Detection With Emphasis On Topological Structurecited by 3
  25. 2022The Conversational Short-phrase Speaker Diarization (CSSD) Task: Dataset, Evaluation Metric and Baselinescited by 3
  26. 2023Neural Diarization with Non-autoregressive Intermediate Attractorscited by 3
  27. 2023DiaCorrect: Error Correction Back-end For Speaker Diarizationcited by 3
  28. 2024Multiple Choice Learning for Efficient Speech Separation with Many Speakerscited by 3
  29. 2025Character-Centric Understanding of Animated Moviescited by 3
  30. 2021BeamTransformer: Microphone Array-based Overlapping Speech Detectioncited by 2
  31. 2021CS-Rep: Making Speaker Verification Networks Embracing Re-parameterizationcited by 2
  32. 2022TMS: A Temporal Multi-scale Backbone Design for Speaker Embeddingcited by 2
  33. 2022Speaker Embedding-aware Neural Diarization: an Efficient Framework for Overlapping Speech Diarization in Meeting Scenarioscited by 2
  34. 2023End-to-End Integration of Speech Separation and Voice Activity Detection for Low-Latency Diarization of Telephone Conversationscited by 2
  35. 2024Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarizationcited by 2
  36. 2021Speaker Embedding-aware Neural Diarization for Flexible Number of Speakers with Textual Informationcited by 1
  37. 2022Late Audio-Visual Fusion for In-The-Wild Speaker Diarizationcited by 1
  38. 2022High-resolution embedding extractor for speaker diarisationcited by 1

50 most cited of 71 All 71 (JSON)