Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Not on the map. Why?
Abstract (arXiv)
This paper describes the Microsoft speaker diarization system for monaural multi-talker recordings in the wild, evaluated at the diarization track of the VoxCeleb Speaker Recognition Challenge(VoxSRC) 2020. We will first explain our system design to address issues in handling real multi-talker recordings. We then present the details of the components, which include Res2Net-based speaker embedding extractor, conformer-based continuous speech separation with leakage filtering, and a modified DOVER (short for Diarization Output Voting Error Reduction) method for system fusion. We evaluate the systems with the data set provided by VoxSRCchallenge 2020, which contains real-life multi-talker audio collected from YouTube. Our best system achieves 3.71% and 6.23% of the diarization error rate (DER) on development set and evaluation set, respectively, being ranked the 1st at the diarization track of the challenge.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 2; 2024: 2.
17 papers.
Sort:
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 122
- 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wildcited by 24
- 2021Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASRcited by 22
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
- 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audiocited by 10
- 2024The VoxCeleb Speaker Recognition Challenge: A Retrospectivecited by 9
- 2021The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lapcited by 8
- 2022Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractorscited by 7
- 2022Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarizationcited by 7
- 2021Multi-scale speaker embedding-based graph attention networks for speaker diarisationcited by 6
- 2022In search of strong embedding extractors for speaker diarisationcited by 5
- 2022Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separationcited by 4
5 more
- 2024Improving Speaker Assignment in Speaker-Attributed ASR for Real Meeting Applicationscited by 3
- 2022Royalflush Speaker Diarization System for ICASSP 2022 Multi-channel Multi-party Meeting Transcription Challengecited by 2
- 2023End-to-End Integration of Speech Separation and Voice Activity Detection for Low-Latency Diarization of Telephone Conversationscited by 2
- 2023SVVAD: Personal Voice Activity Detection for Speaker Verificationcited by 2
- 2022TSUP Speaker Diarization System for Conversational Short-phrase Speaker Diarization Challengecited by 1
- 2024The VoxCeleb Speaker Recognition Challenge: A Retrospective27 Aug 2024
- 2024Improving Speaker Assignment in Speaker-Attributed ASR for Real Meeting Applications11 Mar 2024
- 2023SVVAD: Personal Voice Activity Detection for Speaker Verification31 May 2023
- 2023End-to-End Integration of Speech Separation and Voice Activity Detection for Low-Latency Diarization of Telephone Conversations21 Mar 2023
- 2022In search of strong embedding extractors for speaker diarisation26 Oct 2022
- 2022TSUP Speaker Diarization System for Conversational Short-phrase Speaker Diarization Challenge26 Oct 2022
- 2022Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarization27 Aug 2022
- 2022Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractors6 Jun 2022
- 2022Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation7 Apr 2022
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings30 Mar 2022
- 2022Royalflush Speaker Diarization System for ICASSP 2022 Multi-channel Multi-party Meeting Transcription Challenge10 Feb 2022
- 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wild29 Nov 2021
5 more
- 2021Multi-scale speaker embedding-based graph attention networks for speaker diarisation7 Oct 2021
- 2021Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR7 Oct 2021
- 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio6 Jul 2021
- 2021The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap2 Feb 2021
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learning24 Jan 2021
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 122
- 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wildcited by 24
- 2021Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASRcited by 22
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
- 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audiocited by 10
- 2024The VoxCeleb Speaker Recognition Challenge: A Retrospectivecited by 9
- 2021The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lapcited by 8
- 2022Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractorscited by 7
- 2022Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarizationcited by 7
- 2021Multi-scale speaker embedding-based graph attention networks for speaker diarisationcited by 6
- 2022In search of strong embedding extractors for speaker diarisationcited by 5
- 2022Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separationcited by 4
12 most cited of 17 All 17 (JSON)
- 2024The VoxCeleb Speaker Recognition Challenge: A Retrospective27 Aug 2024
- 2024Improving Speaker Assignment in Speaker-Attributed ASR for Real Meeting Applications11 Mar 2024
- 2023SVVAD: Personal Voice Activity Detection for Speaker Verification31 May 2023
- 2023End-to-End Integration of Speech Separation and Voice Activity Detection for Low-Latency Diarization of Telephone Conversations21 Mar 2023
- 2022In search of strong embedding extractors for speaker diarisation26 Oct 2022
- 2022TSUP Speaker Diarization System for Conversational Short-phrase Speaker Diarization Challenge26 Oct 2022
- 2022Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarization27 Aug 2022
- 2022Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractors6 Jun 2022
- 2022Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation7 Apr 2022
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings30 Mar 2022
- 2022Royalflush Speaker Diarization System for ICASSP 2022 Multi-channel Multi-party Meeting Transcription Challenge10 Feb 2022
- 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wild29 Nov 2021
12 newest of 17 All 17 (JSON)