mlsanityData to 7 Oct 2026

pyannote.audio: neural building blocks for speaker diarization

arXiv 1911.01255 ↗First posted 4 Nov 2019eess.AS cs.SDcited by 175

Not on the map. Why?

Abstract (arXiv)

We introduce pyannote.audio, an open-source toolkit written in Python for speaker diarization. Based on PyTorch machine learning framework, it provides a set of trainable end-to-end neural building blocks that can be combined and jointly optimized to build speaker diarization pipelines. pyannote.audio also comes with pre-trained models covering a wide range of domains for voice activity detection, speaker change detection, overlapped speech detection, and speaker embedding -- reaching state-of-the-art performance for most of them.

Key facts. Cited by 175 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Nov 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 13; 2022: 20; 2023: 33; 2024: 23; 2025: 40; 2026: 46.

175 papers.

Sort:

By area:

  1. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  2. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
  3. 2022Generative Spoken Dialogue Language Modelingcited by 125
  4. 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 109
  5. 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 98
  6. 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 69
  7. 2023Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Biascited by 51
  8. 2023AutoAD: Movie Description in Contextcited by 50
  9. 2023AutoAD II: The Sequel -- Who, When, and What in Movie Audio Descriptioncited by 48
  10. 2025Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamicscited by 45
  11. 2023Can Language Models Learn to Listen?cited by 40
  12. 2025DualTalk: Dual-Speaker Interaction for 3D Talking Head Conversationscited by 31
38 more
  1. 2021End-to-End Speech Recognition from Federated Acoustic Modelscited by 30
  2. 2022DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generationcited by 30
  3. 2024MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversationscited by 25
  4. 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 20
  5. 2024Casablanca: Data and Models for Multidialectal Arabic Speech Recognitioncited by 20
  6. 2023Zambezi Voice: A Multilingual Speech Corpus for Zambian Languagescited by 18
  7. 2022Dubbing in Practice: A Large Scale Study of Human Localization With Insights for Automatic Dubbingcited by 17
  8. 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 14
  9. 2026VIBEVOICE-ASR Technical Reportcited by 14
  10. 2023On the Robustness of Arabic Speech Dialect Identificationcited by 13
  11. 2022DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexiconcited by 12
  12. 2021Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problemcited by 11
  13. 2022Multi-scale Speaker Diarization with Dynamic Scale Weightingcited by 11
  14. 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
  15. 2024DistinctAD: Distinctive Audio Description Generation in Contextscited by 11
  16. 2025Afrispeech-Dialog: A Benchmark Dataset for Spontaneous English Conversations in Healthcare and Beyondcited by 10
  17. 2021Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoringcited by 9
  18. 2021Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediatescited by 9
  19. 2024The VoxCeleb Speaker Recognition Challenge: A Retrospectivecited by 9
  20. 2025Co3Gesture: Towards Coherent Concurrent Co-speech 3D Gesture Generation with Interactive Diffusioncited by 9
  21. 2021The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lapcited by 8
  22. 2023VoxSRC 2022: The Fourth VoxCeleb Speaker Recognition Challengecited by 8
  23. 2024LLM-based speaker diarization correction: A generalizable approachcited by 8
  24. 2021End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddingscited by 7
  25. 2023Leveraging Data Collection and Unsupervised Learning for Code-switched Tunisian Arabic Automatic Speech Recognitioncited by 7
  26. 2024Style-Talker: Finetuning Audio Language Model and Style-Based Text-to-Speech Model for Fast Spoken Dialogue Generationcited by 7
  27. 2025ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matchingcited by 7
  28. 2022Overlapped speech and gender detection with WavLM pre-trained featurescited by 6
  29. 2024USAT: A Universal Speaker-Adaptive Text-to-Speech Approachcited by 6
  30. 2025MNV-17: A High-Quality Performative Mandarin Dataset for Nonverbal Vocalization Recognition in Speechcited by 6
  31. 2022In search of strong embedding extractors for speaker diarisationcited by 5
  32. 2024LiveFC: A System for Live Fact-Checking of Audio Streamscited by 5
  33. 2025Can we train ASR systems on Code-switch without real code-switch data? Case study for Singapore's languagescited by 5
  34. 2022Audio visual character profiles for detecting background characters in entertainment mediacited by 4
  35. 2022Audio-Visual Activity Guided Cross-Modal Identity Association for Active Speaker Detectioncited by 4
  36. 2023Evaluating OpenAI's Whisper ASR for Punctuation Prediction and Topic Modeling of life histories of the Museum of the Personcited by 4
  37. 2023Summary of the DISPLACE Challenge 2023 - DIarization of SPeaker and LAnguage in Conversational Environmentscited by 4
  38. 2023Deep Multimodal Fusion for Surgical Feedback Classificationcited by 4

50 most cited of 175 All 175 (JSON)