mlsanityData to 14 Oct 2026

Playing with Voices: Tabletop Role-Playing Game Recordings as a Diarization Challenge

arXiv 2502.12714 ↗First posted 18 Feb 2025cs.CL cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper provides a proof of concept that audio of tabletop role-playing games (TTRPG) could serve as a challenge for diarization systems. TTRPGs are carried out mostly by conversation. Participants often alter their voices to indicate that they are talking as a fictional character. Audio processing systems are susceptible to voice conversion with or without technological assistance. TTRPG present a conversational phenomenon in which voice conversion is an inherent characteristic for an immersive gaming experience. This could make it more challenging for diarizers to pick the real speaker and determine that impersonating is just that. We present the creation of a small TTRPG audio dataset and compare it against the AMI and the ICSI corpus. The performance of two diarizers, pyannote.audio and wespeaker, were evaluated. We observed that TTRPGs' properties result in a higher confusion rate for both diarizers. Additionally, wespeaker strongly underestimates the number of speakers in the TTRPG audio files. We propose TTRPG audio as a promising challenge for diarization systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 43 references that are in the map. First posted on arXiv 18 Feb 2025.

Builds on

16 of 43 references.

References · 16

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  2. 2020CHiME-6 Challenge:Tackling Multispeaker Speech Recognition for Unsegmented Recordingscited by 132
  3. 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
  4. 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 111
  5. 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 101
  6. 2022Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkitcited by 97
  7. 2020Spot the conversation: speaker diarisation in the wildcited by 79
  8. 2020The Third DIHARD Diarization Challengecited by 49
  9. 2022Dungeons and Dragons as a Dialog Challenge for Artificial Intelligencecited by 35
  10. 2020Speaker Diarization with Lexical Informationcited by 14
  11. 2021Telling Stories through Multi-User Dialogue by Modeling Character Relationscited by 13
  12. 2021PaCo: Preconditions Attributed to Commonsense Knowledgecited by 9
4 more
  1. 2023The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systemscited by 9
  2. 2021USTC-NELSLIP System Description for DIHARD-III Challengecited by 7
  3. 2020A Memory Augmented Architecture for Continuous Speaker Identification in Meetingscited by 2
  4. 2023Weakly-supervised Deep Cognate Detection Framework for Low-Resourced Languages Using Morphological Knowledge of Closely-Related Languagescited by 2

Built on by

Not cited yet.