mlsanityData to 7 Oct 2026

Real-TurnTurk: A Multimodal Turkish Corpus for Turn-Taking Prediction

arXiv 2608.22071 ↗First posted 22 Aug 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Turn-taking is a basic organizational feature of human conversation and remains difficult to model in natural, synchronous dialog systems. While existing research has explored multimodal approaches and large language models for turn-ending prediction, there is a lack of naturalistic conversational corpora specifically addressing turn-taking dynamics in Turkish. This study introduces a multimodal Turkish conversational dataset of unscripted dyadic interactions, comprising synchronized front-facing video, per-speaker audio channels that allow overlapping speech to be attributed to individual speakers, and time-aligned transcriptions. Turn-taking prediction is formulated as a binary classification problem, and a Genetic Algorithm (GA) is employed to optimize interpretable decision rules derived from visual, acoustic, and linguistic features. A hybrid AND-OR rule representation is adopted in the proposed framework to represent the alternative cue combinations that precede a turn transition.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 27 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

9 of 27 references.

References · 9

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  3. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
  4. 2022Voice Activity Projection: Self-supervised Learning of Turn-taking Eventscited by 54
  5. 2021Py-Feat: Python Facial Expression Analysis Toolboxcited by 33
  6. 2024Real-time and Continuous Turn-taking Prediction Using Voice Activity Projectioncited by 21
  7. 2018Multimodal Continuous Turn-Taking Prediction Using Multiscale RNNscited by 12
  8. 2025Predicting Turn-Taking and Backchannel in Human-Machine Conversations Using Linguistic, Acoustic, and Visual Signalscited by 10
  9. 2026Syn-TurnTurk: A Synthetic Dataset for Turn-Taking Prediction in Turkish Dialoguescited by 1

Built on by

Not cited yet.