mlsanityData to 14 Oct 2026

Synchronization and Turn-Taking in Full-Duplex Speech Dialogue Models

arXiv 2605.20356 ↗First posted 19 May 2026cs.CL cs.AI cs.SDcited by 2

Not on the map. Why?

Abstract (arXiv)

Full-duplex spoken dialogue models (SDMs) can listen and speak simultaneously, enabling interaction dynamics closer to human conversation than turn-based systems. Inspired by neural coupling in human communication, we study how such models coordinate their internal representations during interaction. We simulate full-duplex dialogues between two instances of the pretrained textitMoshi model under controlled conditions, manipulating channel noise and decoding bias. Synchronization is measured using Centered Kernel Alignment (CKA) across temporal lags, while anticipatory turn-taking cues are probed from delayed internal activations using causal LSTM models, from both speaker and listener perspectives. We find strong representational synchronization under no noise conditions, peaking near zero lag and degrading with noise, and we show that internal states encode anticipatory information that supports turn-taking prediction ahead of time.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

10 of 17 references.

References · 10

  1. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
  2. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  3. 2022Generative Spoken Dialogue Language Modelingcited by 126
  4. 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 100
  5. 2025Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamicscited by 47
  6. 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Surveycited by 39
  7. 2025FD-Bench: A Full-Duplex Benchmarking Pipeline Designed for Full Duplex Spoken Dialogue Systemscited by 20
  8. 2025FLEXI: Benchmarking Full-duplex Human-LLM Speech Interactioncited by 15
  9. 2025From Turn-Taking to Synchronous Dialogue: A Survey of Full-Duplex Spoken Language Modelscited by 10
  10. 2025Towards General Auditory Intelligence: Large Multimodal Models for Machine Listening and Speakingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.