mlsanityData to 14 Oct 2026

X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction

arXiv 2608.10878 ↗First posted 11 Aug 2026cs.CL eess.AScited by 3

Not on the map. Why?

Abstract (arXiv)

Accurate and responsive turn-taking is essential for spoken dialogue systems, which must distinguish in real time between user interruptions, backchannels that should be ignored, and the completion of an utterance. Prior modular approaches typically optimize turn state prediction at the utterance or fixed-chunk level, creating a mismatch with the continuous turn state estimate, and often depend on an auxiliary ASR model, which limits responsiveness and increases overall system complexity. Therefore, we present X2-Turn, a frame-synchronous turn state prediction method via delayed-stream modeling. Specifically, building on the pretrained Voxtral Realtime model, we introduce a frame-synchronous turn state head that operates in parallel with the ASR head on shared streaming representations, jointly predicting ASR tokens and fine-grained turn states at the frame level. Experiments on bilingual EasyTurn and Full-Duplex-Bench demonstrate that the proposed method achieves an effective trade-off between turn state accuracy and decision latency.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 27 of its 34 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

27 of 34 references.

References · 27

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  3. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
  4. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
  5. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
  6. 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 226
  7. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
  8. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 141
  9. 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 128
  10. 2022Generative Spoken Dialogue Language Modelingcited by 126
  11. 2026Qwen3-ASR Technical Reportcited by 118
  12. 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
15 more
  1. 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 100
  2. 2021M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challengecited by 71
  3. 2026PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Modelscited by 63
  4. 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 60
  5. 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 60
  6. 2025Full-Duplex-Bench v1.5: Evaluating Overlap Handling for Full-Duplex Speech Modelscited by 54
  7. 2025Streaming Sequence-to-Sequence Learning with Delayed Streams Modelingcited by 27
  8. 2025FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systemscited by 15
  9. 2025Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systemscited by 13
  10. 2026SoulX-Duplug: Plug-and-Play Streaming State Prediction Module for Realtime Full-Duplex Speech Conversationcited by 9
  11. 2026Voxtral Realtimecited by 6
  12. 2026Uni-ASR: Unified LLM-Based Architecture for Non-Streaming and Streaming Automatic Speech Recognitioncited by 6
  13. 2026JoyAI-Talker: Full-Duplex Speech Interactive Large Model Built for Empathetic Voice Agentscited by 4
  14. 2026FastTurn: Unifying Acoustic and Streaming Semantic Cues for Low-Latency and Robust Turn Detectioncited by 3
  15. 2026JAL-Turn: Joint Acoustic-Linguistic Modeling for Real-Time and Robust Turn-Taking Detection in Full-Duplex Spoken Dialogue Systemscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.