mlsanityData to 7 Oct 2026

DuplexCascade: Full-Duplex Speech-to-Speech Dialogue with VAD-Free Cascaded ASR-LLM-TTS Pipeline and Micro-Turn Optimization

arXiv 2603.09180 ↗First posted 10 Mar 2026cs.CL cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Spoken dialog systems with cascaded ASR-LLM-TTS modules retain strong LLM intelligence, but VAD segmentation often forces half-duplex turns and brittle control. On the other hand, VAD-free end-to-end model support full-duplex interaction but is hard to maintain conversational intelligence. In this paper, we present DuplexCascade, a VAD-free cascaded streaming pipeline for full-duplex speech-to-speech dialogue. Our key idea is to convert conventional utterance-wise long turns into chunk-wise micro-turn interactions, enabling rapid bidirectional exchange while preserving the strengths of a capable text LLM. To reliably coordinate turn-taking and response timing, we introduce a set of conversational special control tokens that steer the LLM's behavior under streaming constraints. On Full-DuplexBench and VoiceBench, DuplexCascade delivers state-of-the-art full-duplex turn-taking and strong conversational intelligence among open-source speech-to-speech dialogue systems.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

17 of 25 references.

References · 17

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
  3. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
  4. 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 192
  5. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
  6. 2022Generative Spoken Dialogue Language Modelingcited by 125
  7. 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 94
  8. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
  9. 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 69
  10. 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 57
  11. 2026PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Modelscited by 57
  12. 2024Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Modelscited by 26
5 more
  1. 2025Streaming Sequence-to-Sequence Learning with Delayed Streams Modelingcited by 24
  2. 2020Analyzing the Quality and Stability of a Streaming End-to-End On-Device Speech Recognizercited by 7
  3. 2020Incremental Text-to-Speech Synthesis Using Pseudo Lookahead with Large Pretrained Language Modelcited by 7
  4. 2025VoXtream: Full-Stream Text-to-Speech with Extremely Low Latencycited by 5
  5. 2022Dynamic Speech Endpoint Detection with Regression Targetscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.