DuplexCascade: Full-Duplex Speech-to-Speech Dialogue with VAD-Free Cascaded ASR-LLM-TTS Pipeline and Micro-Turn Optimization
Not on the map. Why?
Abstract (arXiv)
Spoken dialog systems with cascaded ASR-LLM-TTS modules retain strong LLM intelligence, but VAD segmentation often forces half-duplex turns and brittle control. On the other hand, VAD-free end-to-end model support full-duplex interaction but is hard to maintain conversational intelligence. In this paper, we present DuplexCascade, a VAD-free cascaded streaming pipeline for full-duplex speech-to-speech dialogue. Our key idea is to convert conventional utterance-wise long turns into chunk-wise micro-turn interactions, enabling rapid bidirectional exchange while preserving the strengths of a capable text LLM. To reliably coordinate turn-taking and response timing, we introduce a set of conversational special control tokens that steer the LLM's behavior under streaming constraints. On Full-DuplexBench and VoiceBench, DuplexCascade delivers state-of-the-art full-duplex turn-taking and strong conversational intelligence among open-source speech-to-speech dialogue systems.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
17 of 25 references.
References · 17
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
- 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 192
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
- 2022Generative Spoken Dialogue Language Modelingcited by 125
- 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 94
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
- 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 69
- 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 57
- 2026PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Modelscited by 57
- 2024Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Modelscited by 26
5 more
- 2025Streaming Sequence-to-Sequence Learning with Delayed Streams Modelingcited by 24
- 2020Analyzing the Quality and Stability of a Streaming End-to-End On-Device Speech Recognizercited by 7
- 2020Incremental Text-to-Speech Synthesis Using Pseudo Lookahead with Large Pretrained Language Modelcited by 7
- 2025VoXtream: Full-Stream Text-to-Speech with Extremely Low Latencycited by 5
- 2022Dynamic Speech Endpoint Detection with Regression Targetscited by 4
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilitiescited by 3
- 2026Low-Latency Turn-Taking via Context-Aware Preface Generation in a Real-World Dialogue Robotcited by 0
- 2026PACE: A Playback-Aligned Context Engine for LLM-Based Full-Duplex Voice Dialoguecited by 0
- 2026Causal Analysis and Mitigation of Spurious Onsets in Full-Duplex Speech LLMscited by 0
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoningcited by 0
- 2026Evaluating Real-Time Voice Agents: From Component Quality to Grounded Outcomescited by 0
- 2026DuplexAct-Bench: Broadening Full-Duplex Speech Evaluation toward Proactive Interaction across Diverse Behavioral Requirementscited by 0
- 2026DuplexAct-Bench: Broadening Full-Duplex Speech Evaluation toward Proactive Interaction across Diverse Behavioral Requirements30 Sep 2026
- 2026Evaluating Real-Time Voice Agents: From Component Quality to Grounded Outcomes25 Sep 2026
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning19 Sep 2026
- 2026NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilities18 Sep 2026
- 2026Causal Analysis and Mitigation of Spurious Onsets in Full-Duplex Speech LLMs11 Sep 2026
- 2026PACE: A Playback-Aligned Context Engine for LLM-Based Full-Duplex Voice Dialogue7 Aug 2026
- 2026Low-Latency Turn-Taking via Context-Aware Preface Generation in a Real-World Dialogue Robot25 Jul 2026