A Survey of Full-Duplex Spoken Dialogue Systems: Architectural Hierarchy, Interaction Ontology, and Decision State Machine
Not on the map. Why?
Abstract (arXiv)
More than a dozen spoken dialogue systems have recently claimed to be "full-duplex," yet the term has been used to describe substantially different capabilities. Existing surveys collapse them onto a single axis (cascaded/end-to-end, or engineered/learned) and miss the distinctions that matter most for builders. We argue that much of this ambiguity is taxonomical: current terminology does not specify where duplex decisions are made, which interaction types are supported, or how a system behaves moment by moment. This paper introduces three complementary frameworks: (i) an L0-L3 Architectural Hierarchy that locates where duplex decisions are made; (ii) a T× I× R Interaction Ontology that specifies the temporal relation, user intent, and required system response for each interaction; and (iii) a Decision State Machine (IDLE/LISTEN/SPEAK/WAIT/DUAL) that describes how systems move between states. Across published systems and benchmarks, our audit documents a realization gap: although many architectures can in principle operate in full-duplex states, their observed behavior remains constrained by the interaction patterns represented in training and evaluation. We point to the limited public training-data coverage relative to the (largely undisclosed) industrial corpora, together with the still-unrealized goal of L3 representation-level modeling, as the key frontiers for future research on full-duplex dialogue. The related material is available at https://github.com/DuplexLM/DuplexSurvey.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jun 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026DuplexWorld: Can voice agents help you get through the day?cited by 4
- 2026Multimodal Duplex Interaction Agentcited by 3
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challengescited by 1
- 2026DuplexDrama: A Synthesized Dialogue Dataset with Scenarios, Full-Duplex Behaviors, Expressive Speech, and Sound Eventscited by 1
- 2026Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agentscited by 0
- 2026TimeInteract: Towards Real-Time Interactive Intelligence for Streaming Time Seriescited by 0
- 2026RUBATO: Decoupled Clocks Allow Full-Duplex Models to Think as Fast as They Cancited by 0
- 2026DuplexAct: How Interactive Are Frontier Full-Duplex Spoken Language Models?cited by 0
- 2026DuplexAct: How Interactive Are Frontier Full-Duplex Spoken Language Models?13 Oct 2026
- 2026RUBATO: Decoupled Clocks Allow Full-Duplex Models to Think as Fast as They Can9 Oct 2026
- 2026TimeInteract: Towards Real-Time Interactive Intelligence for Streaming Time Series22 Sep 2026
- 2026Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents11 Sep 2026
- 2026DuplexDrama: A Synthesized Dialogue Dataset with Scenarios, Full-Duplex Behaviors, Expressive Speech, and Sound Events11 Sep 2026
- 2026Multimodal Duplex Interaction Agent8 Sep 2026
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026DuplexWorld: Can voice agents help you get through the day?11 Aug 2026