FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systems
Not on the map. Why?
Abstract (arXiv)
Full-Duplex Speech Dialogue Systems (Full-Duplex SDS) have significantly enhanced the naturalness of human-machine interaction by enabling real-time bidirectional communication. However, existing approaches face challenges such as difficulties in independent module optimization and contextual noise interference due to highly coupled architectural designs and oversimplified binary state modeling. This paper proposes FlexDuo, a flexible full-duplex control module that decouples duplex control from spoken dialogue systems through a plug-and-play architectural design. Furthermore, inspired by human information-filtering mechanisms in conversations, we introduce an explicit Idle state. On one hand, the Idle state filters redundant noise and irrelevant audio to enhance dialogue quality. On the other hand, it establishes a semantic integrity-based buffering mechanism, reducing the risk of mutual interruptions while ensuring accurate response transitions. Experimental results on the Fisher corpus demonstrate that FlexDuo reduces the false interruption rate by 24.9% and improves response accuracy by 7.6% compared to integrated full-duplex dialogue system baselines. It also outperforms voice activity detection (VAD) controlled baseline systems in both Chinese and English dialogue quality. The proposed modular architecture and state-based dialogue model provide a novel technical pathway for building flexible and efficient duplex dialogue systems.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 19 Feb 2025.
Builds on
25 of 38 references.
References · 25
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024GPT-4o System Cardcited by 4,467
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2024Qwen2-Audio Technical Reportcited by 543
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
- 2021Generative Spoken Language Modeling from Raw Audiocited by 336
- 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
- 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
- 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
13 more
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
- 2024Mini-Omni2: Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilitiescited by 104
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
- 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interactioncited by 79
- 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
- 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 69
- 2024SpeechVerse: A Large-scale Generalizable Audio Language Modelcited by 62
- 2024Language Model Can Listen While Speakingcited by 62
- 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 57
- 2020TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialogcited by 55
- 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
- 2024SpeechGPT-Gen: Scaling Chain-of-Information Speech Generationcited by 36
- 2022Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systemscited by 28
Built on by
Citing papers per year: 2025: 2; 2026: 13.
15 papers.
Sort:
By area:
- 2025FLEXI: Benchmarking Full-duplex Human-LLM Speech Interactioncited by 14
- 2025Chronological Thinking in Full-Duplex Spoken Dialogue Language Modelscited by 13
- 2026Multi-Faceted Interactivity Alignment in Full-Duplex Speech Modelscited by 9
- 2026Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMscited by 3
- 2026F-Actor: Controllable Conversational Behaviour in Full-Duplex Modelscited by 2
- 2026Liberating LLM Capabilities in Full-Duplex Speech Modelscited by 1
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Predictioncited by 1
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challengescited by 1
- 2026Enabling Streaming User Transcription in Full-Duplex Speech-to-Speech Modelscited by 1
- 2026UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interactioncited by 0
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systemscited by 0
- 2026PACE: A Playback-Aligned Context Engine for LLM-Based Full-Duplex Voice Dialoguecited by 0
3 more
- 2026Enabling Proactive Spoken Turns via a Generalized Style-Aware Full-Duplex Frameworkcited by 0
- 2026Decoupling Turn-Taking from Semantics: A Decoupled Data Approach for Finite-State-Machine-Based Full-Duplex Dialoguecited by 0
- 2026DiffuPlex: Accelerating Full-Duplex Spoken Dialog Models via Rolling Masked Diffusioncited by 0
- 2026DiffuPlex: Accelerating Full-Duplex Spoken Dialog Models via Rolling Masked Diffusion8 Oct 2026
- 2026Enabling Streaming User Transcription in Full-Duplex Speech-to-Speech Models14 Sep 2026
- 2026Decoupling Turn-Taking from Semantics: A Decoupled Data Approach for Finite-State-Machine-Based Full-Duplex Dialogue3 Sep 2026
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction11 Aug 2026
- 2026PACE: A Playback-Aligned Context Engine for LLM-Based Full-Duplex Voice Dialogue7 Aug 2026
- 2026Enabling Proactive Spoken Turns via a Generalized Style-Aware Full-Duplex Framework4 Aug 2026
- 2026Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs7 Jul 2026
- 2026Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models9 Jun 2026
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systems4 Jun 2026
- 2026Liberating LLM Capabilities in Full-Duplex Speech Models4 May 2026
- 2026UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interaction21 Apr 2026
3 more
- 2025FLEXI: Benchmarking Full-duplex Human-LLM Speech Interactioncited by 14
- 2026Multi-Faceted Interactivity Alignment in Full-Duplex Speech Modelscited by 9
- 2026Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMscited by 3
- 2026F-Actor: Controllable Conversational Behaviour in Full-Duplex Modelscited by 2
- 2026Liberating LLM Capabilities in Full-Duplex Speech Modelscited by 1
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Predictioncited by 1
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challengescited by 1
- 2026Enabling Streaming User Transcription in Full-Duplex Speech-to-Speech Modelscited by 1
- 2026UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interactioncited by 0
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systemscited by 0
- 2026PACE: A Playback-Aligned Context Engine for LLM-Based Full-Duplex Voice Dialoguecited by 0
- 2026Enabling Proactive Spoken Turns via a Generalized Style-Aware Full-Duplex Frameworkcited by 0
12 most cited of 14 All 14 (JSON)
- 2026DiffuPlex: Accelerating Full-Duplex Spoken Dialog Models via Rolling Masked Diffusion8 Oct 2026
- 2026Enabling Streaming User Transcription in Full-Duplex Speech-to-Speech Models14 Sep 2026
- 2026Decoupling Turn-Taking from Semantics: A Decoupled Data Approach for Finite-State-Machine-Based Full-Duplex Dialogue3 Sep 2026
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction11 Aug 2026
- 2026PACE: A Playback-Aligned Context Engine for LLM-Based Full-Duplex Voice Dialogue7 Aug 2026
- 2026Enabling Proactive Spoken Turns via a Generalized Style-Aware Full-Duplex Framework4 Aug 2026
- 2026Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs7 Jul 2026
- 2026Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models9 Jun 2026
- 2026IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systems4 Jun 2026
- 2026Liberating LLM Capabilities in Full-Duplex Speech Models4 May 2026
- 2026UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interaction21 Apr 2026
12 newest of 14 All 14 (JSON)