mlsanityData to 7 Oct 2026

FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systems

arXiv 2502.13472 ↗First posted 19 Feb 2025cs.CL cs.HCcited by 15

Not on the map. Why?

Abstract (arXiv)

Full-Duplex Speech Dialogue Systems (Full-Duplex SDS) have significantly enhanced the naturalness of human-machine interaction by enabling real-time bidirectional communication. However, existing approaches face challenges such as difficulties in independent module optimization and contextual noise interference due to highly coupled architectural designs and oversimplified binary state modeling. This paper proposes FlexDuo, a flexible full-duplex control module that decouples duplex control from spoken dialogue systems through a plug-and-play architectural design. Furthermore, inspired by human information-filtering mechanisms in conversations, we introduce an explicit Idle state. On one hand, the Idle state filters redundant noise and irrelevant audio to enhance dialogue quality. On the other hand, it establishes a semantic integrity-based buffering mechanism, reducing the risk of mutual interruptions while ensuring accurate response transitions. Experimental results on the Fisher corpus demonstrate that FlexDuo reduces the false interruption rate by 24.9% and improves response accuracy by 7.6% compared to integrated full-duplex dialogue system baselines. It also outperforms voice activity detection (VAD) controlled baseline systems in both Chinese and English dialogue quality. The proposed modular architecture and state-based dialogue model provide a novel technical pathway for building flexible and efficient duplex dialogue systems.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 19 Feb 2025.

Builds on

25 of 38 references.

References · 25

  1. 2024Qwen2.5 Technical Reportcited by 4,713
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  5. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  6. 2024Qwen2-Audio Technical Reportcited by 543
  7. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
  8. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
  9. 2021Generative Spoken Language Modeling from Raw Audiocited by 336
  10. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
  11. 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
  12. 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
13 more
  1. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
  2. 2024Mini-Omni2: Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilitiescited by 104
  3. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
  4. 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interactioncited by 79
  5. 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
  6. 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 69
  7. 2024SpeechVerse: A Large-scale Generalizable Audio Language Modelcited by 62
  8. 2024Language Model Can Listen While Speakingcited by 62
  9. 2024OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversationcited by 57
  10. 2020TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialogcited by 55
  11. 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
  12. 2024SpeechGPT-Gen: Scaling Chain-of-Information Speech Generationcited by 36
  13. 2022Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systemscited by 28

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 13.

15 papers.

Sort:

By area: