mlsanityData to 14 Oct 2026

DuplexAct-Bench: Broadening Full-Duplex Speech Evaluation toward Proactive Interaction across Diverse Behavioral Requirements

arXiv 2609.39446 ↗First posted 30 Sep 2026cs.CL cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing full-duplex speech benchmarks cover only subsets of real-time interaction behaviors, often under limited contextual conditions. We introduce DuplexAct-Bench, a bilingual benchmark that systematically covers six complementary behaviors, from interruption and yielding to proactive initiation, active silence, and backchanneling, across Pre-session, In-session, and No-explicit conditions. Across 1,290 English and Chinese streaming trials, we evaluate 12 full-duplex speech systems on both Timing and Content. Results reveal substantial variation across behaviors, conditions, and systems, as well as frequent mismatches between semantic quality and behavioral timing. These findings show that current systems remain far from robustly managing when, whether, and how to participate as real-time interaction unfolds. Project page: https://alitaxky.icu/DuplexAct-Bench/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 30 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

22 of 30 references.

References · 22

  1. 2024GPT-4o System Cardcited by 4,588
  2. 2025Qwen2.5-Omni Technical Reportcited by 736
  3. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  4. 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 197
  5. 2026Qwen3.5-Omni Technical Reportcited by 174
  6. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 141
  7. 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 100
  8. 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 78
  9. 2026PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Modelscited by 63
  10. 2025Full-Duplex-Bench v1.5: Evaluating Overlap Handling for Full-Duplex Speech Modelscited by 54
  11. 2025Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamicscited by 47
  12. 2025Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examinercited by 41
10 more
  1. 2026Full-Duplex-Bench-v3: Benchmarking Tool Use for Full-Duplex Voice Agents Under Real-World Disfluencycited by 37
  2. 2025FD-Bench: A Full-Duplex Benchmarking Pipeline Designed for Full Duplex Spoken Dialogue Systemscited by 20
  3. 2025FLEXI: Benchmarking Full-duplex Human-LLM Speech Interactioncited by 15
  4. 2026Full-Duplex Interaction in Spoken Dialogue Systems: A Comprehensive Study from the ICASSP 2026 HumDial Challengecited by 13
  5. 2026DuplexSLA: A Full-Duplex Spoken Language Model with Synchronized Speech, Language, and Actioncited by 9
  6. 2026DuplexCascade: Full-Duplex Speech-to-Speech Dialogue with VAD-Free Cascaded ASR-LLM-TTS Pipeline and Micro-Turn Optimizationcited by 7
  7. 2026Raon-Speech Technical Reportcited by 7
  8. 2026BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLMcited by 6
  9. 2026AnyAudio-Judge: A Dynamic Rubric-Based Benchmark and Evaluator for Audio Instruction Followingcited by 3
  10. 2026DuplexSpeechBench-IFEval: Evaluating Implicit Instruction Following in Full-Duplex Voice Agentscited by 1

Built on by

Not cited yet.