EchoChain: A Full-Duplex Benchmark for State-Update Reasoning Under Interruptions
Not on the map. Why?
Abstract (arXiv)
Real-time voice assistants must revise task state when users interrupt mid-response, but existing spoken-dialog benchmarks largely evaluate turn-based interaction and miss this failure mode. We introduce EchoChain, a controlled benchmark for evaluating full-duplex state-update reasoning under mid-speech interruptions. EchoChain identifies three recurring failure patterns in post-interruption continuations: contextual inertia, interruption amnesia, and objective displacement. The benchmark generates scenario-driven conversations and injects interruptions at a standardized point relative to assistant speech onset, enabling controlled cross-model comparison. In a paired half-duplex control, total failures drop by 40.2% relative to interrupted runs, indicating that many errors are driven by state-update reasoning under interruption rather than task difficulty alone. Across evaluated real-time voice models, no system exceeds a 50% pass rate, showing substantial room for improvement in mid-generation state revision. EchoChain provides a reproducible benchmark for diagnosing state-update reasoning failures in full-duplex voice interaction.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 11 of its 14 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
11 of 14 references.
References · 11
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 124
- 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 94
- 2023SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agentscited by 71
- 2025Full-Duplex-Bench v1.5: Evaluating Overlap Handling for Full-Duplex Speech Modelscited by 53
- 2025Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examinercited by 38
- 2025Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interactioncited by 18
- 2025FD-Bench: A Full-Duplex Benchmarking Pipeline Designed for Full Duplex Spoken Dialogue Systemscited by 17
- 2025Can Speech LLMs Think while Listening?cited by 15
- 2025MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocolscited by 14
- 2025FLEXI: Benchmarking Full-duplex Human-LLM Speech Interactioncited by 14
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026DuplexWorld: Can voice agents help you get through the day?cited by 2
- 2026When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptionscited by 0
- 2026Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agentscited by 0
- 2026Prompts versus Rules: Auditing and Controlling Speech Naturalness Behaviors in Voice User Simulatorscited by 0
- 2026Prompts versus Rules: Auditing and Controlling Speech Naturalness Behaviors in Voice User Simulators7 Oct 2026
- 2026Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents11 Sep 2026
- 2026When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions29 Aug 2026
- 2026DuplexWorld: Can voice agents help you get through the day?11 Aug 2026