Semantic-Aware Interruption Detection in Spoken Dialogue Systems: Benchmark, Metric, and Model
Not on the map. Why?
Abstract (arXiv)
Achieving natural full-duplex interaction in spoken dialogue systems (SDS) remains a challenge due to the difficulty of accurately detecting user interruptions. Current solutions are polarized between "trigger-happy" VAD-based methods that misinterpret backchannels and robust end-to-end models that exhibit unacceptable response delays. Moreover, the absence of real-world benchmarks and holistic metrics hinders progress in the field. This paper presents a comprehensive frame-work to overcome these limitations. We first introduce SID-Bench, the first benchmark for semantic-aware interruption detection built entirely from real-world human dialogues. To provide a rigorous assessment of the responsiveness-robustness trade-off, we propose the Average Penalty Time (APT) metric, which assigns a temporal cost to both false alarms and late responses. Building on this framework, we design an LLM-based detection model optimized through a novel training paradigm to capture subtle semantic cues of intent. Experimental results show that our model significantly outperforms mainstream baselines, achieving a nearly threefold reduction in APT. By successfully resolving the long-standing tension between speed and stability, our work establishes a new state-of-the-art for intelligent interruption handling in SDS. To facilitate future research, SID-Bench and the associated code are available at: https://github.com/xkx-hub/SID-bench.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Mar 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Overcoming State Inertia in Full-Duplex Spoken Language Models via Activation Steeringcited by 4
- 2026Same Words, Different Actions: Paired Turn-Taking Evaluation under Rewritten Dialogue Contextscited by 2
- 2026Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agentscited by 0
- 2026MultiPartyTurnBench: Benchmarking Floor Control in Multi-Party Spoken Dialoguecited by 0
- 2026MultiPartyTurnBench: Benchmarking Floor Control in Multi-Party Spoken Dialogue14 Oct 2026
- 2026Same Words, Different Actions: Paired Turn-Taking Evaluation under Rewritten Dialogue Contexts15 Sep 2026
- 2026Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents11 Sep 2026
- 2026Overcoming State Inertia in Full-Duplex Spoken Language Models via Activation Steering9 Jun 2026