cs.SDMar 25, 2026

Semantic-Aware Interruption Detection in Spoken Dialogue Systems: Benchmark, Metric, and Model

Authors: Kangxiang Xia, Bingshen Mu, Xian Shi, Jin Xu, Lei Xie

Organizations: Qwen Team, Alibaba · Independent Researcher

Abstract

Achieving natural full-duplex interaction in spoken dialogue systems (SDS) remains a challenge due to the difficulty of accurately detecting user interruptions. Current solutions are polarized between "trigger-happy" VAD-based methods that misinterpret backchannels and robust end-to-end models that exhibit unacceptable response delays. Moreover, the absence of real-world benchmarks and holistic metrics hinders progress in the field. This paper presents a comprehensive frame-work to overcome these limitations. We first introduce SID-Bench, the first benchmark for semantic-aware interruption detection built entirely from real-world human dialogues. To provide a rigorous assessment of the responsiveness-robustness trade-off, we propose the Average Penalty Time (APT) metric, which assigns a temporal cost to both false alarms and late responses. Building on this framework, we design an LLM-based detection model optimized through a novel training paradigm to capture subtle semantic cues of intent. Experimental results show that our model significantly outperforms mainstream baselines, achieving a nearly threefold reduction in APT. By successfully resolving the long-standing tension between speed and stability, our work establishes a new state-of-the-art for intelligent interruption handling in SDS. To facilitate future research, SID-Bench and the associated code are available at: https://github.com/xkx-hub/SID-bench.

Figures & tables

Explore similar work

CardsList
  1. Still Between Us? Evaluating and Improving Voice Assistant Robustness to Third-Party Interruptions

    Apr 19, 2026Dongwook Lee, Eunwoo Song, Che Hyun Lee +2Spoken Dialogue SystemsAudio Understanding

  2. Phoenix-VAD: Streaming Semantic Endpoint Detection for Full-Duplex Speech Interaction

    Sep 24, 2025Weijie Wu, Wenhao Guan, Kaidi Wang +6Full-Duplex Spoken Dialogue Systems

  3. Endpoint Anticipation for Low-Latency Spoken Dialogue

    Jun 11, 2026Sathvik Udupa, Shinji Watanabe, Petr Schwarz +1Spoken Dialogue Systems