cs.SDNov 6, 2026

Real-Time Short-Response Selection for Spoken Dialogue Systems

Authors: Hien Ohnaka, Kazuyo Onishi, Koichiro Yoshino

Organizations: Graduate School of Engineering Science, The University of Osaka, 1-3 Machikaneyama-cho, Toyonaka, Osaka, 560-8531, Japan · Nara Institute of Science and Technology, 8916-5 Takayama-cho, Ikoma, Nara, 630-0101, Japan

Abstract

To realize spoken dialogue systems that can interact naturally with users, it is important for the system to respond to user utterances at appropriate timings. To achieve such natural turn-taking, the system needs not only to predict appropriate response timings but also to mask delays caused by language generation and speech synthesis so that they are not perceived by the user. We propose a real-time short-response selection task that can be integrated with existing turn-taking models to mask generation delay. To address this task, the proposed model learns the mapping between dialogue context and short responses using contrastive learning. When a turn-taking event is detected, the system selects a response from a set of pre-generated candidates. The selected response is played while the main response is being generated. Experimental results show that the proposed method learns to select short responses based on dialogue context, outperforming random and LLM-based baselines. Moreover, integrating response selection maintained turn-taking prediction performance and added minimal processing overhead.

Figures & tables

Explore similar work

CardsList
  1. Low-Latency Turn-Taking via Context-Aware Preface Generation in a Real-World Dialogue Robot

    Jul 25, 2026Yuki Okafuji, Koji Inoue, Yoshiki OhiraSpoken Dialogue SystemsTask-Oriented Dialogue Systems

  2. Discourse-Aware Dual-Track Streaming Response for Low-Latency Spoken Dialogue Systems

    Feb 26, 2026Siyuan Liu, Jiahui Xu, Feng Jiang +6Spoken Dialogue SystemsFull-Duplex Spoken Dialogue Systems

  3. RelayS2S: A Dual-Path Speculative Generation for Real-Time Dialogue

    Mar 24, 2026Long Mai, Junli LiangSpoken Dialogue SystemsSpeculative Decoding