cs.AISep 22, 2026

Training Intelligent Voice Assistant Wakeup with Controllable Synthetic Conversations

Authors: Marcin Sowański, Kacper Leszczyński, Kacper Krzywicki, Krzysztof Wodnicki

Organizations: TCL Research Europe · University of Warsaw

Abstract

Wake word detection is a critical component of virtual assistants, serving as the gateway to seamless user interactions. This paper introduces a novel wake-up system that extends traditional direct keyword detection with contextual trigger detection. After an initial wake word activation, the system uses reasoning to distinguish between user commands and unrelated speech, ensuring efficient and context-aware engagement. We present a data generation architecture that produces a 62.3-hour corpus of controllable multi-speaker conversations containing direct invocations, contextual follow-ups, and non-addressed speech. Experimental results demonstrate the effectiveness of the proposed approach across diverse synthetic conversational scenarios. We release the code, dataset and trained models to promote reproducibility and further advancements in intelligent assistant technologies.

Figures & tables

Explore similar work

CardsList
  1. Not All Speech Is Intent: Adaptive Self-Correcting Inference Layer for Post-ASR False Wake-Up

    Sep 11, 2026Preeti Saraswat, Divya Neelagiri, Anil YadavAdaptive InferenceOnline Learning

  2. Enroll-on-Wakeup: A First Comparative Study of Target Speech Extraction for Seamless Interaction in Real Noisy Human-Machine Dialogue Scenarios

    Feb 17, 2026Yiming Yang, Guangyong Wang, Haixin Guan +1Target Speaker Extraction

  3. Speak or Stay Silent: Context-Aware Turn-Taking in Multi-Party Dialogue

    Mar 12, 2026Kratika Bhagtani, Mrinal Anand, Yu Chen Xu +1Turn-Taking in DialogueTurn-Taking Prediction