cs.SDOct 12, 2026

LLM-HB: Language-Aware LLM-Guided Hotword Biasing for Code-Switching ASR

Authors: Yuxuan He, Genshun Wan, Pengcheng Li, Gongping Huang, Jianqing Gao, Yanmin Qian

Organizations: Auditory Cognition and Computational Acoustics Lab, Shanghai Jiao Tong University, Shanghai, China · AI research Institute, iFLYTEK Company Limited, Hefei, Anhui, China · School of Electronic Information, Wuhan University, Wuhan, Hubei, China

Abstract

Code-switching (CS) speech, characterized by language alternation within a single utterance, is prevalent in multilingual communities and poses challenges to automatic speech recognition (ASR) due to rapid language transitions. We propose LLM-HB, a language-aware large language model-guided hotword biasing framework for code-switching ASR (CS-ASR). The framework incorporates a mixture-of-experts (MoE) adaptor and an auxiliary language prediction head to better capture and differentiate multilingual representations, while hotwords are injected through LLM-based prompting. Experiments on the ASRU2019 code-switching challenge test set demonstrate that LLM-HB achieves a 20.30% relative reduction in mixed error rate (MER) over the baseline, reaching 5.85% MER under a 15-distractor hotword setting. To the best of our knowledge, this is the first work to integrate LLM-guided biasing into code-switching ASR. We further release the extracted ASRU2019 hotword list to support future research.

Figures & tables

Explore similar work

CardsList
  1. Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR

    Jun 20, 2026Enes Yavuz Ugan, Alexander WaibelCode-Switching Speech RecognitionCode-Switching

  2. Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognition

    Jun 5, 2026Tung X. Nguyen, Hieu Minh Truong, Giang Son Nguyen +3Code-Switching Speech RecognitionContrastive Learning

  3. Improving Code-Switching ASR with Code-Mixing Guided Synthetic Speech

    Jun 14, 2026Yue Heng Yeo, Haoyang Li, Yizhou Peng +6Code-Switching Speech RecognitionSynthetic Data Augmentation