Code-Switching Speech Recognition

Overview

Code-switching speech recognition studies how automatic speech recognizers handle utterances that mix languages, dialects, and specialized vocabulary, where a system may omit or normalize words from one language. Common approaches adapt multilingual pretrained models with parameter-efficient fine-tuning, synthetic mixed-language speech, pseudo-labeling, preference or reinforcement learning, and language-aware decoding or hotword biasing. Evaluation uses bilingual datasets and measures such as word or mixed error rate, alongside switch-localized errors, language-specific accuracy, and script fidelity. Systems are improving on supported language pairs, but transfer to unseen pairs remains limited, and a central challenge is improving switch recognition without sacrificing monolingual accuracy or relying on aggregate metrics that hide language-specific failures.

Latest papers

CardsList

26 papers7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

  1. Dynamic Block-Online Streaming ASR for Low-Resource Agglutinative Code-Switching Speech with Morphology-Aware Evaluation

    Nov 11, 2026Kazi Rafat, Afifa Imran, Md. Ismail Hossain +5Code-Switching Speech RecognitionStreaming ASR

  2. Walrus Technical Report

    Nov 10, 2026Alkis Koudounas, Osamu Take, Hayato Futami +2Speech Foundation ModelsAudio-Language Models

  3. Beyond Aggregate WER: In-domain Adaptation, Learner Speech, Code-Switching, and Speaker Attribution in Online Spanish Learning Classrooms

    Oct 27, 2026Olga Kellert, Samhitha Harish, Johnatan E Bonilla +3ASR EvaluationDomain Adaptation for ASR

  4. SyRA-CS: Synthetic-to-Real Adaptation for Code-Switched ASR with Meta-Learning

    Oct 22, 2026Fadel Thior, Ahmer Tabassum, Haania Siddiqui +2Code-Switching Speech RecognitionSynthetic-to-Real Domain Adaptation

  5. LLM-HB: Language-Aware LLM-Guided Hotword Biasing for Code-Switching ASR

    Oct 12, 2026Yuxuan He, Genshun Wan, Pengcheng Li +3Code-Switching Speech RecognitionMultilingual ASR

  6. Phonological Interference in Multilingual Speech Models

    Oct 8, 2026Moran Yanuka, Raja Giryes, Morris AlperMultilingual ASRAutomatic Speech Recognition

  7. CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settings

    Sep 28, 2026Shama Gupta, Hoang H Nguyen, Chelsea Huang +2Code-Switching Speech RecognitionASR Evaluation

  8. Beyond Word Error Rate: A Switch Aware Evaluation of ASR and Audio Language Models on English Yoruba Code-Switched Speech

    Sep 10, 2026Chibuzor Okocha, Christan Earl GrantAudio-Language Model EvaluationCode-Switching Speech Recognition

  9. Evaluation of forced alignment of code-mixed speech: the case of Hindi-English

    Jul 28, 2026Ayushi Pandey, Pamir Gogoi, Kevin TangCode-Switching Speech RecognitionCode-Switching

  10. Reinforcement Learning for Data-Efficient Code-Switched ASR

    Jul 2, 2026Ziwei Ye, Peter VickersCode-Switching Speech RecognitionAudio-Language Models

  11. Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR

    Jun 20, 2026Enes Yavuz Ugan, Alexander WaibelCode-Switching Speech RecognitionCode-Switching

  12. Improving Code-Switching ASR with Code-Mixing Guided Synthetic Speech

    Jun 14, 2026Yue Heng Yeo, Haoyang Li, Yizhou Peng +6Code-Switching Speech RecognitionSynthetic Data Augmentation

  13. Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognition

    Jun 5, 2026Tung X. Nguyen, Hieu Minh Truong, Giang Son Nguyen +3Code-Switching Speech RecognitionContrastive Learning

  14. Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs

    Jun 4, 2026Gio Paik, Hyunseo Shin, Soungmin LeeCode-Switching Speech RecognitionDomain Generalization

  15. Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMs

    May 13, 2026Trung Nguyen Quang, Cheng Yi Lewis Won, Minh Duc Pham +3Code-Switching Speech RecognitionAudio-Language Models

  16. MUSCAT: MUltilingual, SCientific ConversATion Benchmark

    Apr 17, 2026Supriti Sinhamahapatra, Thai-Binh Nguyen, Yiğit Oğuz +3Code-Switching Speech RecognitionASR Evaluation

  17. ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmark

    Feb 13, 2026Tung X. Nguyen, Nhu Vo, Giang-Son Nguyen +6Code-Switching Speech RecognitionMedical Speech Recognition