Multilingual ASR

ASR: Automatic Speech Recognition

Overview

Multilingual ASR studies how to turn speech into text reliably across languages, dialects, accents, and mixed-language conversations, including languages with little training data. Systems range from CTC and transducer models to encoder-decoder recognizers such as Whisper and speech-language models connected through lightweight projectors; researchers adapt them with fine-tuning, language-specific adapters, distillation, and synthetic speech. Work increasingly tests real-world conditions such as spontaneous speech, medical terminology, speaker overlap, and code-switching, while benchmarks examine low-resource languages and regional variation. A central challenge is balancing shared cross-language knowledge with language-specific needs, while improving evaluation beyond WER to account for scripts, spelling variation, meaning, and demographic disparities.

Latest papers

CardsList

109 papers13 papers in the last four weeks, down 28% on the four weeks before. 0.1% of all new papers.

  1. Enhancing ASR Performance in the Medical Domain for Dravidian Languages

    Apr 10, 2026Sri Charan Devarakonda, Ravi Sastry Kolluru, Manjula Sri Rayudu +3Medical Speech RecognitionAutomatic Speech Recognition

  2. Advancing LLM-based phoneme-to-grapheme for multilingual speech recognition

    Mar 31, 2026Lukuan Dong, Ziwei Li, Saierdaer Yusuyin +2Multilingual ASRSpeech Language Models

  3. An Empirical Recipe for Universal Phone Recognition

    Mar 30, 2026Shikhar Bharadwaj, Chin-Jou Li, Kwanghee Choi +4Automatic Speech RecognitionMultilingual ASR

  4. KoALa-Bench: Evaluating Large Audio Language Models on Korean Speech Understanding and Faithfulness

    Mar 30, 2026Jinyoung Kim, Hyeongsoo Lim, Eunseo Seo +4Audio-Language Model EvaluationSpeech Processing

  5. Ethio-ASR: Joint Multilingual Speech Recognition and Language Identification for Ethiopian Languages

    Mar 24, 2026Badr M. Abdullah, Israel Abebe Azime, Atnafu Lambebo Tonja +14Speech ProcessingMultilingual ASR

  6. LoASR-Bench: Evaluating Large Speech Language Models on Low-Resource Automatic Speech Recognition Across Language Families

    Mar 20, 2026Jianan Chen, Xiaoxue Gao, Tatsuya Kawahara +1ASR EvaluationLow-Resource Speech Recognition

  7. Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognition

    Mar 18, 2026Yuxiang Mei, Delai Qiu, Shengping Liu +2Multilingual ASRSpeech Language Models

  8. Speak in Context: Multilingual ASR with Speech Context Alignment via Contrastive Learning

    Mar 6, 2026Yuchen Zhang, Haralambos Mouratidis, Ravi ShekharContextual ASRAutomatic Speech Recognition

  9. Towards Orthographically-Informed Evaluation of Speech Recognition Systems for Indian Languages

    Mar 1, 2026Kaushal Santosh Bhogale, Tahir Javed, Greeshma Susan John +4ASR EvaluationAutomatic Speech Recognition

  10. ViMedCSS: A Vietnamese Medical Code-Switching Speech Dataset & Benchmark

    Feb 13, 2026Tung X. Nguyen, Nhu Vo, Giang-Son Nguyen +6Code-Switching Speech RecognitionMedical Speech Recognition

  11. PRiSM: Benchmarking Phone Realization in Speech Models

    Jan 20, 2026Shikhar Bharadwaj, Chin-Jou Li, Yoonjae Kim +13Automatic Speech RecognitionSpeech Language Models

  12. M-CIF: Multi-Scale Alignment For CIF-Based Non-Autoregressive ASR

    Oct 25, 2025Ruixiang Mao, Xiangnan Ma, Qing Yang +7Automatic Speech RecognitionMultilingual ASR