Multilingual Automatic Speech Recognition

Ask about this topic

Momentum

15 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 84

All topics
CardsList

  1. BabelFake: A Multilingual Audio-Visual DeepFake Benchmark

    Oct 5, 2026Carlotta Segna, Joel Tschesche, Anna RohrbachMultilingual BenchmarkMultilingual Automatic Speech Recognition

    TU Darmstadt & Hessian.AI, Germany

  2. Code-Switching Spoken Language Identification as Multi-Label Set Prediction

    Oct 1, 2026Shunsuke Mitsumori, Matthew Wiesner, Shigeo Morishima +1Code-SwitchingMultilingual Automatic Speech Recognition

    Waseda University, Tokyo, Japan · Johns Hopkins University, Baltimore, USA · Carnegie Mellon University, Pittsburgh, USA

  3. Benchmarking Automatic Speech Recognition Tools for Iberian Languages

    Sep 29, 2026Fernando López, Pablo Gómez, David Solans +2Automatic Speech Recognition EvaluationMultilingual Automatic Speech Recognition

    Telefónica Innovación Digital, Spain · Universidad Autónoma de Madrid, Spain

  4. CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASR

    Sep 28, 2026Bashar Talafha, Samar M. Magdy, Aisha Alansari +36DialectsMultilingual Automatic Speech Recognition

    The University of British Columbia · King Fahd University of Petroleum and Minerals · Al al-Bayt University +13

  5. Language Discrimination Improves Linguistic Learning in Multilingual Speech Models

    Sep 27, 2026Maureen de Seyssel, Jie Chi, Zakaria AldenehMultilingual Automatic Speech RecognitionCross-Lingual Consistency

    Apple

  6. Adaptive Fisher-Whitened Cross-Covariance for Low-Resource Speech Recognition

    Sep 24, 2026Asmee Mishra, Mengjie Qian, Brechtje Post +1Multilingual Automatic Speech RecognitionLow-Rank Structure

    Department of Engineering, University of Cambridge, United Kingdom · Phonetics Laboratory, University of Cambridge, United Kingdom

  7. YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speech

    Sep 24, 2026William Chen, Shinnosuke Takamichi, Sayaka Shiota +3Multilingual Automatic Speech RecognitionText Corpora

    Carnegie Mellon University, USA · Keio University, Japan · Tokyo Metropolitan University, Japan +1

  8. The Second MLC-SLM Challenge: Multilingual Conversational Speech Diarization, Recognition, and Understanding

    Sep 23, 2026Bingshen Mu, Mingchen Shao, Zhennan Lin +7Multilingual Automatic Speech RecognitionSpeaker Diarization

    School of Intelligence Science and Technology, Nanjing University · College of Computing and Data Science, Nanyang Technological University, Singapore · Huawei Technologies, China +1

  9. Isolated Sign Language Recognition for Icelandic Sign Language: Experiments in a Low-resource Setting

    Sep 22, 2026Finnur Ágúst Ingimundarson, Guðný Björk Þorvaldsdóttir, Mathias Müller +1Sign Language TranslationMultilingual Automatic Speech Recognition

    Department of Computational Linguistics, University of Zurich · Communication Centre for the Deaf and Hard of Hearing in Iceland

  10. Federated Multilingual Speech-LLMs: Architecture and Aggregation Strategy Benchmarking

    Sep 20, 2026Jordi Luque, Aleix Sant, Fernando LópezMultilingual Automatic Speech RecognitionSpeech Encoder

    Telefónica Innovación Digital, Scientific Research

  11. A Cross-Lingual Acoustic Disease-Alignment Framework for Respiratory Health Assessment from Spontaneous Speech

    Sep 16, 2026Roksana Khanom, Raghib Asfak Tasnim, Bodrun Nahar Bithi +4Respiratory Sound ClassificationMultilingual Automatic Speech Recognition

    University of Maryland, College Park, USA · Sylhet MAG Osmani Medical College Hospital, Bangladesh · Dr. M R Khan Shishu Hospital & Institute of Child Health, Bangladesh +1

  12. Language Orthogonalization for Zero-Shot Cross-Lingual Audio Deepfake Detection

    Sep 15, 2026Minu Kim, Ji Sub Um, Hoirin KimSelf-Supervised Speech ModelsMultilingual Automatic Speech Recognition

    University of Southern California, USA · KAIST, South Korea

  13. Sequential Adapter Stacking for Cross-Lingual Low-Resource ASR

    Sep 14, 2026Thai Thi Thanh Thao Dang, Mengjie Qian, Kate KnillMultilingual Automatic Speech RecognitionAutomatic Speech Recognition

    Department of Engineering, University of Cambridge, UK

  14. Tone on a Budget: A Reference-Free Metric for Lexical Tone in Massively Multilingual Text-to-Speech

    Sep 13, 2026Moses Daudu, Adeola Enitan Bamidele, Honor-Jesus BezaleelSeed-Tts-Eval BenchmarkCharacter Error Rate

    Landmark University, Omu-Aran, Nigeria · Federal University of Agriculture, Abeokuta, Nigeria · Independent Researcher

  15. SEAR: Segment-Evidence-Aware Routing for Weak-to-Strong Multilingual Speech MCQ

    Sep 11, 2026Huy Hoang Le, Long-Bao Nguyen, Minh Tri DaoMultilingual Automatic Speech RecognitionMultiple-Choice Questions

    CAKE by VPBank, Vietnam

  16. Orukeet: Multilingual ASR with Frozen Gabor Kernels

    Sep 9, 2026Nathan Roll, Irene Yi, Büşra Marşan +6Multilingual Automatic Speech RecognitionAutomatic Speech Recognition

    Oruk AI · Stanford University · OpenWhispr +2

  17. Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speech

    Sep 1, 2026Che Hyun Lee, Sangkwon Park, Donghun Kang +4Code-SwitchingMultilingual Automatic Speech Recognition

    Department of Electrical and Computer Engineering, Seoul National University · 2Interdisciplinary Program in Artificial Intelligence, Seoul National University · Department of Artificial Intelligence, University of Seoul +1

  18. DonorRank: Donor Language Selection for Low-Resource Cross-Lingual Speech Recognition

    Aug 11, 2026Akriti Dhasmana, Aarohi Srivastava, David ChiangMultilingual Automatic Speech RecognitionLow-Resource Languages

    Computer Science and Engineering University of Notre Dame Notre Dame, IN, USA

  19. Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASR

    Aug 4, 2026Yuan Xie, Jiaqi Song, Xianliang Wang +3Multilingual Automatic Speech RecognitionAware Heterogeneous Multi-Teacher Multimodal On-Policy Distillation

    Advanced Intelligent Systems Group, NIO, Beijing, China

  20. Latent Softmax for Data-Efficient Phoneme-Based Multilingual ASR Across Tonal and Non-Tonal Languages

    Aug 2, 2026Saierdaer Yusuyin, Nanling Jiang, Hao Huang +1Multilingual Automatic Speech RecognitionGrapheme-To-Phoneme

    School of Computer Science and Technology, Xinjiang University, China · Department of Electronic Engineering and Information Science, University of Science and Technology of China, China · Speech Processing and Machine Intelligence (SPMI) Lab, Tsinghua University, China +1

  21. A Cross-lingual Comparison of Human and Classification Model Entrainment Behavior in Code-switched Speech Settings

    Jul 28, 2026Debasmita Bhattacharya, Siying Ding, Alayna Nguyen +1Code-SwitchingMultilingual Automatic Speech Recognition

    Department of Computer Science, Columbia University · Instagram

  22. MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognition

    Jul 27, 2026Sangmin Lee, Woojin Chung, Woongjib Choi +1Multilingual Automatic Speech RecognitionMultilingual Language Models

    Dept. of Electronics and Electrical Engineering, Yonsei University, Seoul, South Korea

  23. Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages

    Jul 26, 2026Deovrat Mehendale, Aditya Mehndiratta, Dhruv Rathi +2Speaker DiarizationMultilingual Automatic Speech Recognition

    Sarvam AI, India · AI4Bharat, IIT Madras, India

  24. Synthetic Speech, Real Signal: Paralinguistic Preservation and Cross-Lingual Augmentation via Voice Cloning

    Jul 24, 2026Roseline Polle, Owen Parsons, George Fairs +5Cross-Lingual Voice CloningParalinguistic Cues

    thymia, UK · The University of Edinburgh, UK · University of Southampton, UK

  25. MEUSLI: a Multilingual Projector for LLM-based ASR and Beyond

    Jul 24, 2026Lorenzo Concina, Seraphina Fong, Marco Matassoni +1Multilingual Automatic Speech RecognitionSpeech Translation

    Center for Augmented Intelligence, Fondazione Bruno Kessler, Trento, Italy · Department of Information Engineering and Computer Science, University of Trento, Italy

  26. Unified Gradient Projection: Language-Balanced Continual Learning for Multilingual Low-Resource ASR

    Jul 13, 2026Ziang Ren, Guodong Lin, Yuchen Ai +2Multilingual Automatic Speech RecognitionWhisper-Large-V3

    Department of Electronic Engineering, Tsinghua University, China

  27. GigaAM Multilingual: Foundation Model for Underrepresented Languages

    Jul 11, 2026Andrei Kuzmenko, Alexandr Maximenko, Aleksandr Kutsakov +5Multilingual Automatic Speech RecognitionLow-Resource Languages

    SaluteDevices, Russia

  28. Which Languages Transfer Best to Warlpiri? A Similarity-Based Study for Low-Resource ASR

    Jul 11, 2026Pravina Mylvaganam, Eliathamby Ambikairajah, Ting Dang +2Multilingual Automatic Speech RecognitionCross-Lingual Transfer

    University of New South Wales, Australia · University of Melbourne, Australia · University of Sydney, Australia

  29. Diarization-Guided Qwen-ASR Adaptation for Multilingual Two-Speaker Conversational Speech

    Jul 9, 2026Hao Wu, RongQi Han, Zhen Wang +2Multilingual Automatic Speech RecognitionSpeaker Diarization

    Shanghai Qi Zhi Institute, Shanghai, China · Megatronix (Beijing) Technology Co., Ltd

  30. From Sinhala to Dhivehi: Cross-Lingual Transfer Learning for Low-Resource Speech Recognition

    Jul 7, 2026Lukmal Ilyas, Nevidu JayatillekeMultilingual Automatic Speech RecognitionCross-Lingual Transfer

    School of Computing, Informatics Institute of Technology, Sri Lanka · Department of Computer Science & Engineering, University of Moratuwa, Sri Lanka

  31. Token Merging for Multilingual Speech Recognition: A Systematic Study Across Model Scale and Fine-Tuning

    Jul 7, 2026Dylan Luke HolyoakMultilingual Automatic Speech RecognitionLow-Resource Languages

    Geffen Academy at UCLA

  32. Progressive Refinement: An Iterative Pseudo-Labeling Approach for Mandarin-English Code-Switching ASR

    Jul 6, 2026Qu Yang, Cakra Wardhana, Tim NgCode-SwitchingMultilingual Automatic Speech Recognition

    Apple, Singapore · National University of Singapore, Singapore

  33. Evaluating the Effect of Linguistic Relatedness on Cross-Lingual Transfer in Large Multilingual Automatic Speech Recognition

    Jul 6, 2026Andrei Florian, Cynthia Jayne Amol, Hope Kerubo Ombaba +6Cross-Lingual TransferMultilingual Automatic Speech Recognition

    Princeton University · Maseno University

  34. Jointly Improving Dialect Identification and ASR in Indian Languages using Multimodal Feature Fusion

    Jul 3, 2026Saurabh Kumar, Amartyaveer, Prasanta Kumar GhoshMultilingual Automatic Speech RecognitionAutomatic Speech Recognition

    Department of Electrical Engineering, Indian Institute of Science, Bangalore, India

  35. Towards a Phonology-Informed Evaluation of Multilingual TTS

    Jul 2, 2026Sneha Ray Barman, Neeraj Kumar Sharma, Shakuntala MahantaGrapheme-To-PhonemeMultilingual Automatic Speech Recognition

    Centre for Linguistic Science & Technology, IIT Guwahati · Mehta Family School for Data Science & Artificial Intelligence, IIT Guwahati · Department of Humanities & Social Sciences, IIT Guwahati

  36. From Monolingual to Multilingual: Evaluating Mamba for ASR in South African Languages

    Jul 1, 2026Jesujoba O. Alabi, Julian Herreilers, Badr M. Abdullah +1Multilingual Automatic Speech RecognitionAutomatic Speech Recognition

    Saarland University, Germany · Saigen, South Africa

  37. Disentangling Speaker and Language Effects in Cross-Lingual Speaker Verification for Iberian Languages

    Jul 1, 2026Pol Buitrago, Javier HernandoAutomatic Speaker VerificationCross-Lingual Consistency

    1Barcelona Supercomputing Center (BSC), Spain · 2Universitat Polit`ecnica de Catalunya (UPC), Spain

  38. AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification

    Jun 28, 2026Chuxiao Zuo, Yao Zhu, Minqiang Xu +3Multilingual Automatic Speech RecognitionSpeaker

    Honor Device Co., Ltd Nanjing, China · Honor Device Co., Ltd Shanghai, China

  39. Do Speech Emphasis Models Generalize across Languages and Emotions?

    Jun 26, 2026Megan Wei, Deepali Aneja, Jiaqi Su +3Multilingual Automatic Speech RecognitionEmotion Recognition

    Adobe Research, USA · Brown University, USA

  40. SamaVaani: Auditing and Debiasing Multilingual Clinical ASR for Indian Languages

    Jun 25, 2026Subham Kumar, Prakrithi Shivaprakash, Abhishek Manoharan +7Multilingual Automatic Speech RecognitionAutomatic Speech Recognition

    IIT, Kharagpur · NIMHANS, Bangalore · LGBRIMH, Tezpur

  41. Dziri Voicebot: An End-to-End Low-Resource Speech-to-Speech Conversational System for Algerian Dialect

    Jun 24, 2026Dihia Lanasri, Rebeh Imane Ammar Aouchiche, Abdelkarim Remmide +2Multilingual Automatic Speech RecognitionAutomatic Speech Recognition

    ATM Mobilis · Saad Dahlab Blida 1 University

  42. CrossAccent-TTS: Cross-Lingual Accent-Intensity Controllable Text-to-Speech via Disentangled Speaker and Accent Representations

    Jun 24, 2026Ram Annamdevula, Ankit Tatawat, Ashishkumar P. Gudmalwar +2Multilingual Automatic Speech RecognitionAccents

    Media Analysis, Sony Research India

  43. Cross-lingual Retrieval-Augmented Classification for Dysarthria Severity Assessment

    Jun 22, 2026Taeyoung Jeong, Insung Lee, Du-Seong Chang +1Dysarthric SpeechMultilingual Automatic Speech Recognition

    Department of Artificial Intelligence, Sogang University, South Korea

  44. Neural Speaker Diarization via Multilingual Training: Evaluation on Low-Resource Nepali-Hindi Speech

    Jun 21, 2026Samip Neupane, Sandesh Pokhrel, Sandesh Pyakurel +1Speaker DiarizationMultilingual Automatic Speech Recognition

    Department of Electronics and Computer Engineering, Pulchowk Campus, Institute of Engineering, Lalitpur, Nepal

  45. From Speech to Text Corpora: Evaluating ASR-Based Data Acquisition for Low-Resource Fongbe and Hausa

    Jun 20, 2026Mahounan Pericles Adjovi, Victor Olufemi, Roald Eiselen +1Multilingual Automatic Speech RecognitionTranscript

    Carnegie Mellon University Africa, Kigali, Rwanda · North-West University, South Africa

  46. Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR

    Jun 20, 2026Enes Yavuz Ugan, Alexander WaibelCode-SwitchingMultilingual Automatic Speech Recognition

    Interactive Systems Lab, Karlsruhe Institute of Technology (KIT), Germany · InterACT, Carnegie Mellon University (CMU), USA

  47. OpenWER: Improving Cross-Lingual ASR Evaluation and Enabling Token-Based Accuracy Metrics

    Jun 19, 2026Korbinian Kuhn, Gottfried ZimmermannAutomatic Speech Recognition EvaluationCharacter Error Rate

    Stuttgart Media University, Germany · University of Tübingen, Germany

  48. Improving low-resource ASR using bilingual fine-tuning with language identification: a cross-linguistic evaluation

    Jun 16, 2026Reihaneh Amooie, Yun Hao, Wietse de Vries +3Multilingual Automatic Speech RecognitionLow-Resource Languages

    University of Groningen · Fryske Akademy · Vrije Universiteit Brussel

  49. L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verification

    Jun 16, 2026Hyung-Seok Oh, Deok-Hyeon Cho, Seung-Bin Kim +1Automatic Speaker VerificationMultilingual Automatic Speech Recognition

    Department of Artificial Intelligence, Korea University, Seoul, Korea

  50. Are you speaking my languages? On spoken language adherence in multimodal LLMs

    Jun 15, 2026Hyungwon Kim, Kandarp Joshi, Lillian Zhou +2Multilingual Automatic Speech RecognitionAutomatic Speech Recognition

    Google DeepMind

  51. UR-BERT: Scaling Text Encoders for Massively Multilingual TTS Through Universal Romanization and Speech Token Prediction

    Jun 10, 2026Sangmin Lee, Eekgyun Ahn, Woongjib Choi +1Multilingual Automatic Speech RecognitionSpeech Encoder

    Dept. of Electrical and Electronic Engineering, Yonsei University, Seoul, South Korea

  52. CS-YODAS: A Mined Dataset of In-the-Wild Code-Switched Speech

    Jun 9, 2026Brian Yan, Qingzheng Wang, Matthew Wiesner +9Code-SwitchingMultilingual Automatic Speech Recognition

    Carnegie Mellon University · Johns Hopkins University · University of Texas at Austin +4

  53. Multilingual Word-Level Forced Alignment with Self-Supervised Representations and Learned Dynamic Programming

    Jun 9, 2026Roy Weber, Meidan Zehavi, Rotem Rousso +1Motion-Language AlignmentMultilingual Automatic Speech Recognition

    Faculty of Electrical and Computer Engineering, Technion – Israel Institute of Technology, Haifa, 3200003, Israel

  54. OpenBibleTTS: Large-Scale Speech Resources and TTS Models for Low-Resource Languages

    Jun 8, 2026David Guzmán, Luel Hagos Beyene, Jesujoba Oluwadara Alabi +3Multilingual Automatic Speech RecognitionFlow-Matching Text-To-Speech

    McGill University · Mila - Quebec AI Institute · AIMS Research and Innovation Centre +3

  55. Overcoming Decoder Inconsistencies in Whisper for Dravidian and Low-Resource Languages

    Jun 8, 2026Chowdam Venkata Kumar, Kumud Tripathi, Pankaj WasnikMultilingual Automatic Speech RecognitionLow-Resource Languages

    Media Analysis Group, Sony Research India

  56. KIT's Submission to Cross-Lingual Voice Cloning in IWSLT 2026

    Jun 5, 2026Seymanur Akti, Alexander WaibelCross-Lingual Voice CloningMultilingual Automatic Speech Recognition

    Karlsruhe Institute of Technology (KIT) · KIT Campus Transfer (KCT) · Carnegie Mellon University (CMU)

  57. Multilingual Multi-Speaker Unit Vocoders: A Systematic Analysis of Discrete Speech Representations

    Jun 4, 2026Naman Kothari, Arjun Gangwar, Adarsh Arigala +1Discrete Speech RepresentationsMultilingual Automatic Speech Recognition

    National Institute of Technology, Trichy · Indian Institute of Technology, Madras

  58. Multi-task Learning is Not Enough: Representational Entanglement in Dual-output Second Language Speech Recognition

    Jun 4, 2026Seung Hwan Cho, Young-Min KimMultilingual Automatic Speech RecognitionDual-Encoder Architectures

    Department of Industrial Data Engineering, Hanyang University, Seoul, South Korea · School of Interdisciplinary Industrial Studies, Hanyang University, Seoul, South Korea

  59. Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs

    Jun 4, 2026Gio Paik, Hyunseo Shin, Soungmin LeeMultilingual Automatic Speech RecognitionAutomatic Speech Recognition

    Theta One Korea, Seoul, Republic of Korea · Kitsch Labs, Seongnam, Republic of Korea · Department of Artificial Intelligence, University of Seoul, Seoul, Republic of Korea +1

  60. PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects

    May 31, 2026Sicheng Yang, Shulan Ruan, Shiwei Wu +4Multilingual Automatic Speech RecognitionDialects

    Shenzhen International Graduate School, Tsinghua University Shenzhen, China · Department of Electronic Engineering, Tsinghua University Beijing, China · JD AI Research Beijing, China