Multilingual ASR

ASR: Automatic Speech Recognition

Follow this topic Ask about this topic

Momentum

16 papers in the last four weeks, against 1 the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 77

All topics

HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR
Oct 6, 2026Takanori Ashihara, Kohei Matsuura, Masato MimuraAutomatic Speech Recognition Speech Language Models
NTT, Inc., Japan
Benchmarking Automatic Speech Recognition Tools for Iberian Languages
Sep 29, 2026Fernando López, Pablo Gómez, David Solans +2ASR Evaluation Automatic Speech Recognition
Telefónica Innovación Digital, Spain · Universidad Autónoma de Madrid, Spain
CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settings
Sep 28, 2026Shama Gupta, Hoang H Nguyen, Chelsea Huang +2Code-Switching Speech Recognition ASR Evaluation
ServiceNow AI Research · Qualcomm Technologies, Inc.
Almieyar: A Culturally Grounded Benchmark for Multi-Dialect Arabic Speech Recognition
Sep 28, 2026Omid Ghahroodi, Anas Madkoor, Dima Faris Al Saudi +37ASR Evaluation Arabic NLP
QCRI, HBKU · Qatar University · UDST +15
Adaptive Fisher-Whitened Cross-Covariance for Low-Resource Speech Recognition
Sep 24, 2026Asmee Mishra, Mengjie Qian, Brechtje Post +1Speech Foundation Models Low-Resource Speech Recognition
Department of Engineering, University of Cambridge, United Kingdom · Phonetics Laboratory, University of Cambridge, United Kingdom
Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages
Sep 24, 2026Stephen E. Moore, Akwasi Asare, Mich-Seth Owusu +3ASR Evaluation Domain Adaptation for ASR
Department of Mathematics, University of Cape Coast, Ghana · Ghana Natural Language Processing, Cape Coast, Ghana
BranchShine-CR: Compact Multilingual IPA Transcription with Self-Conditioned CTC and Consistency Regularization
Sep 24, 2026Nikhil Navas, Sergio Chevtchenko, Talisson Damiao +1Speech Processing Low-Resource Speech Recognition
International Centre for Neuromorphic Systems, Western Sydney University · Neurabuild
The Second MLC-SLM Challenge: Multilingual Conversational Speech Diarization, Recognition, and Understanding
Sep 23, 2026Bingshen Mu, Mingchen Shao, Zhennan Lin +7Spoken Language Understanding Multilingual Language Model Evaluation
School of Intelligence Science and Technology, Nanjing University · College of Computing and Data Science, Nanyang Technological University, Singapore · Huawei Technologies, China +1
Vimarsha: Faithful ASR Evaluation for Indian Languages with Demographic Diversity, In-the-Wild Audio and Spelling Variations
Sep 21, 2026Kaushal Santosh Bhogale, Srija Anand, Sadakopa Ramakrishnan Thothathiri +3ASR Evaluation Demographic Bias in ASR
Indian Institute of Technology, Madras, India · Sarvam AI, India
Federated Multilingual Speech-LLMs: Architecture and Aggregation Strategy Benchmarking
Sep 20, 2026Jordi Luque, Aleix Sant, Fernando LópezSpeech Language Models Federated Learning
Telefónica Innovación Digital, Scientific Research
HearInContext: A Benchmark for Implicit Context in Speech Recognition
Sep 16, 2026Yifan Gao, Yao Tian, Hongbin SuoASR Evaluation Automatic Speech Recognition
AI Center, OPPO, Beijing, China
Sequential Adapter Stacking for Cross-Lingual Low-Resource ASR
Sep 14, 2026Thai Thi Thanh Thao Dang, Mengjie Qian, Kate KnillLow-Resource Speech Recognition Parameter-Efficient Fine-Tuning
Department of Engineering, University of Cambridge, UK
Whisper-Based Speech Transcription from Videos Across Multiple Languages for Cross-Cultural Understanding
Sep 11, 2026Michael PichenyDomain Adaptation for ASR Automatic Speech Recognition
NYU Courant Institute School of Mathematics, Computing, and Data Science NYU New York, USA
Orukeet: Multilingual ASR with Frozen Gabor Kernels
Sep 9, 2026Nathan Roll, Irene Yi, Büşra Marşan +6Automatic Speech Recognition Multilingual ASR
Oruk AI · Stanford University · OpenWhispr +2
Source-Adaptive Data Curation for Bilingual NVV-Aware ASR
Sep 9, 2026Yuang Cao, Qirui Zhan, Jingbin Hu +7Speech Processing Audio Understanding
Shenzhen Pimei Technology, China · Yutuzhineng, China · Nanjing University, China
BuzzASR: A Swarm of 100+ Monolingual Speech Recognition Models
Sep 9, 2026Shivam Singh, Aditya Yadavalli, Catherine Arnett +1Speech Foundation Models Automatic Speech Recognition
UC San Diego · EleutherAI
Qwen-Audio-3.0-ASR Technical Report
Sep 7, 2026Chuanmeng Bian, Daren Chen, Peixin Chen +42Streaming ASR Automatic Speech Recognition
Phoneme-guided TTS augmentation for ASR: A unified pipeline and multilingual evaluation
Aug 27, 2026Zhen Wang, TianRui Wu, RongQi Han +3Synthetic Data Augmentation TTS Synthesis
Shanghai Qi Zhi Institute, Shanghai, China · Megatronix (Beijing) Technology Co., Ltd. · Tsinghua University, Beijing, China
Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASR
Aug 4, 2026Yuan Xie, Jiaqi Song, Xianliang Wang +3Multilingual Language Models Multi-Teacher Knowledge Distillation
Advanced Intelligent Systems Group, NIO, Beijing, China
Latent Softmax for Data-Efficient Phoneme-Based Multilingual ASR Across Tonal and Non-Tonal Languages
Aug 2, 2026Saierdaer Yusuyin, Nanling Jiang, Hao Huang +1Automatic Speech Recognition Multilingual ASR
School of Computer Science and Technology, Xinjiang University, China · Department of Electronic Engineering and Information Science, University of Science and Technology of China, China · Speech Processing and Machine Intelligence (SPMI) Lab, Tsinghua University, China +1
MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognition
Jul 27, 2026Sangmin Lee, Woojin Chung, Woongjib Choi +1Multilingual ASR
Dept. of Electronics and Electrical Engineering, Yonsei University, Seoul, South Korea
Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages
Jul 26, 2026Deovrat Mehendale, Aditya Mehndiratta, Dhruv Rathi +2ASR Evaluation Speech Processing
Sarvam AI, India · AI4Bharat, IIT Madras, India
MEUSLI: a Multilingual Projector for LLM-based ASR and Beyond
Jul 24, 2026Lorenzo Concina, Seraphina Fong, Marco Matassoni +1Speech Language Models Low-Resource Speech Recognition
Center for Augmented Intelligence, Fondazione Bruno Kessler, Trento, Italy · Department of Information Engineering and Computer Science, University of Trento, Italy
DONDO: Open w2v-BERT Speech-Recognition Base Models for African Languages
Jul 23, 2026Paul Azunre, Naafi Ibrahim, Joel Budu +1Speech Foundation Models Automatic Speech Recognition
Khaya AI
Transcription Policy as a Latent Variable: Activating Controllable Verbatim ASR with Word-Level Timing
Jul 21, 2026Laurin Wagner, Mario Zusag, Bernhard ThallingerSpeech Processing Automatic Speech Recognition
nyra labs · nyra labs, Austria
From a Multilingual Streaming ASR Backbone to Kenyan-Language Systems: Data-Centric Adaptation of Nemotron 3.5 for Kikuyu, Dholuo, and Kalenjin
Jul 21, 2026Mark GatereFine-Tuning Streaming ASR
C-elo Labs
Audio-Native Speech Recognition with a Frozen Discrete-Diffusion Language Model
Jul 14, 2026Harsha Vardhan Khurdula, Abhinav Kumar Singh, Yoeven D Khemlani +1Automatic Speech Recognition Diffusion Language Models
Interfaze AI · San Francisco, CA, USA
An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challenge
Jul 14, 2026Shuming Fang, Shuifei ZengASR Evaluation Automatic Speech Recognition
UGREEN AI Lab, Shenzhen, China · School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing, China
Unified Gradient Projection: Language-Balanced Continual Learning for Multilingual Low-Resource ASR
Jul 13, 2026Ziang Ren, Guodong Lin, Yuchen Ai +2Automatic Speech Recognition Gradient Projection
Department of Electronic Engineering, Tsinghua University, China
GigaAM Multilingual: Foundation Model for Underrepresented Languages
Jul 11, 2026Andrei Kuzmenko, Alexandr Maximenko, Aleksandr Kutsakov +5Speech Foundation Models Speech Processing
SaluteDevices, Russia

Oct 6, 2026, eess.ASJ/K move · Enter open · S save

HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR

Takanori Ashihara, Kohei Matsuura, Masato Mimura

NTT, Inc., Japan

Automatic Speech Recognition Speech Language Models Speaker Diarization Multilingual ASR

Open paper AskPDF arXiv

This paper presents the HINTT system submitted to the 2nd Challenge and Workshop on Multilingual Conversational Speech Language Model (MLC-SLM). We address multilingual speaker-attributed ASR, where systems must determine who spoke when and what was spoken. We investigate two modeling strategies for this problem: a cascaded pipeline that combines speaker diarization with speech-LLM-based ASR, and a unified speech LLM that directly generates speaker labels, timestamps, and transcriptions. Our final submission is based on the cascaded pipeline, consisting of a fine-tuned DiariZen diarization model, a fine-tuned Qwen3-ASR model, and LLM-based generative error correction. For comparison, we also fine-tune VibeVoice-ASR as a unified model using the same official training data. All task-specific fine-tuning and model selection are performed using only the official MLC-SLM data, without external data or pseudo-labels. Experimental results demonstrate that the cascaded system remains more reliable under the MLC-SLM Task 1 conditions, while unified speech LLMs offer a promising direction for future speaker-attributed ASR.

Momentum

Related topics

Latest papers 77