Automatic Speech Recognition

Also known as ASR

Follow this topic Ask about this topic

Momentum

54 papers in the last four weeks, up 238% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 302

All topics

Entropy-Aware Domain-Routed Mixture-of-Experts Speech-LLM Framework: A Case Study of Multi-Domain Child-Adult ASR
Jun 9, 2026Mohan Shi, Kaiyuan Zhang, Zilai Wang +3Mixture-of-Experts Language Models Automatic Speech Recognition
University of California, Los Angeles, USA
Speech Meets ELF: Audio Conditional Continuous-Target Diffusion for Speech Recognition and Translation
Jun 9, 2026Xuanchen Li, Tianrui Wang, Yuheng Lu +11Speech Translation Automatic Speech Recognition
1Tianjin University · 2Shanghai Jiao Tong University · 3Zhipu AI
ViP-VL: Vietnamese Self-supervised Speech Pretraining Model with Vector-Quantization Learning
Jun 9, 2026Khanh Le, Kiet Anh Hoang, Bao Nguyen +5Audio Representation Learning Speech Processing
VinUniversity, Vietnam · UNEY, Switzerland
LLM can Read Spectrogram: Encoder-free Speech-Language Modeling
Jun 8, 2026Ruchao Fan, Yiming Wang, Yuxuan Hu +6Spoken Language Understanding Audio Understanding
Microsoft, USA
Is Text All You Need? Text as a Universal Information Bottleneck for Speech LLMs
Jun 8, 2026Ming-Hao Hsu, Yuxuan Hu, Shujie Liu +3Audio Representation Learning Audio Understanding
School of Data Science, The Chinese University of Hong Kong, Shenzhen, China. · Microsoft Research, Redmond, WA, USA. · Microsoft Research Asia, Hong Kong, China.
TRADE: Transducer-Augmented Decoder for Speech LLM
Jun 7, 2026Yun Tang, Shanil Puri, Shinji Watanabe +1Streaming ASR Speech Processing
Hippocratic AI · Carnegie Mellon University
Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders
Jun 5, 2026Georgii Aparin, Vadim Popov, Tasnima Sadekova +1Audio-Language Model Hallucination Detection Sparse Autoencoders
AI Foundation and Algorithm Lab · National Research University Higher School of Economics
Assessing True Generalisability of Audio-Visual Speech Recognisers
Jun 5, 2026Zhaofeng Lin, Stavros Petridis, Maja Pantic +1Automatic Speech Recognition Audio-Visual Speech Recognition
Trinity College Dublin, Ireland · Imperial College London, UK
Phonetic Error Analysis of Raw Waveform Acoustic Models
Jun 5, 2026Erfan Loweimi, Zhengjun Yue, Andrea Carmantini +3ASR Evaluation Speech Processing
Centre for Speech Technology Research (CSTR), University of Edinburgh, UK · SLAI & CUHK-SZ, China · King’s College London, UK
Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognition
Jun 5, 2026Tung X. Nguyen, Hieu Minh Truong, Giang Son Nguyen +3Code-Switching Speech Recognition Contrastive Learning
VinUniversity, Vietnam · University of Technology Sydney, Australia · Monash University, Australia
Hearing the Unspoken: Language Model Priors for Acoustic Adversarial Attacks
Jun 5, 2026Jiani Xie, Andrew C. Cullen, Paul Montague +1Streaming ASR Automatic Speech Recognition
University of Melbourne · DST Group
Leveraging Soft Distributions of SSL-Derived Discrete Speech Tokens for Downstream Inference
Jun 5, 2026Kentaro Onda, Satoru Fukayama, Daisuke Saito +1Automatic Speech Recognition Audio Tokenization
The University of Tokyo, Japan · National Institute of Advanced Industrial Science and Technology (AIST), Japan
FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognition
Jun 4, 2026Fernando López, Santosh Kesiraju, Jordi LuqueAutomatic Speech Recognition Speech Language Models
Scientific Research, Telefónica Innovación Digital, Spain · AUDIAS, Universidad Autónoma de Madrid, Spain
Multi-task Learning is Not Enough: Representational Entanglement in Dual-output Second Language Speech Recognition
Jun 4, 2026Seung Hwan Cho, Young-Min KimDisentangled Representation Learning Multi-Task Learning
Department of Industrial Data Engineering, Hanyang University, Seoul, South Korea · School of Interdisciplinary Industrial Studies, Hanyang University, Seoul, South Korea
Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs
Jun 4, 2026Gio Paik, Hyunseo Shin, Soungmin LeeCode-Switching Speech Recognition Domain Generalization
Theta One Korea, Seoul, Republic of Korea · Kitsch Labs, Seongnam, Republic of Korea · Department of Artificial Intelligence, University of Seoul, Seoul, Republic of Korea +1
M2S-AVSR: Modality-aware Multi-view Self-supervised Representation for Robust Audio-Visual Speech Recognition
Jun 4, 2026Fei Su, Cancan Li, Ming Li +1Multimodal Robustness Audio-Visual Representation Learning
School of Artificial Intelligence and the School of Computer Science, Wuhan University, China · School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen, China · School of Artificial Intelligence, Wuhan University, China
Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancy
Jun 3, 2026Zhihan Li, Hankun Wang, Yiwei Guo +3ASR Evaluation Automatic Speech Recognition
X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, China
Test-Time Compute Scaling for ASR with Depth-Conditioned Looped Transformers
Jun 3, 2026Yacouba Kaloga, Shashi Kumar, Shakeel A. Sheikh +3Inference-Time Scaling Test-Time Scaling
Idiap Research Institute, Switzerland · EPFL, Switzerland · BUT, Czech Republic
Efficient ASR Training with Conversations that Never Happened
Jun 2, 2026Máté Gedeon, Péter MihajlikSynthetic Data Augmentation Automatic Speech Recognition
Dept. of Telecommunications and Artificial Intelligence, Budapest University of Technology and Economics, Budapest, Hungary · SpeechTex Ltd., Budapest, Hungary · ELTE Research Centre for Linguistics, Budapest, Hungary
WAXAL-NET: Finetuned Edge ASR Across 19 African Languages
Jun 1, 2026Victor Tolulope Olufemi, Oreoluwa Babatunde, Ramsey Njema +28ASR Evaluation Domain Adaptation for ASR
CMU Africa · LyngualLabs · MBZUAI
Echo: A Joint-Embedding Predictive Architecture for Speaker Diarization and Speech Recognition in a Shared Latent Space
Jun 1, 2026Louis MouchonAudio Representation Learning Joint-Embedding Predictive Architecture
Independent Research
MOSS-Audio Technical Report
Jun 1, 2026Chen Yang, Chufan Yu, Hanfu Chen +27Audio Understanding Audio-Language Models
MURMUR: An Efficient Inference System for Long-Form ASR
May 31, 2026Wei-Tzu Lee, Keisuke Kamahori, Baris KasikciAutomatic Speech Recognition
University of Washington
Spiking and Event-driven Neuromorphic Mamba Models for Efficient Speech Recognition
May 31, 2026Tauseef Ahmed, Tao Sun, Jeronimo Castrillon +2Efficient Neural Network Inference Mamba
Department of Advanced Computing Sciences, Maastricht University, Netherlands · Hardware-Efficient AI Team, IMEC, Netherlands · Chair for Compiler Construction, TU Dresden, Germany +1
Beyond the Mouth: Upper-Face Affective Cues in Audiovisual Sentence Recognition under Acoustic Uncertainty
May 30, 2026Zhou Yang, Yueyi YangMultimodal Robustness Automatic Speech Recognition
Faculty of Education and Psychology, University of Oulu, Finland · Center for Machine Vision and Signal Analysis, University of Oulu, Finland
LaSR: Context-Aware Speech Recognition via Latent Reasoning
May 30, 2026Heyang Liu, Ziyang Cheng, Jiayi Huang +5Automatic Speech Recognition Speech Language Models
Shanghai Jiao Tong University · Ant Group
SALSA: Speech Aware LLM Adaptation via Learned Steering Activation Vectors
May 30, 2026Yekaterina Yegorova, Argyrios Gerogiannis, Haolong Zheng +3Language Model Steering Automatic Speech Recognition
University of Illinois Urbana-Champaign · Korea Advanced Institute of Science and Technology
Scaling Conversational Hungarian ASR: The BEA-Dialogue+ Corpus
May 29, 2026Máté Gedeon, Piroska Zsófia Barta, Péter Mihajlik +1Automatic Speech Recognition Low-Resource Speech Recognition
Department of Telecommunications and Artificial Intelligence, Budapest University of Technology and Economics, Hungary · Speechtex Ltd., Hungary · ELTE Research Centre for Linguistics, Hungary
Subtitle-Aligned Fine-Tuning of Whisper for Swiss German ASR: Benchmark Contamination, Convention Mismatch, and an Honest Baseline at 25.6% WER (13.8% cWER)
May 29, 2026Felix AkeretASR Evaluation Fine-Tuning
Independent Researcher, Zurich, Switzerland · Dipl. Ing. ETH Zürich, Dipl. NDS BWI ETH Zürich. · Dipl. NDS BWI ETH Zürich.
Your Multimodal Speech Model Says I Have a Face for Radio
May 28, 2026Maya K. Nachesa, Vlad Niculae, Vagrant GautamASR Evaluation Demographic Bias in ASR
Language Technology Lab University of Amsterdam · Heidelberg Institute for Theoretical Studies
MELD: Mel-Spectrogram-Based Speech Language Modeling with Discrete Latent Variables
May 28, 2026Sung-Lin Yeh, Wei Zhou, Gil Keren +6Audio Representation Learning Autoregressive Language Modeling
University of Edinburgh · *Work done at Meta · 2Google DeepMind +1
Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding
May 28, 2026Jeong Hun Yeo, Minsu Kim, Hyeongseop Rha +1Language Model Decoding Automatic Speech Recognition
KAIST, Daejeon, Republic of Korea · Google DeepMind, Tokyo, Japan
Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation
May 28, 2026Zixuan Jiang, Yanqiao Zhu, Peng Wang +8Automatic Speech Recognition
College of Artificial Intelligence, Xi’an Jiaotong University, Xi’an 710049, China · X-LANCE Lab, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China · The Chinese University of Hong Kong, Shenzhen, Shenzhen 518172, China +2
ChildVox: A Speech, Audio, and Large Audio-Language Model Benchmark in Understanding and Characterizing Sound across Childhood
May 28, 2026Tiantian Feng, Anfeng Xu, Xuan Shi +10Audio-Language Model Evaluation Speech Quality Assessment
University of Southern California · The Ohio State University · University of California, Los Angeles +3
Breaking the Script Barrier: Enabling Automatic Alignment for PoS-based ASR Error Analysis in Non-Latin Scripts
May 27, 2026Prasenjit K Mudi, Dahlia Devapriya, Sheetal KalyaniAutomatic Speech Recognition
Indian Institute of Technology Madras, India
Building Community-Centred NLP Resources for Puno Quechua
May 27, 2026Elwin Huaman, Adrian Gamarra Lafuente, Johanna Cordova +1Automatic Speech Recognition Low-Resource Language Processing
University of Cambridge (UK) · Stanford University (USA) · ERTIM - Inalco (France)
When Helpful Context Leaks: Privacy Risks in Domain-Adapted ASR
May 27, 2026Maike Züfle, Jan NiehuesData Leakage Domain Adaptation for ASR
Karlsruhe Institute of Technology, Germany
Data-Efficient On-Policy Distillation for Automatic Speech Recognition
May 27, 2026Yu Lin, Yiming Wang, Runyuan Cai +1Automatic Speech Recognition On-Policy Distillation
AutoArk-AI
Beyond Phones: Structured Phonemic Modeling for Vietnamese Automatic Speech Recognition
May 27, 2026Nghia Hieu Nguyen, Quan Ngoc Hoang, Long Hoang Huu Nguyen +2Automatic Speech Recognition
Faculty of Information Science and Engineering · University of Information Technology · Vietnam National University, Ho Chi Minh city, Vietnam +1
TARQ: Tail-Aware Reconstruction Quantization for Rare-Word Robust Automatic Speech Recognition
May 27, 2026Xinyu Wang, Ziyu Zhao, Ke Bai +4Automatic Speech Recognition Post-Training Quantization
McGill University · Boson AI · Arizona State University
FalAR: A Large-scale Speaker-Annotated European Portuguese Speech Corpus of Parliamentary Sessions
May 26, 2026Francisco Teixeira, Carlos Carvalho, Mariana Julião +7Automatic Speech Recognition Low-Resource Speech Recognition
INESC-ID, Lisbon, Portugal · Instituto Superior Técnico, Universidade de Lisboa, Portugal
Proactive for Uncertainty: Cause-Aware Error Diagnosis and Interactive Clarification for Spoken Dialogue Systems
May 25, 2026Yizhou Peng, Ziyang Ma, Changsong Liu +3Spoken Dialogue Systems Automatic Speech Recognition
Nanyang Technological University, Singapore · Shanghai Jiao Tong University, China
Phonetic Modeling of Dialectal Variation in Vietnamese Speech
May 23, 2026Quan Ngoc Hoang, Long Hoang Huu Nguyen, Nghia Hieu Nguyen +2Speech Processing Automatic Speech Recognition
4Vietnam National University, Ho Chi Minh city, Vietnam
End-to-End Intracortical Speech Decoding from Neural Activity
May 23, 2026Owais Mujtaba Khanday, Jose A. Gonzalez-Lopez, Marc Ouellet +2Brain-Computer Interfaces Neural Decoding
1Dpt. of Signal Theory, Telematics and Communications, University of Granada, Spain · 2Brain, Mind, and Behavior Research Center, University of Granada, Spain · 3Grupo CSUR de Epilepsia Refractaria, Hospital Virgen de Las Nieves (Granada), Spain
SCRIBE: Diagnostic Evaluation and Rich Transcription Models for Indic ASR
May 20, 2026Kavya Manohar, Arghya Bhattacharya, Kush Juvekar +1ASR Evaluation Automatic Speech Recognition
Adalat AI, India
Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulation
May 19, 2026Zhifei Xie, Kaiyu Pang, Haobin Zhang +4Automatic Speech Recognition Noise Robustness
1NTU · 3Shanghai AI Lab · 2NUS
Can Large Language Models Reliably Correct Errors in Low-Resource ASR? A Contamination-Aware Case Study on West Frisian
May 19, 2026Yun Hao, Reihaneh Amooie, Wietse de Vries +2Automatic Speech Recognition Data Contamination in Language Models
University of Groningen, The Netherlands
FormalASR: End-to-End Spoken Chinese to Formal Text
May 19, 2026Wanyi Ning, Yinshang Guo, Haitao Qian +3Speech Processing Automatic Speech Recognition
1Yijiahe AI, Nanjing, China · 2Tianjin University, Tianjin, China · 3Nanjing University, Nanjing, China
Benchmarking Commercial ASR Systems on Code-Switching Speech: Arabic, Persian, and German
May 18, 2026Sajjad Abdoli, Ghassan Al-Sumaidaee, Clayton W. Taylor +2Code-Switching Speech Recognition ASR Evaluation
Perle AI
PAREDA: A Multi-Accent Speech Dataset of Natural Language Processing Research Discussions
May 18, 2026Sicheng Jin, Dipankar Srirag, Aditya JoshiASR Evaluation Speech Processing
University of New South Wales
Analyzing Error Propagation in Korean Spoken QA with ASR-LLM Cascades
May 17, 2026Donghyuk Jung, Youngwon ChoiAudio-Language Model Evaluation Question Answering
Korea Culture Technology Institute, Republic of Korea · Maum AI Inc., Republic of Korea
JSPG: Dynamic Dictionary Filtering via Joint Semantic-Pinyin-Glyph Retrieval for Chinese Contextual ASR
May 16, 2026Shilin Zhou, Zhenghua LiAutomatic Speech Recognition Sequence Alignment
School of Computer Science and Technology, Soochow University, Suzhou, China
Symphony for Speech-to-Text: Supporting Real-Time Medical Voice Interfaces
May 15, 2026Arne Nix, Robert James, Lasse Borgholt +6Healthcare Streaming ASR
Corti
A Calculus-Based Framework for Determining Vocabulary Size in End-to-End ASR
May 14, 2026Sunil Kumar KopparapuAutomatic Speech Recognition Hyperparameter Optimization
TCS Research - Mumbai.
Refining Pseudo-Audio Prompts with Speech-Text Alignment for Text-Only Domain Adaptation in LLM-Based ASR
May 14, 2026Ryo Magoshi, Takashi Maekaku, Yusuke ShinoharaDomain Adaptation for ASR Domain Adaptation
Graduate School of Informatics, Kyoto University, Japan · LY Corporation, Japan
Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMs
May 13, 2026Trung Nguyen Quang, Cheng Yi Lewis Won, Minh Duc Pham +3Code-Switching Speech Recognition Audio-Language Models
Institute for Infocomm Research (I2R), A⋆STAR, Singapore · Nanyang Technological University, Singapore
Vividh-ASR: A Complexity-Tiered Benchmark and Optimization Dynamics for Robust Indic Speech Recognition
May 13, 2026Kush Juvekar, Kavya Manohar, Aditya Srinivas Menon +2ASR Evaluation Automatic Speech Recognition
Adalat AI, India
On the Interpretability of Whisper Encodings Using Sparse Autoencoders
May 12, 2026Dan Pluth, Zachary Nicholas Houghton, Yu Zhou +1Transformer Interpretability Mechanistic Interpretability
Vail Systems, Inc. · University of Oregon
Responsible Benchmarking of Fairness for Automatic Speech Recognition
May 11, 2026Felix Herron, Ange Richard, François Portet +2Algorithmic Fairness Demographic Bias in ASR
MILES Team, LAMSADE, Université Paris Dauphine-PSL (1) · GETALP Team, LIG, Université Grenoble Alpes (2) · PACTE, Université Grenoble-Alpes (3)
WorldSpeech: A Multilingual Speech Corpus from Around the World
May 9, 2026Antonis Asonitis, Luca A. Lanzendörfer, Frédéric Berdoz +1Automatic Speech Recognition Low-Resource Speech Recognition
ETH Zurich

Jun 9, 2026, eess.ASJ/K move · Enter open · S save

Entropy-Aware Domain-Routed Mixture-of-Experts Speech-LLM Framework: A Case Study of Multi-Domain Child-Adult ASR

Mohan Shi, Kaiyuan Zhang, Zilai Wang, Natarajan Balaji Shankar+2

University of California, Los Angeles, USA

Mixture-of-Experts Language Models Automatic Speech Recognition LLM Routing Speech Language Models

Open paper AskPDF arXiv

While Speech Large Language Models (Speech-LLMs) have achieved strong performance on adult Automatic Speech Recognition (ASR), their effectiveness on child speech remains under-explored, and single models often struggle to handle diverse adult and child age groups simultaneously. This paper proposes a Mixture-of-Experts (MoE) Speech-LLM for unified ASR across adult and child speech spanning diverse environments and age groups. The framework employs a Classifier-based Domain Router (C-DR) with a coarse-to-fine strategy and integrates both a Mixture-of-Projectors (MoP) and a Mixture-of-LoRAs (MoL) to model domain-specific variations. To address routing uncertainty near domain boundaries, an Entropy-Aware Routing (EAR) mechanism is introduced to dynamically incorporate a shared expert. Experiments on public child corpora demonstrate consistent improvements over baselines while preserving adult ASR performance. To our knowledge, this is the first work leveraging Speech-LLMs for unified, multi-domain ASR encompassing both children and adults.

Momentum

Related topics

Latest papers 302