Automatic Speech Recognition

Also known as ASR

Follow this topic Ask about this topic

Momentum

54 papers in the last four weeks, up 238% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 302

All topics

Pretrained self-supervised speech models can recognize unseen consonants
Jun 10, 2026Chihiro Taguchi, Éric Le Ferrand, Hirosi Nakagawa +4Automatic Speech Recognition Self-Supervised Speech Representation Learning
University of Notre Dame, USA · University at Buffalo, USA · Tokyo University of Foreign Studies, Japan +3
Massive Open-Vocabulary Keyword Spotting
Jun 9, 2026Leonor Barreiros, Raul Monteiro, Afonso Mendes +1Keyword Spotting Automatic Speech Recognition
Priberam Labs, Lisboa, Portugal · Instituto Superior Técnico, Lisboa, Portugal · Instituto de Telecomunicações, Lisboa, Portugal
Speaker Group Encoding in Self-supervised Speech Recognition Models
Jun 9, 2026Felix Herron, Solange Rossato Alexandre Allauzen, Benoit Favre +1Audio Representation Learning Demographic Bias in ASR
MILES Team, LAMSADE, Université Paris Dauphine-PSL, France (1) · GETALP Team, LIG, Université Grenoble Alpes, France (2) · NLP team, LIS, Aix-Marseille University, France (3)
Entropy-Aware Domain-Routed Mixture-of-Experts Speech-LLM Framework: A Case Study of Multi-Domain Child-Adult ASR
Jun 9, 2026Mohan Shi, Kaiyuan Zhang, Zilai Wang +3Mixture-of-Experts Language Models Automatic Speech Recognition
University of California, Los Angeles, USA
Speech Meets ELF: Audio Conditional Continuous-Target Diffusion for Speech Recognition and Translation
Jun 9, 2026Xuanchen Li, Tianrui Wang, Yuheng Lu +11Speech Translation Automatic Speech Recognition
1Tianjin University · 2Shanghai Jiao Tong University · 3Zhipu AI
ViP-VL: Vietnamese Self-supervised Speech Pretraining Model with Vector-Quantization Learning
Jun 9, 2026Khanh Le, Kiet Anh Hoang, Bao Nguyen +5Audio Representation Learning Speech Processing
VinUniversity, Vietnam · UNEY, Switzerland
LLM can Read Spectrogram: Encoder-free Speech-Language Modeling
Jun 8, 2026Ruchao Fan, Yiming Wang, Yuxuan Hu +6Spoken Language Understanding Audio Understanding
Microsoft, USA
Is Text All You Need? Text as a Universal Information Bottleneck for Speech LLMs
Jun 8, 2026Ming-Hao Hsu, Yuxuan Hu, Shujie Liu +3Audio Representation Learning Audio Understanding
School of Data Science, The Chinese University of Hong Kong, Shenzhen, China. · Microsoft Research, Redmond, WA, USA. · Microsoft Research Asia, Hong Kong, China.
TRADE: Transducer-Augmented Decoder for Speech LLM
Jun 7, 2026Yun Tang, Shanil Puri, Shinji Watanabe +1Streaming ASR Speech Processing
Hippocratic AI · Carnegie Mellon University
Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders
Jun 5, 2026Georgii Aparin, Vadim Popov, Tasnima Sadekova +1Audio-Language Model Hallucination Detection Sparse Autoencoders
AI Foundation and Algorithm Lab · National Research University Higher School of Economics
Assessing True Generalisability of Audio-Visual Speech Recognisers
Jun 5, 2026Zhaofeng Lin, Stavros Petridis, Maja Pantic +1Automatic Speech Recognition Audio-Visual Speech Recognition
Trinity College Dublin, Ireland · Imperial College London, UK
Phonetic Error Analysis of Raw Waveform Acoustic Models
Jun 5, 2026Erfan Loweimi, Zhengjun Yue, Andrea Carmantini +3ASR Evaluation Speech Processing
Centre for Speech Technology Research (CSTR), University of Edinburgh, UK · SLAI & CUHK-SZ, China · King’s College London, UK
Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognition
Jun 5, 2026Tung X. Nguyen, Hieu Minh Truong, Giang Son Nguyen +3Code-Switching Speech Recognition Contrastive Learning
VinUniversity, Vietnam · University of Technology Sydney, Australia · Monash University, Australia
Hearing the Unspoken: Language Model Priors for Acoustic Adversarial Attacks
Jun 5, 2026Jiani Xie, Andrew C. Cullen, Paul Montague +1Streaming ASR Automatic Speech Recognition
University of Melbourne · DST Group
Leveraging Soft Distributions of SSL-Derived Discrete Speech Tokens for Downstream Inference
Jun 5, 2026Kentaro Onda, Satoru Fukayama, Daisuke Saito +1Automatic Speech Recognition Audio Tokenization
The University of Tokyo, Japan · National Institute of Advanced Industrial Science and Technology (AIST), Japan
FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognition
Jun 4, 2026Fernando López, Santosh Kesiraju, Jordi LuqueAutomatic Speech Recognition Speech Language Models
Scientific Research, Telefónica Innovación Digital, Spain · AUDIAS, Universidad Autónoma de Madrid, Spain
Multi-task Learning is Not Enough: Representational Entanglement in Dual-output Second Language Speech Recognition
Jun 4, 2026Seung Hwan Cho, Young-Min KimDisentangled Representation Learning Multi-Task Learning
Department of Industrial Data Engineering, Hanyang University, Seoul, South Korea · School of Interdisciplinary Industrial Studies, Hanyang University, Seoul, South Korea
Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs
Jun 4, 2026Gio Paik, Hyunseo Shin, Soungmin LeeCode-Switching Speech Recognition Domain Generalization
Theta One Korea, Seoul, Republic of Korea · Kitsch Labs, Seongnam, Republic of Korea · Department of Artificial Intelligence, University of Seoul, Seoul, Republic of Korea +1
M2S-AVSR: Modality-aware Multi-view Self-supervised Representation for Robust Audio-Visual Speech Recognition
Jun 4, 2026Fei Su, Cancan Li, Ming Li +1Multimodal Robustness Audio-Visual Representation Learning
School of Artificial Intelligence and the School of Computer Science, Wuhan University, China · School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen, China · School of Artificial Intelligence, Wuhan University, China
Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancy
Jun 3, 2026Zhihan Li, Hankun Wang, Yiwei Guo +3ASR Evaluation Automatic Speech Recognition
X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, China
Test-Time Compute Scaling for ASR with Depth-Conditioned Looped Transformers
Jun 3, 2026Yacouba Kaloga, Shashi Kumar, Shakeel A. Sheikh +3Inference-Time Scaling Test-Time Scaling
Idiap Research Institute, Switzerland · EPFL, Switzerland · BUT, Czech Republic
Efficient ASR Training with Conversations that Never Happened
Jun 2, 2026Máté Gedeon, Péter MihajlikSynthetic Data Augmentation Automatic Speech Recognition
Dept. of Telecommunications and Artificial Intelligence, Budapest University of Technology and Economics, Budapest, Hungary · SpeechTex Ltd., Budapest, Hungary · ELTE Research Centre for Linguistics, Budapest, Hungary
WAXAL-NET: Finetuned Edge ASR Across 19 African Languages
Jun 1, 2026Victor Tolulope Olufemi, Oreoluwa Babatunde, Ramsey Njema +28ASR Evaluation Domain Adaptation for ASR
CMU Africa · LyngualLabs · MBZUAI
Echo: A Joint-Embedding Predictive Architecture for Speaker Diarization and Speech Recognition in a Shared Latent Space
Jun 1, 2026Louis MouchonAudio Representation Learning Joint-Embedding Predictive Architecture
Independent Research
MOSS-Audio Technical Report
Jun 1, 2026Chen Yang, Chufan Yu, Hanfu Chen +27Audio Understanding Audio-Language Models
MURMUR: An Efficient Inference System for Long-Form ASR
May 31, 2026Wei-Tzu Lee, Keisuke Kamahori, Baris KasikciAutomatic Speech Recognition
University of Washington
Spiking and Event-driven Neuromorphic Mamba Models for Efficient Speech Recognition
May 31, 2026Tauseef Ahmed, Tao Sun, Jeronimo Castrillon +2Efficient Neural Network Inference Mamba
Department of Advanced Computing Sciences, Maastricht University, Netherlands · Hardware-Efficient AI Team, IMEC, Netherlands · Chair for Compiler Construction, TU Dresden, Germany +1
Beyond the Mouth: Upper-Face Affective Cues in Audiovisual Sentence Recognition under Acoustic Uncertainty
May 30, 2026Zhou Yang, Yueyi YangMultimodal Robustness Automatic Speech Recognition
Faculty of Education and Psychology, University of Oulu, Finland · Center for Machine Vision and Signal Analysis, University of Oulu, Finland
LaSR: Context-Aware Speech Recognition via Latent Reasoning
May 30, 2026Heyang Liu, Ziyang Cheng, Jiayi Huang +5Automatic Speech Recognition Speech Language Models
Shanghai Jiao Tong University · Ant Group
SALSA: Speech Aware LLM Adaptation via Learned Steering Activation Vectors
May 30, 2026Yekaterina Yegorova, Argyrios Gerogiannis, Haolong Zheng +3Language Model Steering Automatic Speech Recognition
University of Illinois Urbana-Champaign · Korea Advanced Institute of Science and Technology

Jun 10, 2026, cs.CLJ/K move · Enter open · S save

Pretrained self-supervised speech models can recognize unseen consonants

Chihiro Taguchi, Éric Le Ferrand, Hirosi Nakagawa, Hitomi Ono+3

University of Notre Dame, USA · University at Buffalo, USA · Tokyo University of Foreign Studies, Japan+3

Automatic Speech Recognition Self-Supervised Speech Representation Learning Audio Classification Low-Resource Speech Recognition

Open paper AskPDF arXiv

Modern pretrained self-supervised automatic speech recognition models are trained on large-scale audio data to encode speech into contextualized representations. However, their training data are heavily skewed toward high-resource languages with little data from low-resource languages, raising concerns about the potential underrepresentation of typologically uncommon speech sounds such as click consonants primarily found in Khoisan languages. This leads to our central research question: Can these models recognize click consonants as accurately as other speech sounds? To address this question, we fine-tune and compare pretrained self-supervised speech models (Wav2Vec2 and HuBERT) on data from two click-rich Khoisan languages (G|ui and West !Xoon). Our results reveal that the fine-tuned models consistently recognize clicks more accurately than non-clicks, suggesting that self-supervision enables generalization across human speech sounds including rare phonemes.

Momentum

Related topics

Latest papers 302