Automatic Speech Recognition

Also known as ASR

Follow this topic Ask about this topic

Momentum

54 papers in the last four weeks, up 238% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 302

All topics

MELD: Mel-Spectrogram-Based Speech Language Modeling with Discrete Latent Variables
May 28, 2026Sung-Lin Yeh, Wei Zhou, Gil Keren +6Audio Representation Learning Autoregressive Language Modeling
University of Edinburgh · *Work done at Meta · 2Google DeepMind +1
Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding
May 28, 2026Jeong Hun Yeo, Minsu Kim, Hyeongseop Rha +1Language Model Decoding Automatic Speech Recognition
KAIST, Daejeon, Republic of Korea · Google DeepMind, Tokyo, Japan
Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation
May 28, 2026Zixuan Jiang, Yanqiao Zhu, Peng Wang +8Automatic Speech Recognition
College of Artificial Intelligence, Xi’an Jiaotong University, Xi’an 710049, China · X-LANCE Lab, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China · The Chinese University of Hong Kong, Shenzhen, Shenzhen 518172, China +2
ChildVox: A Speech, Audio, and Large Audio-Language Model Benchmark in Understanding and Characterizing Sound across Childhood
May 28, 2026Tiantian Feng, Anfeng Xu, Xuan Shi +10Audio-Language Model Evaluation Speech Quality Assessment
University of Southern California · The Ohio State University · University of California, Los Angeles +3
Breaking the Script Barrier: Enabling Automatic Alignment for PoS-based ASR Error Analysis in Non-Latin Scripts
May 27, 2026Prasenjit K Mudi, Dahlia Devapriya, Sheetal KalyaniAutomatic Speech Recognition
Indian Institute of Technology Madras, India
Building Community-Centred NLP Resources for Puno Quechua
May 27, 2026Elwin Huaman, Adrian Gamarra Lafuente, Johanna Cordova +1Automatic Speech Recognition Low-Resource Language Processing
University of Cambridge (UK) · Stanford University (USA) · ERTIM - Inalco (France)
When Helpful Context Leaks: Privacy Risks in Domain-Adapted ASR
May 27, 2026Maike Züfle, Jan NiehuesData Leakage Domain Adaptation for ASR
Karlsruhe Institute of Technology, Germany
Data-Efficient On-Policy Distillation for Automatic Speech Recognition
May 27, 2026Yu Lin, Yiming Wang, Runyuan Cai +1Automatic Speech Recognition On-Policy Distillation
AutoArk-AI
Beyond Phones: Structured Phonemic Modeling for Vietnamese Automatic Speech Recognition
May 27, 2026Nghia Hieu Nguyen, Quan Ngoc Hoang, Long Hoang Huu Nguyen +2Automatic Speech Recognition
Faculty of Information Science and Engineering · University of Information Technology · Vietnam National University, Ho Chi Minh city, Vietnam +1
TARQ: Tail-Aware Reconstruction Quantization for Rare-Word Robust Automatic Speech Recognition
May 27, 2026Xinyu Wang, Ziyu Zhao, Ke Bai +4Automatic Speech Recognition Post-Training Quantization
McGill University · Boson AI · Arizona State University
FalAR: A Large-scale Speaker-Annotated European Portuguese Speech Corpus of Parliamentary Sessions
May 26, 2026Francisco Teixeira, Carlos Carvalho, Mariana Julião +7Automatic Speech Recognition Low-Resource Speech Recognition
INESC-ID, Lisbon, Portugal · Instituto Superior Técnico, Universidade de Lisboa, Portugal
Proactive for Uncertainty: Cause-Aware Error Diagnosis and Interactive Clarification for Spoken Dialogue Systems
May 25, 2026Yizhou Peng, Ziyang Ma, Changsong Liu +3Spoken Dialogue Systems Automatic Speech Recognition
Nanyang Technological University, Singapore · Shanghai Jiao Tong University, China
Phonetic Modeling of Dialectal Variation in Vietnamese Speech
May 23, 2026Quan Ngoc Hoang, Long Hoang Huu Nguyen, Nghia Hieu Nguyen +2Speech Processing Automatic Speech Recognition
4Vietnam National University, Ho Chi Minh city, Vietnam
End-to-End Intracortical Speech Decoding from Neural Activity
May 23, 2026Owais Mujtaba Khanday, Jose A. Gonzalez-Lopez, Marc Ouellet +2Brain-Computer Interfaces Neural Decoding
1Dpt. of Signal Theory, Telematics and Communications, University of Granada, Spain · 2Brain, Mind, and Behavior Research Center, University of Granada, Spain · 3Grupo CSUR de Epilepsia Refractaria, Hospital Virgen de Las Nieves (Granada), Spain
SCRIBE: Diagnostic Evaluation and Rich Transcription Models for Indic ASR
May 20, 2026Kavya Manohar, Arghya Bhattacharya, Kush Juvekar +1ASR Evaluation Automatic Speech Recognition
Adalat AI, India
Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulation
May 19, 2026Zhifei Xie, Kaiyu Pang, Haobin Zhang +4Automatic Speech Recognition Noise Robustness
1NTU · 3Shanghai AI Lab · 2NUS
Can Large Language Models Reliably Correct Errors in Low-Resource ASR? A Contamination-Aware Case Study on West Frisian
May 19, 2026Yun Hao, Reihaneh Amooie, Wietse de Vries +2Automatic Speech Recognition Data Contamination in Language Models
University of Groningen, The Netherlands
FormalASR: End-to-End Spoken Chinese to Formal Text
May 19, 2026Wanyi Ning, Yinshang Guo, Haitao Qian +3Speech Processing Automatic Speech Recognition
1Yijiahe AI, Nanjing, China · 2Tianjin University, Tianjin, China · 3Nanjing University, Nanjing, China
Benchmarking Commercial ASR Systems on Code-Switching Speech: Arabic, Persian, and German
May 18, 2026Sajjad Abdoli, Ghassan Al-Sumaidaee, Clayton W. Taylor +2Code-Switching Speech Recognition ASR Evaluation
Perle AI
PAREDA: A Multi-Accent Speech Dataset of Natural Language Processing Research Discussions
May 18, 2026Sicheng Jin, Dipankar Srirag, Aditya JoshiASR Evaluation Speech Processing
University of New South Wales
Analyzing Error Propagation in Korean Spoken QA with ASR-LLM Cascades
May 17, 2026Donghyuk Jung, Youngwon ChoiAudio-Language Model Evaluation Question Answering
Korea Culture Technology Institute, Republic of Korea · Maum AI Inc., Republic of Korea
JSPG: Dynamic Dictionary Filtering via Joint Semantic-Pinyin-Glyph Retrieval for Chinese Contextual ASR
May 16, 2026Shilin Zhou, Zhenghua LiAutomatic Speech Recognition Sequence Alignment
School of Computer Science and Technology, Soochow University, Suzhou, China
Symphony for Speech-to-Text: Supporting Real-Time Medical Voice Interfaces
May 15, 2026Arne Nix, Robert James, Lasse Borgholt +6Healthcare Streaming ASR
Corti
A Calculus-Based Framework for Determining Vocabulary Size in End-to-End ASR
May 14, 2026Sunil Kumar KopparapuAutomatic Speech Recognition Hyperparameter Optimization
TCS Research - Mumbai.
Refining Pseudo-Audio Prompts with Speech-Text Alignment for Text-Only Domain Adaptation in LLM-Based ASR
May 14, 2026Ryo Magoshi, Takashi Maekaku, Yusuke ShinoharaDomain Adaptation for ASR Domain Adaptation
Graduate School of Informatics, Kyoto University, Japan · LY Corporation, Japan
Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMs
May 13, 2026Trung Nguyen Quang, Cheng Yi Lewis Won, Minh Duc Pham +3Code-Switching Speech Recognition Audio-Language Models
Institute for Infocomm Research (I2R), A⋆STAR, Singapore · Nanyang Technological University, Singapore
Vividh-ASR: A Complexity-Tiered Benchmark and Optimization Dynamics for Robust Indic Speech Recognition
May 13, 2026Kush Juvekar, Kavya Manohar, Aditya Srinivas Menon +2ASR Evaluation Automatic Speech Recognition
Adalat AI, India
On the Interpretability of Whisper Encodings Using Sparse Autoencoders
May 12, 2026Dan Pluth, Zachary Nicholas Houghton, Yu Zhou +1Transformer Interpretability Mechanistic Interpretability
Vail Systems, Inc. · University of Oregon
Responsible Benchmarking of Fairness for Automatic Speech Recognition
May 11, 2026Felix Herron, Ange Richard, François Portet +2Algorithmic Fairness Demographic Bias in ASR
MILES Team, LAMSADE, Université Paris Dauphine-PSL (1) · GETALP Team, LIG, Université Grenoble Alpes (2) · PACTE, Université Grenoble-Alpes (3)
WorldSpeech: A Multilingual Speech Corpus from Around the World
May 9, 2026Antonis Asonitis, Luca A. Lanzendörfer, Frédéric Berdoz +1Automatic Speech Recognition Low-Resource Speech Recognition
ETH Zurich

May 28, 2026, eess.ASJ/K move · Enter open · S save

MELD: Mel-Spectrogram-Based Speech Language Modeling with Discrete Latent Variables

Sung-Lin Yeh, Wei Zhou, Gil Keren, Duc Le+5

University of Edinburgh · *Work done at Meta · 2Google DeepMind+1

Audio Representation Learning Autoregressive Language Modeling Automatic Speech Recognition Speech Language Models Text-to-Speech Discrete Speech Representation Learning

Open paper AskPDF arXiv

Recent speech language models rely on encoders that are optimized separately from autoregressive models. Since these encoders are unaware of the downstream objectives, the extracted representations may not be optimal for downstream tasks. To address this limitation, we introduce a discrete latent variable model on mel spectrograms that jointly optimizes the encoder and the speech language model. Joint optimization not only brings improvements over codec-based and other mel-spectrogram-based baselines on zero-shot Text-to-Speech (TTS) and Speech-to-Text (STT) tasks, but also effectively alleviates common issues in autoregressive mel spectrogram modeling, such as prolonged silence generation and word omissions.

Momentum

Related topics

Latest papers 302