Automatic Speech Recognition

Also known as ASR

Overview

Automatic speech recognition (ASR) studies how to turn audio into written words, supporting tasks such as transcription, captioning, voice interfaces, and clinical documentation. Systems commonly use self-supervised speech encoders with CTC or transducer decoders, encoder-decoder models, and increasingly speech-language models; adaptation, contextual biasing, and synthetic or unlabeled data help handle specialized vocabulary and underrepresented languages. Work also targets streaming and long-form audio, overlapping speakers, noisy recordings, and audiovisual cues, with evaluation on datasets such as LibriSpeech, Common Voice, and meeting and domain-specific benchmarks. Strong pretrained models coexist with persistent gaps in low-resource and atypical speech, dialect fairness, hallucination control, and real-world robustness, while word error rate alone often misses meaning, usability, and downstream impact.

Latest papers

CardsList

484 papers67 papers in the last four weeks, down 7% on the four weeks before. 0.4% of all new papers.

  1. Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMs

    May 13, 2026Trung Nguyen Quang, Cheng Yi Lewis Won, Minh Duc Pham +3Code-Switching Speech RecognitionAudio-Language Models

  2. On the Interpretability of Whisper Encodings Using Sparse Autoencoders

    May 12, 2026Dan Pluth, Zachary Nicholas Houghton, Yu Zhou +1Transformer InterpretabilityMechanistic Interpretability

  3. Responsible Benchmarking of Fairness for Automatic Speech Recognition

    May 11, 2026Felix Herron, Ange Richard, François Portet +2Algorithmic FairnessDemographic Bias in ASR

  4. WorldSpeech: A Multilingual Speech Corpus from Around the World

    May 9, 2026Antonis Asonitis, Luca A. Lanzendörfer, Frédéric Berdoz +1Automatic Speech RecognitionLow-Resource Speech Recognition

  5. WASIL: In-the-Wild Arabic Spoken Interactions with LLMs

    May 9, 2026Zien Sheikh Ali, Hamdy Mubarak, Soon-Gyo Jung +3Voice Agent EvaluationArabic NLP

  6. Dolphin-CN-Dialect: Where Chinese Dialects Matter

    May 9, 2026Yangyang Meng, Huihang Zhong, Guodong Lin +6Streaming ASRAutomatic Speech Recognition

  7. Beyond Single Ground Truth: Reference Monism as Epistemic Injustice in ASR Evaluation

    May 8, 2026Anna Seo Gyeong Choi, Maria Teleki, James Caverlee +3ASR EvaluationAutomatic Speech Recognition

  8. Bangla-WhisperDiar: Fine-Tuning Whisper and PyAnnote for Bangla Long-Form Speech Recognition and Speaker Diarization

    May 6, 2026Mohammed Aman Bhuiyan, Md Sazzad Hossain Adib, Samiul Basir Bhuiyan +4Audio UnderstandingAutomatic Speech Recognition

  9. A Comprehensive Analysis of Tokenization and Self-Supervised Learning in End-to-End Automatic Speech Recognition applied on French Language

    May 5, 2026Thibault Bañeras-Roux, Mickael Rouvier, Jane Wottawa +1ASR EvaluationAutomatic Speech Recognition

  10. A Paradigm for Interpreting Metrics and Identifying Critical Errors in Automatic Speech Recognition

    May 5, 2026Thibault Bañeras-Roux, Mickael Rouvier, Jane Wottawa +1ASR EvaluationAutomatic Speech Recognition

  11. AfriVox-v2: A Domain-Verticalized Benchmark for In-the-Wild African Speech Recognition

    May 5, 2026Busayo Awobade, Gabrial Zencha Ashungafac, Tobi OlatunjiMultilingual ASRASR Evaluation

  12. Contrastive Regularization for Accent-Robust ASR

    May 5, 2026Van-Phat Thai, Aradhya Dhruv, Duc-Thinh Pham +1Automatic Speech RecognitionSupervised Contrastive Learning

  13. When Audio-Language Models Fail to Leverage Multimodal Context for Dysarthric Speech Recognition

    May 4, 2026Pehuén Moure, Niclas Pokel, Bilal Bounajma +4Audio-Language Model EvaluationASR Evaluation

  14. LRS-VoxMM: A benchmark for in-the-wild audio-visual speech recognition

    Apr 30, 2026Doyeop Kwak, Jeongsoo Choi, Suyeon Lee +1ASR EvaluationAutomatic Speech Recognition

  15. HATS: An Open data set Integrating Human Perception Applied to the Evaluation of Automatic Speech Recognition Metrics

    Apr 30, 2026Thibault Bañeras Roux, Jane Wottawa, Mickael Rouvier +2ASR EvaluationHuman-in-the-Loop Evaluation

  16. Qualitative Evaluation of Language Model Rescoring in Automatic Speech Recognition

    Apr 30, 2026Thibault Bañeras-Roux, Mickaël Rouvier, Jane Wottawa +1ASR EvaluationAutomatic Speech Recognition

  17. Few-Shot Synthetic Accented Speech for ASR Fine-Tuning: What Helps and When?

    Apr 30, 2026Yurii Halychanskyi, Nimet Beyza Bozdag, Mark Hasegawa-Johnson +2Synthetic-to-Real Domain AdaptationSynthetic Data Augmentation

  18. Graph-Based Phonetic Error Correction of Noisy ASR

    Apr 29, 2026Pratik Rakesh Singh, Mohammadi Zaki, Aneesh Mukkamala +1Automatic Speech Recognition

  19. Multimodal LLMs are not all you need for Pediatric Speech Language Pathology

    Apr 29, 2026Darren Fürst, Sebastian Steindl, Ulrich SchäferAudio Representation LearningHealthcare

  20. Text-Utilization for Encoder-dominated Speech Recognition Models

    Apr 29, 2026Albert Zeyer, Tim Posielek, Ralf Schlüter +1Automatic Speech Recognition

  21. WhisperPipe: A Resource-Efficient Streaming Architecture for Real-Time Automatic Speech Recognition

    Apr 28, 2026Erfan Ramezani, Mohammad Mahdi Giahi, Mohammad Erfan Zarabadipour +2Streaming ASRSpeech Processing

  22. RAS: a Reliability Oriented Metric for Automatic Speech Recognition

    Apr 27, 2026Wenbin Huang, Yuhang Qiu, Bohan Li +5ASR EvaluationSelective Prediction

  23. Keyword spotting using convolutional neural network for speech recognition in Hindi

    Apr 26, 2026Saru Bharti, Pushparaj Mani PathakKeyword SpottingSpeech Processing

  24. Au-M-ol: A Unified Model for Medical Audio and Language Understanding

    Apr 25, 2026Meizhu Liu, Nistha Mitra, Paul Li +3Medical Speech RecognitionSpeech Processing

  25. Prompting Whisper for Joint Speech Transcription and Diarization

    Apr 24, 2026Mariia Zamyrova, Henk van den HeuvelSpeech ProcessingAutomatic Speech Recognition

  26. Identifying and typifying demographic unfairness in phoneme-level embeddings of self-supervised speech recognition models

    Apr 24, 2026Felix Herron, Solange Rossato, Alexandre Allauzen +1Demographic Bias in ASRAutomatic Speech Recognition

  27. Advancing automatic speech recognition using feature fusion with self-supervised learning features: A case study on Fearless Steps Apollo corpus

    Apr 24, 2026Szu-Jui Chen, John H. L. HansenAutomatic Speech RecognitionSelf-Supervised Speech Representation Learning