ASR Evaluation

ASR: Automatic Speech Recognition

Overview

ASR evaluation studies how well speech systems turn audio into text and whether their errors matter for people and downstream tasks. Word error rate and character error rate remain common, but researchers also use language-aware normalization, semantic and human-preference measures, and task-based metrics for details such as speaker attribution, timestamps, or critical terms. Benchmarks increasingly test diverse languages and dialects, conversational overlap, clinical or other specialized speech, and acoustic shifts such as noise and reverberation. A central tension is that standardized scores enable comparisons, yet a single reference transcript or aggregate error rate can misrepresent valid linguistic variation, fairness, and practical impact.

Latest papers

CardsList

151 papers13 papers in the last four weeks, down 55% on the four weeks before. 0.1% of all new papers.

  1. Sada-ASR: A Production Multidialectal Arabic Speech Recognition System

    Nov 14, 2026Mahmoud Khaled, Mohammed Abd-Elnaser, Mahmoud Mohsen +2Automatic Speech RecognitionArabic Dialects

  2. Dynamic Block-Online Streaming ASR for Low-Resource Agglutinative Code-Switching Speech with Morphology-Aware Evaluation

    Nov 11, 2026Kazi Rafat, Afifa Imran, Md. Ismail Hossain +5Code-Switching Speech RecognitionStreaming ASR

  3. KeyASRBench: Measuring Whole-Phrase Keyword Preservation in Real-World ASR

    Nov 7, 2026Guanzheng Wei, Ziyi ZhaoASR EvaluationAutomatic Speech Recognition

  4. From Transcription to Reformulation: Defining and Benchmarking Grounded Generative Speech Recognition

    Oct 30, 2026Qing Wang, Qihan Hu, Hang Lv +9Automatic Speech RecognitionASR Evaluation

  5. Beyond Aggregate WER: In-domain Adaptation, Learner Speech, Code-Switching, and Speaker Attribution in Online Spanish Learning Classrooms

    Oct 27, 2026Olga Kellert, Samhitha Harish, Johnatan E Bonilla +3ASR EvaluationDomain Adaptation for ASR

  6. Measuring the Verifier's Floor: How Much Apparent Rare-Word Text-to-Speech Error Is ASR Error?

    Oct 22, 2026Kirill Borodin, Vasilii Kudryavtsev, Nikita Vasiliev +1TTS EvaluationAutomatic Speech Recognition

  7. Text-Only LLM Correctors Break Correct Transcripts: A Repair-Damage Analysis of Audio Grounding in ASR Error Correction

    Oct 21, 2026Vasiliy Kudryavtsev, Kirill Borodin, Nikita Vasiliev +2LLM Self-CorrectionAutomatic Speech Recognition

  8. Measuring Local Acoustic Contribution in Speech LLMs via Word-Span Counterfactual Interventions

    Oct 21, 2026Hardik B. Sailor, Qiongqiong Wang, Dheemant Rastogi +2Audio-Language Model EvaluationSpeech Language Models

  9. SMART: Semantic Segment Mapping and Assessment of Recognition Transcripts with Contextual Rubrics

    Oct 20, 2026Xiaoyu Gu, Chencheng Wang, Fuyang Li +4ASR EvaluationAutomatic Speech Recognition

  10. AfriBED: a Speech Recognition Bias Evaluation Dataset for Low Resource African Languages

    Oct 19, 2026Claytone Sikasote, Hussein Suleman, Jan BuysDemographic Bias in ASRASR Evaluation

  11. Evaluating Tibetan Speech Recognition Across Dialects and Adaptation Regimes: A Multi-Granularity Analysis

    Oct 19, 2026Jacob Moore, Sheng LiAutomatic Speech RecognitionASR Evaluation

  12. ASR Personalization in Pathological Voice: Accuracy, Efficiency, and Duration Effects

    Oct 17, 2026Giuseppe Giaimis, Sergei Katkov, Muhammad Azfar Yaqub +1Automatic Speech RecognitionPersonalized Speech Recognition

  13. SITAR: A Situational Distortion Metric for Automatic Speech Recognition Evaluation

    Oct 15, 2026Mingzhe Lu, Jinhao Liu, Yunpeng Li +3ASR Evaluation

  14. Connecting the Dots: Enduring Performance Gaps in ASR Systems Between Standard and Minority English Varieties

    Oct 13, 2026Alexander Metzger, Aruna Srivastava, Ruslan Mukhamedvaleev +5Demographic Bias in ASRAutomatic Speech Recognition

  15. When Does an ASR Error Matter? Task-Role Diagnostics for Tool-Using Voice Agents

    Oct 13, 2026Xiaolong Wang, Shijie Su, Naqi XiongVoice Agent EvaluationASR Evaluation

  16. Nufo: A Benchmark for Ewe Automatic Speech Recognition

    Oct 12, 2026Christ Kekeli Keli, Steve Sanogo, Patrice Sebastiano +2Automatic Speech RecognitionLow-Resource Speech Recognition

  17. Understanding Personalization Gains in Whisper ASR

    Oct 12, 2026Sergei Katkov, Antonio LiottaPersonalized Speech RecognitionAutomatic Speech Recognition

  18. ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Context

    Oct 12, 2026Mingwei Fu, Zheshu Song, Zhikai Zhou +3ASR EvaluationAudio-Visual Speech Recognition

  19. The NVVSpeech Challenge 2026: Overview and Lessons for Speech Understanding and Generation with Nonverbal Vocalizations

    Oct 12, 2026Liumeng Xue, Yuang Cao, Jingbin Hu +12Nonverbal Vocalization GenerationAudio Understanding

  20. Error Rate is Not Enough: Costs of Augmentation in Low-Resource ASR

    Oct 9, 2026Katsumi Ibaraki, David ChiangLow-Resource Speech RecognitionSynthetic Data Augmentation for Speech Recognition

  21. Phonologically Informed Tokenization for German Speech Recognition: A Cross-Domain Study

    Oct 8, 2026Christopher Witzl, Tobias Bocklet, Korbinian RiedhammerAutomatic Speech RecognitionDomain Adaptation for ASR

  22. Automatic Speech Recognition for Low-Resource Sinhala: A Critical Review of Methods, Challenges, and Future Directions

    Oct 5, 2026Chanuka Dinuwan, Sanath Jayasena, Buddhika KarunarathneASR EvaluationAutomatic Speech Recognition

  23. SHAMS: An Audio-Grounded Pronunciation Benchmark for Levantine Arabic

    Oct 1, 2026Ben Sapirstein, Roy Mattar, Guy Mor-Lan +3ASR EvaluationArabic NLP

  24. Fairness Beyond a Single Run: Training-Seed Variability in Speech LLM Adaptation

    Sep 30, 2026Srishti Ginjala, Eric Fosler-Lussier, Srinivasan ParthasarathyDemographic Bias in ASRAutomatic Speech Recognition

  25. FFASR: Benchmarking Far-Field Automatic Speech Recognition using High-Fidelity Simulated RIRs

    Sep 30, 2026Shivam Saini, Eric Bezzam, Georg Götz +5ASR EvaluationAutomatic Speech Recognition