Automatic Speech Recognition Evaluation

Ask about this topic

Momentum

11 papers in the last four weeks, up 267% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 40

All topics
CardsList

  1. Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants

    Oct 5, 2026Aadam Haq, Oggi Rudovic, Malcolm Chadwick +5Automatic Speech Recognition Evaluation

    NatWest, UK

  2. SHAMS: An Audio-Grounded Pronunciation Benchmark for Levantine Arabic

    Oct 1, 2026Ben Sapirstein, Roy Mattar, Guy Mor-Lan +3Arabic Natural Language ProcessingArabic

    Reichman University · Independent Researcher · The Hebrew University of Jerusalem +2

  3. FFASR: Benchmarking Far-Field Automatic Speech Recognition using High-Fidelity Simulated RIRs

    Sep 30, 2026Shivam Saini, Eric Bezzam, Georg Götz +5Automatic Speech Recognition EvaluationImpulse Response

    Treble Technologies, Reykjavík, Iceland · Hugging Face, Paris, France

  4. Talk2Agent: Benchmarking Voice Interfaces for Text Agents

    Sep 30, 2026Terumi Chiba, Guangzhi Sun, Zheqi Yuan +1TalkAutomatic Speech Recognition Evaluation

    Department of Electronic Engineering, Tsinghua University · University of Cambridge

  5. Benchmarking Automatic Speech Recognition Tools for Iberian Languages

    Sep 29, 2026Fernando López, Pablo Gómez, David Solans +2Automatic Speech Recognition EvaluationMultilingual Automatic Speech Recognition

    Telefónica Innovación Digital, Spain · Universidad Autónoma de Madrid, Spain

  6. CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settings

    Sep 28, 2026Shama Gupta, Hoang H Nguyen, Chelsea Huang +2Code-SwitchingAutomatic Speech Recognition Evaluation

    ServiceNow AI Research · Qualcomm Technologies, Inc.

  7. Almieyar: A Culturally Grounded Benchmark for Multi-Dialect Arabic Speech Recognition

    Sep 28, 2026Omid Ghahroodi, Anas Madkoor, Dima Faris Al Saudi +37Arabic Natural Language ProcessingArabic

    QCRI, HBKU · Qatar University · UDST +15

  8. ASR ensembling for phoneme intelligibility evaluation of speech anonymizers

    Sep 23, 2026Victor Ménestrel, Sebastian Möller, Slim Ouni +1Automatic Speech Recognition EvaluationEnd-To-End Automatic Speech Recognition Models

    Technische Universität Berlin, Faculty IV, Berlin, Germany · Université de Lorraine, CNRS, Inria, Loria, F-54000, Nancy, France

  9. Vimarsha: Faithful ASR Evaluation for Indian Languages with Demographic Diversity, In-the-Wild Audio and Spelling Variations

    Sep 21, 2026Kaushal Santosh Bhogale, Srija Anand, Sadakopa Ramakrishnan Thothathiri +3Automatic Speech Recognition EvaluationIndian Languages

    Indian Institute of Technology, Madras, India · Sarvam AI, India

  10. Beyond Word Error Rate: A Switch Aware Evaluation of ASR and Audio Language Models on English Yoruba Code-Switched Speech

    Sep 12, 2026Chibuzor Okocha, Christan Earl GrantCode-SwitchingAutomatic Speech Recognition Evaluation

    Department of Computer & Information Science & Engineering University of Florida, Gainesville, FL, USA

  11. Candor-LR: A Dyadic Conversational Dataset for Audio-Visual Speech Recognition

    Sep 9, 2026Rishabh Jain, Aristeidis Papadopoulos, Zhaofeng Lin +1Automatic Speech Recognition EvaluationConversational Datasets

    Sigmedia Group, School of Engineering, Trinity College Dublin, Ireland

  12. AVSRBench: A Multi-Condition AVSR Benchmark

    Sep 9, 2026Rishabh Jain, Naomi HarteAutomatic Speech Recognition EvaluationDomain Adaptation

    Sigmedia Group, School of Engineering Trinity College Dublin, Ireland

  13. EDRAC: Benchmarking Arabic Dialect Reading Comprehension

    Sep 1, 2026Noor Abo Mokh, Kirill Chirkunov, Teresa Lynn +15Arabic Natural Language ProcessingArabic

    Mohamed bin Zayed University of Artificial Intelligence · New York University Abu Dhabi · IBM Research AI +1

  14. Development and Feasibility Evaluation of an Edge AI as Medical Device System for Breast Cancer Multidisciplinary Team Meetings

    Aug 22, 2026Aarzoo Dhiman, Farzana Haque, Iqtedar Muazzam +3Multidisciplinary Tumor BoardsAi-Based

    Centre of Excellence for Data Science, Artificial Intelligence and Modelling (DAIM), Faculty of Science and Engineering, University of Hull, Hull, United Kingdom · Queen’s Centre for Oncology and Haematology, Hull University Teaching Hospitals NHS Foundation Trust, Castle Hill Hospital, Cottingham, United Kingdom · Department of Computer Science, Faculty of Science and Engineering, University of Hull, Hull, United Kingdom

  15. Seeds Before Objectives: Rethinking Evaluation for Low-Resource Garhwali ASR

    Aug 11, 2026Karamvir Singh Batra, Prathamjyot Singh, Ashima Sood +2Automatic Speech Recognition EvaluationLow-Resource Languages

    Thapar Institute of Engineering and Technology, Patiala, Punjab, India · Ulster University, Londonderry, United Kingdom · Ulster University, Belfast, United Kingdom

  16. Earnings25: A Comprehensive 500-Hour Speech Benchmark for Finance

    Jul 26, 2026Denglin Jiang, Haoran Zhou, Anshul Wadhawan +7Automatic Speech Recognition EvaluationFinance Benchmarks

    Bloomberg, United States

  17. Benchmarking Human and Automatic Speech Recognition of Diverse Speech: Initial Results

    Jul 21, 2026Ilse Huisman, Rares Popa, Yuanyuan Zhang +1Automatic Speech Recognition EvaluationAutomatic Speech Recognition

    Multimedia Computing Group Delft University of Technology Delft, the Netherlands

  18. ESCUCHA: A Spanish Speech Benchmark for Heterogeneous Acoustic Conditions

    Jul 20, 2026Fernando López, Ana Ayala, Guillermo Segovia +4Automatic Speech Recognition EvaluationLarge Audio Language Models

    Telefónica Innovación Digital · Universidad Autónoma de Madrid · Universidad Complutense de Madrid

  19. Live Gurbani Tracking: A Benchmark and Reference System for Captioning Sikh Kirtan

    Jul 15, 2026Karanbir SinghAutomatic Speech Recognition Evaluation

  20. What Counts as an Error? Dual-Reference Benchmarking for Atypical ASR

    Jun 30, 2026Hawau Olamide Toyin, Srinivasan Umesh, Hanan AldarmakiAutomatic Speech Recognition Evaluation

    MBZUAI, UAE · 2SPRING Lab, IIT Madras, India

  21. Preference-ASR: A Preference-Aware Test Set for Benchmarking ASR in the Era of Speech LLMs

    Jun 28, 2026Nithin Rao Koluguri, Sasha Meister, Nikolay Karpov +4Automatic Speech Recognition Evaluation

    NVIDIA, USA

  22. HALAS: A Human-Annotated Dataset of Hallucinations of Modern ASR Systems

    Jun 22, 2026Mateusz Barański, Jan Jasiński, Julitta Bartolewska +2Automatic Speech Recognition EvaluationAutomatic Speech Recognition

    Signal Processing Group, Institute of Electronics, AGH University of Krakow, Poland

  23. ATCCaps: A Call-Sign-Aware Speech Dataset for Air Traffic Control Recognition

    Jun 21, 2026Dongdong Li, Jianwei Song, Jianwei Wang +1Automatic Speech Recognition EvaluationCaptions

    Department of Computer Science and Technology, East China University of Science and Technology, 130 Meilong Road, Shanghai 200237, China

  24. OpenWER: Improving Cross-Lingual ASR Evaluation and Enabling Token-Based Accuracy Metrics

    Jun 19, 2026Korbinian Kuhn, Gottfried ZimmermannAutomatic Speech Recognition EvaluationCharacter Error Rate

    Stuttgart Media University, Germany · University of Tübingen, Germany

  25. When Multiple Scripts Matter: Evaluating ASR in Clinical Settings

    Jun 16, 2026Jean Seo, Minkyu Kim, Jeonguk Lee +3Automatic Speech Recognition EvaluationEnd-To-End Automatic Speech Recognition Models

    AITRICS · University of Copenhagen · AITRICS, 2 University of Copenhagen +2

  26. Assessing True Generalisability of Audio-Visual Speech Recognisers

    Jun 5, 2026Zhaofeng Lin, Stavros Petridis, Maja Pantic +1Automatic Speech Recognition EvaluationOverfitting

    Trinity College Dublin, Ireland · Imperial College London, UK

  27. Towards Event-Robust Acoustic Scene Classification

    Jun 5, 2026Yiqiang Cai, Bohan Hu, Yu Yang +3Sound Event DetectionAcoustic

    Xi’an Jiaotong-Liverpool University, Suzhou, China · Zhongdian Zhiheng Information Technology Service Co., Ltd, Nanjing, China · China Telecom Jiangsu Branch, Nanjing, China +1

  28. SN-WER: Script-Normalized WER for Multi-Script Indic ASR Evaluation

    Jun 1, 2026Priyaranjan PattnayakAutomatic Speech Recognition EvaluationCharacter Error Rate

    Oracle America Inc.

  29. Building Community-Centred NLP Resources for Puno Quechua

    May 27, 2026Elwin Huaman, Adrian Gamarra Lafuente, Johanna Cordova +1Low-Resource LanguagesAutomatic Speech Recognition Evaluation

    University of Cambridge (UK) · Stanford University (USA) · ERTIM - Inalco (France)

  30. Benchmarking Commercial ASR Systems on Code-Switching Speech: Arabic, Persian, and German

    May 18, 2026Sajjad Abdoli, Ghassan Al-Sumaidaee, Clayton W. Taylor +2Automatic Speech Recognition EvaluationCode-Switching

    Perle AI

  31. Beyond Single Ground Truth: Reference Monism as Epistemic Injustice in ASR Evaluation

    May 8, 2026Anna Seo Gyeong Choi, Maria Teleki, James Caverlee +3Automatic Speech Recognition EvaluationAutomatic Speech Recognition

    Department of Information Science, Cornell University · Department of Computer Science, Texas A&M University · Rev AI +2

  32. AfriVox-v2: A Domain-Verticalized Benchmark for In-the-Wild African Speech Recognition

    May 5, 2026Busayo Awobade, Gabrial Zencha Ashungafac, Tobi OlatunjiAfrican LanguagesAutomatic Speech Recognition Evaluation

    Intron Health

  33. LRS-VoxMM: A benchmark for in-the-wild audio-visual speech recognition

    Apr 30, 2026Doyeop Kwak, Jeongsoo Choi, Suyeon Lee +1Automatic Speech Recognition EvaluationAudio-Visual Reasoning

    Korea Advanced Institute of Science and Technology, South Korea

  34. AppTek Call-Center Dialogues: A Multi-Accent Long-Form Benchmark for English ASR

    Apr 30, 2026Eugen Beck, Sarah Beranek, Uma Moothiringote +4Automatic Speech Recognition EvaluationAutomatic Speech Recognition

  35. HATS: An Open data set Integrating Human Perception Applied to the Evaluation of Automatic Speech Recognition Metrics

    Apr 30, 2026Thibault Bañeras Roux, Jane Wottawa, Mickael Rouvier +2Automatic Speech Recognition EvaluationCharacter Error Rate

    Nantes University, France · Le Mans University, France · Avignon University, France

  36. Evaluation of Automatic Speech Recognition Using Generative Large Language Models

    Apr 23, 2026Thibault Bañeras-Roux, Shashi Kumar, Driss Khalil +6Automatic Speech Recognition EvaluationAutomatic Speech Recognition

    Idiap Research Institute, Martigny, Switzerland · EPFL, Lausanne, Switzerland · Brno University of Technology, Czech Republic +3

  37. "This Wasn't Made for Me": Recentering User Experience and Emotional Impact in the Evaluation of ASR Bias

    Apr 22, 2026Siyu Liang, Alicia Beckford WassinkAutomatic Speech Recognition Evaluation

    University of Washington, Seattle, Washington, USA

  38. Voice of India: A Large-Scale Benchmark for Real-World Speech Recognition in India

    Apr 21, 2026Kaushal Bhogale, Manas Dhir, Amritansh Walecha +11Automatic Speech Recognition EvaluationAutomatic Speech Recognition

    Indian Institute of Technology, Madras, India · Josh Talks, India

  39. PathBench: Speech Intelligibility Benchmark for Automatic Pathological Speech Assessment

    Mar 9, 2026Bence Mark Halpern, Thomas Tienkamp, Defne Abur +1Automatic Speech Recognition EvaluationDysarthric Speech

    1Nagoya University, Japan · Department of Neurology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Germany · University of Groningen, The Netherlands

  40. Unadapted Multilingual ASR on a Garrusi Kurdish Evaluation Set: A Common-Reference Staged Normalization Analysis

    Date pendingHiwa AsadpourAutomatic Speech Recognition EvaluationMultilingual Automatic Speech Recognition

    Saarland University and Goethe University Frankfurt