Voice Agent Evaluation

Ask about this topic

Momentum

6 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 23

All topics
CardsList

  1. Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants

    Oct 5, 2026Aadam Haq, Oggi Rudovic, Malcolm Chadwick +5ASR EvaluationVoice Agent Evaluation

    NatWest, UK

  2. Talk2Agent: Benchmarking Voice Interfaces for Text Agents

    Sep 30, 2026Terumi Chiba, Guangzhi Sun, Zheqi Yuan +1ASR EvaluationVoice Agent Evaluation

    Department of Electronic Engineering, Tsinghua University · University of Cambridge

  3. VAmoS Part Deux: Harder, More Realistic Voice-Agent Simulation

    Sep 29, 2026Joshua Meyer, Sahar Shayegan, Ritiz Tambi +5Voice Agent EvaluationLLM Agent Evaluation

    Veris AI

  4. When Does a Spoken Agent Have Enough Evidence to Act? The PACT-SLM Contract Test

    Sep 28, 2026Mengzhe GengVoice Agent EvaluationSpeech Language Models

    National Research Council Canada

  5. APEX-Voice: Can Voice Agents Complete Professional Workflows Through Full-Duplex Interaction

    Sep 28, 2026Puneet Mathur, Dinesh ManochaVoice Agent EvaluationTool-Using Agents

    University of Maryland College Park, USA

  6. MSI-Bench: Evaluating Multi-Speaker Voice Interaction for Collaborative AI Agents

    Sep 21, 2026Chenxu Xiong, Dongming Shen, Yuzhi Tang +3Audio-Language Model EvaluationVoice Agent Evaluation

    Boson AI Santa Clara, CA 95054

  7. MTVA-Bench: Evaluating the Language Model Inside Cascaded Voice Agents

    Sep 17, 2026Pritish Mishra, Ishaan Kumar, Akshat Mandoli +1Voice Agent EvaluationMultilingual Language Model Evaluation

    Smallest AI

  8. Benchmarking LLM Judges for Voice-Agent Evaluation: Reliability, Calibration, and Human Oversight

    Aug 25, 2026Anupam Purwar, Shashank Singh, Kritika SrivastavaVoice Agent EvaluationLLM-as-a-Judge

    Sprinklr AI Gurugram, India · Sprinklr AI Bengaluru, India

  9. DuplexWorld: Can voice agents help you get through the day?

    Aug 11, 2026Aryan Vijay Bhosale, Harshit Rajgarhia, Akhil Pothanapalli +3Voice Agent EvaluationSpoken Dialogue Systems

    Centific Global Solutions Inc. · University of Maryland · Work done during an internship at Centific.

  10. FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural India

    Aug 6, 2026Aman Dalmia, Sanskriti Midha, Jigar DoshiVoice Agent EvaluationHealthcare

    Artpark, Indian Institute of Science, Bengaluru, Karnataka, India

  11. VAmoS Bench: Voice Agent Simulation Bench

    Jul 29, 2026Joshua Meyer, Sahar Shayegan, Ritiz Tambi +5Voice Agent EvaluationCustomer Support Automation

    Veris AI

  12. RW-Voice-EQ Bench: A Real World Benchmark for Evaluating Voice AI Systems

    Jul 16, 2026David Ayllon, Alice Baird, Jeffrey Brooks +11ASR EvaluationVoice Agent Evaluation

    Hume AI Research

  13. A Reliability Assessment of LALM Audio Judges for Full-Duplex Voice Agents

    Jul 8, 2026A. Sayyad, J. Emmons, S. Jones +2Audio-Language Model EvaluationVoice Agent Evaluation

    Salesforce Applied AI Research, eVerse team

  14. Reference-Based Prosody and Rhythm Evaluation for Spoken Dialogue Systems

    Jun 30, 2026Ashish Hallur, Thomas Thebaud, Georgi Tinchev +2Voice Agent EvaluationSpeech Generation Evaluation

    Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, USA · Amazon Inc., Seattle, WA, USA

  15. Real-Time Voice AI Hears but Does Not Listen

    Jun 24, 2026Martijn Bartelds, Federico Bianchi, James ZouAudio-Language Model EvaluationVoice Agent Evaluation

    Together AI · Stanford University

  16. SpeechEQ: Benchmarking Emotional Intelligence Quotient in Socially Aware Voice Conversational Models

    Jun 24, 2026Liang-Yuan Wu, Zih-Ching Chen, Tongshuang Wu +2Audio-Language Model EvaluationVoice Agent Evaluation

    New York University · NVIDIA · Carnegie Mellon University +1

  17. From Text to Voice: A Reproducible and Verifiable Framework for Evaluating Tool Calling LLM Agents

    May 14, 2026Md Tahmid Rahman Laskar, Xue-Yong Fu, Seyyed Saeed Sarfjoo +3Audio-Language Model EvaluationVoice Agent Evaluation

    Dialpad Inc.

  18. WASIL: In-the-Wild Arabic Spoken Interactions with LLMs

    May 9, 2026Zien Sheikh Ali, Hamdy Mubarak, Soon-Gyo Jung +3Voice Agent EvaluationArabic NLP

    Qatar Computing Research Institute, Qatar

  19. PersonaKit (PK): A Plug-and-Play Platform for User Testing Diverse Roles in Full-Duplex Dialogue

    May 7, 2026Hyunbae Jeon, Jinho D. ChoiVoice Agent EvaluationSpoken Dialogue Systems

    Department of Computer Science Emory University Atlanta, GA, USA

  20. Audio2Tool: Speak, Call, Act -- A Dataset for Benchmarking Speech Tool Use

    Apr 17, 2026Ramit Pahwa, Apoorva Beedu, Parivesh Priye +4Audio-Language Model EvaluationVoice Agent Evaluation

    Rivian and Volkswagen Group Technologies

  21. Human or Machine? A Preliminary Turing Test for Speech-to-Speech Interaction

    Feb 27, 2026Xiang Li, Jiabao Gao, Sipei Lin +5Voice Agent EvaluationSpoken Dialogue Systems

    State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications · Shenzhen Research Institute of Big Data · The Chinese University of Hong Kong, Shenzhen +2

  22. VCB Bench: An Evaluation Benchmark for Audio-Grounded Large Language Model Conversational Agents

    Oct 13, 2025Jiliang Hu, Wenfu Wang, Zuchao Li +6Audio-Language Model EvaluationVoice Agent Evaluation

    School of Artificial Intelligence, Wuhan University, Wuhan, China · Tencent AI Lab, Beijing, China

  23. EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

    Date pendingTara Bogavelli, Gabrielle Gauthier Melançon, Katrina Stankiewicz +10Voice Agent EvaluationSpoken Dialogue Systems

    ServiceNow AI Research