TTS Evaluation

TTS: Text-to-Speech

Overview

Text-to-speech evaluation asks whether generated speech is intelligible, natural, faithful to a target voice, and appropriate to its context. Common approaches combine human MOS or pairwise preference tests with objective measures such as ASR error, speaker similarity, acoustic features, and learned quality predictors. Benchmarks increasingly probe specific abilities—including accent and phonology, emotion and stress, instruction following, multilingual performance, and long-form consistency—rather than relying on a single overall score. A central challenge is that automatic evaluators often miss prosodic or linguistic errors and may disagree with listeners, so reliable assessment requires multiple dimensions, careful human validation, and tests matched to the intended setting.

Latest papers

CardsList

63 papers11 papers in the last four weeks, down 8% on the four weeks before. 0.1% of all new papers.

  1. Neural networks for Text-to-Speech evaluation

    Mar 17, 2026Ilya Trofimenko, David Kocharyan, Aleksandr Zaitsev +3TTS EvaluationSpeech Quality Assessment

  2. CodecMOS-Accent: A MOS Benchmark of Resynthesized and TTS Speech from Neural Codecs Across English Accents

    Mar 15, 2026Wen-Chin Huang, Nicholas Sanders, Erica CooperTTS EvaluationSpeech Quality Assessment