Speech Generation Evaluation

Overview

Speech generation evaluation asks whether synthesized speech says the right words, sounds natural, preserves speaker identity, and follows instructions about prosody, emotion, or conversational style. Approaches include ASR-based WER and CER, acoustic and MOS-prediction metrics, speaker and emotion embeddings, human listening tests, and pairwise preference models or large audio-language model judges. Benchmarks increasingly test multilingual and domain-specific TTS, fine-grained paralinguistic control, nonverbal vocalizations, and timing and turn-taking in spoken dialogue. A central tension is that automatic scores can miss prosodic, linguistic, or contextual errors that people notice, while gains in intelligibility or semantic alignment may come at the expense of voice identity, expressiveness, or conversational naturalness.

Latest papers

CardsList

62 papers6 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. StyleBench: Evaluating Speech Language Models on Conversational Speaking Style Control

    Mar 8, 2026Haishu Zhao, Aokai Hao, Yuan Ge +3Controllable Speech GenerationSpeech Language Models

  2. Breeze Taigi: Benchmarks and Models for Taiwanese Hokkien Speech Recognition and Synthesis

    Feb 26, 2026Yu-Siang Lan, Chia-Sheng Liu, Yi-Chang Chen +5Speech ProcessingASR Evaluation