Zero-Shot TTS
TTS: Text-to-Speech
Overview
Zero-shot TTS studies how to generate speech in a speaker’s voice from a short audio reference, often across languages or without a transcript. Common approaches include autoregressive models over discrete speech tokens, flow-matching and diffusion models, and masked non-autoregressive generation; some also model waveforms directly. Current work extends voice cloning with streaming, speech editing, and controls for pronunciation, accent, emotion, and prosody. A central challenge is balancing intelligibility, naturalness, and faithful speaker identity, while evaluation metrics do not always agree with human judgments or capture these goals separately.
Latest papers
67 papers7 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.