Zero-Shot TTS

TTS: Text-to-Speech

Overview

Zero-shot TTS studies how to generate speech in a speaker’s voice from a short audio reference, often across languages or without a transcript. Common approaches include autoregressive models over discrete speech tokens, flow-matching and diffusion models, and masked non-autoregressive generation; some also model waveforms directly. Current work extends voice cloning with streaming, speech editing, and controls for pronunciation, accent, emotion, and prosody. A central challenge is balancing intelligibility, naturalness, and faithful speaker identity, while evaluation metrics do not always agree with human judgments or capture these goals separately.

Latest papers

CardsList

67 papers7 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. No-Shot Text-to-Speech: Limitations of Zero-Shot TTS and its Evaluation Methods in Representing Queer and Transgender Voices

    Nov 16, 2026Juliana Francis, Robin Netzorg, Joakim Gustafson +1Zero-Shot TTSTTS Evaluation

  2. ZONOS3-Mini Technical Report

    Nov 12, 2026Gabriel Clark, Sofian Mejjoute, George Close +1TTS SynthesisZero-Shot TTS

  3. M5-TTS: A Mini-Scale Multilingual and Multi-Dialect Text-to-Speech Language Model with Multi-Token Prediction

    Nov 6, 2026Wenhao Li, Jingbin Hu, Shengming Ling +20TTS SynthesisMultilingual TTS Synthesis

  4. ImageTTS: Repurposing Pretrained Image Diffusion Transformers for Speech Synthesis

    Oct 26, 2026Hanchen Pei, Shujie Liu, Yayue Deng +4TTS SynthesisZero-Shot TTS

  5. LeanTTS: Efficient Full-Stack Bilingual TTS for Zero-Shot Cloning and Voice Customization

    Oct 25, 2026Yuheng Lu, Qiulin Li, Xi Wang +5TTS SynthesisZero-Shot TTS

  6. Long-Prompt Zero-Shot TTS: Benchmarking Prosody Reproduction Beyond Voice Cloning

    Oct 14, 2026Dekun Chen, Renjie Xu, Yingda Shen +2Zero-Shot TTSSpeech Prosody

  7. Revise-TTS: A Non-Masking Refinement Framework for Masked Diffusion Models in Text-to-Speech

    Oct 14, 2026Wanli Sun, Dan Su, Anton RagniTTS SynthesisZero-Shot TTS

  8. E3-System: Expressive EmoData, Explicitly Controllable, Easy-to-Use TTS

    Oct 9, 2026Yiqiao Huang, Xiaolong Lin, Zhenpeng Zhan +1TTS SynthesisExpressive Speech Synthesis

  9. Beyond Token Revision: Investigating Mask-and-Replace Diffusion for Zero-Shot Text-to-Speech

    Oct 7, 2026Hounsu Kim, Joonyong Park, Yuki Saito +2Zero-Shot TTSAudio Diffusion Models

  10. Prompt-Consistency Inference for Zero-Shot Flow-Matching Text-to-Speech Models

    Oct 3, 2026Vasily Zadorozhnyy, Can Goksen, Kazuhito Koishida +1TTS SynthesisZero-Shot TTS

  11. RAWD-TTS: Ratio-Free Reward Alignment for Discrete-Diffusion Voice Cloning

    Sep 29, 2026Maxim Maslov, Kirill Borodin, Vasilii Kudryavtsev +2Audio Diffusion ModelsZero-Shot TTS

  12. DEFINE: Exemplar-Guided Accent Control for Zero-Shot TTS

    Sep 26, 2026Ambuj Mehrish, Abhinaba Roy, Alex Ivanov +2TTS SynthesisZero-Shot TTS

  13. EditVoice: Variable-Length Non-Autoregressive Zero-Shot TTS and Speech Editing with Edit Flows

    Sep 24, 2026Hongyao Deng, Wenhao Guan, Xuetao Lin +4TTS SynthesisSpeech Editing

  14. Forget who you Forgot: Speaker Unlearning to Prevent Re-Identification in Zero-Shot Text-to-Speech

    Sep 23, 2026Hyoeun Kim, Yujun Lee, Kyuhong ShimZero-Shot TTSMachine Unlearning

  15. TTS-Guard: Black-Box Ownership Verification of Text-to-Speech Models via Adaptive Adversarial Speaker-Pair Fingerprints

    Sep 20, 2026Xubin Yue, Zhenhua Xu, Zhebo Wang +5Zero-Shot TTS

  16. Cross-Lingual F5-TTS 2: A Simplified Framework for Language-Agnostic Voice Cloning

    Sep 14, 2026Qingyu Liu, Rixi Xu, Yushen Chen +11TTS SynthesisZero-Shot TTS

  17. StepAudio 3 Gen Technical Report

    Sep 11, 2026Bin Lin, Bo Zhao, Boyang Wang +68TTS SynthesisZero-Shot TTS

  18. Post-Training Zero-Shot TTS for Fine-Grained Emotion and Duration Control via Natural Language

    Sep 10, 2026Lianru Gao, Yujie Guo, Yong QinTTS SynthesisZero-Shot TTS