Voice Cloning

Ask about this topic

Overview

Voice cloning studies how to generate new speech that retains a person’s vocal identity while changing the words, language, or speaking style. Common approaches condition text-to-speech models on reference audio or speaker embeddings, using autoregressive token generation, diffusion or flow matching, and multilingual phonetic representations. Evaluation compares intelligibility, speaker similarity, prosody, and human judgments, with long-form consistency and preservation of accents and expressive traits remaining difficult. The field also faces an open tension between useful personalization and risks such as unauthorized imitation, unreliable clone attribution, and weak safeguards against misuse.

Latest papers

CardsList

42 papers8 papers in the last four weeks, up 167% on the four weeks before. 0.0% of all new papers.

  1. JaiTTS: A Thai Voice Cloning Model

    Apr 30, 2026Jullajak Karnjanaekarin, Pontakorn Trakuekul, Narongkorn Panitsrisit +5TTS SynthesisAudio Generation

    Jasmine Technology Solution · Sirindhorn International Institute of Technology · Department of Linguistics, Chulalongkorn University

  2. One Voice, Many Tongues: Cross-Lingual Voice Cloning for Scientific Speech

    Apr 28, 2026Amanuel Gizachew Abebe, Yasmin MoslemTTS SynthesisText-to-Speech

    Shaggar Institute of Technology · Shaggar City, Ethiopia · Trinity College Dublin +1

  3. V.O.I.C.E (Voice, Ownership, Identity, Control, Expression): Risk Taxonomy of Synthetic Voice Generation From Empirical Data

    Apr 25, 2026Tanusree Sharma, Anish Krishnagiri, Lili Dudas +2TTS SynthesisAudio Generation

    Penn State University · University of Dhaka · Arizona State University

  4. MimicLM: Zero-Shot Voice Imitation through Autoregressive Modeling of Pseudo-Parallel Speech Corpora

    Apr 13, 2026Tao Feng, Yuxiang Wang, Yuancheng Wang +5Zero-Shot Voice ConversionSpeech Processing

    Tsinghua University · The Chinese University of Hong Kong, Shenzhen

  5. Bridging the Stability-Expressivity Gap: Synthetic Data Scaling and Preference Alignment for Low-Resource Spoken Language Models

    Apr 10, 2026Yizhong Geng, Yanliang Li, Jinghan Yang +4TTS SynthesisSpeech Language Models

    Beijing University of Posts and Telecommunications, Beijing, China · Beijing Logic Intelligence Technology, Beijing, China · University of California, USA +2

  6. Acoustic and perceptual differences between standard and accented speech and their voice clones

    Apr 2, 2026Tianle Yang, Chengzhe Sun, Phil Rose +1TTS SynthesisAudio Generation

    Department of Linguistics, University at Buffalo, United States · Department of Computer Science and Engineering, University at Buffalo, United States · Emeritus Faculty, Australian National University, Australia

  7. Voxtral TTS

    Mar 26, 2026Mistral-AI, :, Alexander H. Liu +186Multilingual TTS SynthesisTTS Synthesis

  8. Audio Avatar Fingerprinting: An Approach for Authorized Use of Voice Cloning in the Era of Synthetic Audio

    Mar 20, 2026Candice R. GerstnerDigital ForensicsVoice Cloning

    Research Directorate and AI Security Center, National Security Agency, Fort George G. Meade MD, USA

  9. CAST-TTS: A Simple Cross-Attention Framework for Unified Timbre Control in TTS

    Mar 17, 2026Zihao Zheng, Wen Wu, Chao Zhang +2TTS SynthesisControllable Speech Generation

    Shanghai AI Lab, China · MoE Key Lab of Artificial Intelligence, X-LANCE Lab, Shanghai Jiao Tong University, China

  10. ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA

    Mar 10, 2026Aviad Dahan, Moran Yanuka, Noa Kraicer +2Audio-Video GenerationIdentity-Preserving Video Generation

    Tel Aviv University

  11. Speech Generation Speaker Poisoning: Capability Erasure in Zero-Shot Text-to-Speech

    Mar 8, 2026Thanathai Lertpetchpun, Thanapat Trachu, Sai Praneeth Karimireddy +1TTS SynthesisZero-Shot TTS

    Signal Analysis and Interpretation Laboratory, University of Southern California · Thomas Lord Department of Computer Science, University of Southern California

  12. RVCBench: Benchmarking the Robustness of Voice Cloning Across Modern Audio Generation Models

    Jan 31, 2026Ruinan Jin, Xinting Liao, Hanlin Yu +2Adversarial RobustnessAudio Generation

    The University of British Columbia · Vector Institute