Overview

Voice conversion transforms speech to sound like another speaker or to have a different accent, emotion, vocal effort, or singing style while keeping the words intelligible. Common approaches disentangle linguistic content from speaker identity and prosody using self-supervised speech features, codecs, or explicit pitch representations, then generate audio with retrieval, GAN, diffusion, or flow-matching models. Many systems aim for zero-shot conversion from brief reference recordings and increasingly support streaming; evaluation commonly measures word error rate, speaker similarity, naturalness, and latency. A central challenge is balancing faithful content and target voice with natural prosody, low latency, cross-language generalization, and privacy, while detectors must also handle converted speech and other processing reliably.

Latest papers

CardsList

38 papers6 papers in the last four weeks, down 14% on the four weeks before. 0.0% of all new papers.

  1. Adaptive and High-Fidelity Matching Algorithm for Retrieval-Based Accent Conversion

    Nov 5, 2026Xinran Wang, Ning Chen, Yixin Luo +2Voice Conversionk-Nearest Neighbors

  2. EZ-Ar-VC: Robust Arabic Voice Anonymization with Generalization across Dialects and Code-Switching

    Oct 31, 2026Injy Hamed, Adarsh Arigala, Rufael Marew +4Speaker AnonymizationVoice Conversion

  3. StyleStream 2.0: Fast and Controllable Streaming Voice Style Conversion

    Oct 20, 2026Yisi Liu, Nicholas Lee, Gopala K. AnumanchipalliVoice ConversionZero-Shot Voice Conversion

  4. Multimodal Contrastive Representation Learning Based Voice Conversion for Electrolaryngeal Speech Enhancement

    Oct 13, 2026Ding Ma, Jinyi Mi, Jiajun He +3Voice ConversionSpeech Enhancement

  5. Prime-EVC: One-Step Expressive Emotional Voice Conversion via Emotion-Primed Flow Matching

    Oct 12, 2026Yu Pan, Xiaojuan Cai, Liang Zhang +7Voice ConversionEmotional Speech Synthesis

  6. LiveAnon: Improving Privacy and Utility in Streaming Speaker Anonymization with Codec Language Models

    Oct 11, 2026Yejin Kim, Kyungsu Kim, Seungu Han +1Speaker AnonymizationVoice Conversion

  7. AlignAudio: A Unified Dual-Alignment Framework for Noise-Robust Speech-Conditioned Generation

    Oct 10, 2026Yixuan Li, Xuenan Xu, Zeyu Xie +1Audio GenerationVoice Conversion

  8. Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training

    Oct 9, 2026Quentin Le Tellier, Albert Rilliard, Olivier Perrotin +1Controllable Speech GenerationVoice Conversion

  9. VOSSA: Voiceprint Optimization for Streaming Speech Architectures

    Sep 30, 2026Mu-Ruei Tseng, Waris Quamer, Ghady Nasrallah +1Audio Representation LearningSpeech Processing

  10. WhisperVC-AV: Audio-Visual Content Restoration for Noise-Robust Whisper-to-Normal Voice Conversion

    Sep 26, 2026Ziyue Yin, Dong Liu, Ming LiVoice ConversionSpeech Enhancement

  11. ProLombard: Structured Multi-Scale Modeling for Normal-to-Lombard Speech Conversion

    Sep 4, 2026Hongyang Chen, Xinmeng Xu, Youqiang Zheng +5Voice ConversionDisentangled Representation Learning

  12. CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation

    Aug 12, 2026Haowei Lou, Hye-Young Paik, Dai Jia +2Singing Voice SynthesisTTS Synthesis

  13. Expose Your Disguise: Recovering Source Speaker Identity From Voice Conversion

    Jul 26, 2026Hanlei Zhang, Zhongming Ma, Mingyang Zhang +3Voice Conversion

  14. Designed Vocalizations Dataset: Sound-Designed Human and Animal Voices for Non-human Voice Conversion

    Jul 23, 2026Seolhee Lee, Minsu Kang, Yangsun Lee +3Voice Conversion

  15. Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion

    Jul 14, 2026Ben Maman, Frank Zalkow, Hans-Ulrich Berendes +3Audio Diffusion ModelsAudio Generation

  16. ProsoCodec: Prosody-Oriented Speech Codec for Voice Conversion

    Jun 20, 2026Jeongsoo Choi, Ji-Hoon Kim, Shujie Hu +1Audio Representation LearningNeural Audio Codecs

  17. Zero-VC: Zero-Lookahead Streaming Voice Conversion via Speaker Anonymization

    Jun 18, 2026Yudong Li, Zihao Fang, Junwen Qiu +4Speech ProcessingSpeaker Anonymization

  18. Vibrato Expression Control for Singing Voice Conversion with Improving Independent Control

    Jun 15, 2026Joon-Seung Choi, Dong-Min Byun, Seong-Whan LeeVoice Conversion

  19. MeanVC 2: Robust Low-Latency Streaming Zero-Shot Voice Conversion

    Jun 8, 2026Guobin Ma, Yuxuan Xia, Yuepeng Jiang +6Zero-Shot Voice ConversionDiffusion Transformer

  20. From A to B to A: Palindromic Zero-Shot Voice Conversion with Non-Parallel Data

    Jun 7, 2026Moshe Mandel, Shlomo E. ChazanZero-Shot Voice ConversionSpeech Processing

  21. Advancing Electrolaryngeal Speech Enhancement Through Speech-Text Representation Learning

    Jun 1, 2026Ding Ma, Jinyi Mi, Fengji Li +5Representation LearningSpeech Processing

  22. Poly-SVC: Polyphony-Aware Singing Voice Conversion with Harmonic Modeling

    May 12, 2026Chen Geng, Meng Chen, Ruohua Zhou +2Voice Conversion

  23. Exploring Token-Space Manipulation in Latent Audio Tokenizers

    May 11, 2026Francesco Paissan, Luca Della Libera, Mirco Ravanelli +1Audio Representation LearningNeural Audio Codecs

  24. Accent Conversion: A Problem-Driven Survey of Sociolinguistic and Technical Constraints

    Apr 30, 2026Yurii Halychanskyi, Jianfeng Steven Guo, Volodymyr KindratenkoSpeech ProcessingVoice Conversion