Overview

Speech editing changes words, speaker traits, emotion, or delivery in recorded audio while aiming to leave unedited regions natural and consistent. Common approaches use autoregressive text-to-speech models, diffusion or flow-based generation, and codec-token infilling, often guided by transcripts or natural-language instructions. Benchmarks such as RealEdit and SpeechEditBench assess edit accuracy alongside preservation of speaker identity, timing, and non-target attributes. Models increasingly combine synthesis and editing, but compositional instructions and the tradeoff between successful changes and faithful preservation remain difficult.

Latest papers

CardsList

24 papers1 paper in the last four weeks, down 86% on the four weeks before. 0.0% of all new papers.

  1. VoxCanvas-41M: A Large-Scale Bilingual Dataset for Instruction-Based Speech Editing and Its Learning Dynamics

    Nov 5, 2026Zhikang Niu, Wenming Tu, Yalin Li +8Speech EditingSpeech Corpus Construction

  2. Fish Audio Drama 3 Technical Report

    Oct 13, 2026Dawei Han, Shidong Li, Shijia Liao +13TTS SynthesisControllable Speech Generation

  3. AnyEdit: A Unified Framework for Speech and Singing Voice Editing with Real-World Environmental Consistency

    Oct 11, 2026Yunjia Zhang, Junan Zhang, Jing Yang +3Audio EditingSpeech Editing

  4. AegisVox: Factorized Privacy and Clinical Preservation for Long-Form Speech

    Oct 10, 2026Praphul Singh, Akshat Agarwal, Ratul Ghosh +5Speaker AnonymizationSpeech Editing

  5. Edit Who Speaks, Control How They Speak: Global Timbre Editing and Local Instruction Control for TTS

    Oct 8, 2026Junchuan Zhao, Chenglin Xu, Wei Zeng +3TTS SynthesisControllable Speech Generation

  6. SEmoEdit: Probing and Harnessing the Editability of Pre-trained Speech Flows

    Sep 28, 2026Tianxin Xie, Pengfei Zhang, Kai Jiang +2TTS SynthesisSpeech Editing

  7. EditVoice: Variable-Length Non-Autoregressive Zero-Shot TTS and Speech Editing with Edit Flows

    Sep 24, 2026Hongyao Deng, Wenhao Guan, Xuetao Lin +4TTS SynthesisSpeech Editing

  8. Luna-TTS Family Technical Report

    Aug 12, 2026Feng Yin, Shuai Shi, Junjie Zheng +19Non-Autoregressive Text GenerationTTS Synthesis

  9. CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation

    Aug 12, 2026Haowei Lou, Hye-Young Paik, Dai Jia +2Singing Voice SynthesisTTS Synthesis

  10. Multi Codec Discrete Diffusion Model for Text Guided Speech Inpainting and Editing

    Aug 5, 2026Iftach Shoham, Tali Dror, Oren Gal +3Speech EditingAudio Diffusion Models

  11. dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model

    Aug 2, 2026Hankun Wang, Bohan Li, Shi Lian +7Speech Foundation ModelsSpeech Editing

  12. UniSAE: Unified Speech Attribute Editing on Speaker, Emotion and Low-Level Content via Discrete Phonetic Posteriorgram Modelling

    Jun 30, 2026Chuanbo Zhu, Wuyou Zhou, Rongxiu Zhong +4Audio EditingSpeech Editing

  13. RIVET: Robust Idempotent Voice Attribute Editing

    Jun 17, 2026Dareen Alharthi, Bhuvan Koduru, Rita Singh +1Audio EditingSpeech Editing

  14. SpeechEditBench: A Bilingual Multi-Attribute Benchmark for Instruction-Guided Speech Editing

    Jun 1, 2026Hanlin Zhang, Daxin Tan, Dehua Tao +3Audio-Language Model EvaluationAudio Editing

  15. UNISON: A Unified Sound Generation and Editing Framework via Deep LLM Fusion

    May 29, 2026Zhaoqing Li, Haoning Xu, Jingran Su +9Text-to-Audio GenerationTTS Synthesis

  16. CosyEdit2: Speech-Editing-Oriented Reinforcement Learning Unlocks Better Zero-Shot TTS

    May 25, 2026Junyang Chen, Yuhang Jia, Hui Wang +3Speech EditingZero-Shot TTS

  17. AST: Adaptive, Seamless, and Training-Free Precise Speech Editing

    Apr 17, 2026Sihan Lv, Yechen Jin, Zhen Li +5TTS SynthesisAudio Editing

  18. LLaDA-TTS: Unifying Speech Synthesis and Zero-Shot Editing via Masked Diffusion Modeling

    Mar 27, 2026Xiaoyu Fan, Huizhi Xie, Wei Zou +1TTS SynthesisZero-Shot TTS

  19. CosyEdit: Unlocking End-to-End Speech Editing Capability from Zero-Shot Text-to-Speech Models

    Jan 8, 2026Junyang Chen, Yuhang Jia, Hui Wang +2Audio EditingSpeech Editing