TTS Synthesis

TTS: Text-to-Speech

Follow this topic Ask about this topic

Momentum

41 papers in the last four weeks, up 242% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 178

All topics

SPARCLE: SPeaker-aware Aligned Representations via Contrastive Language Embeddings
May 1, 2026Priyam Mazumdar, Yurii Halychanskyi, Steven Guo +2Representation Learning TTS Synthesis
University of Illinois Urbana-Champaign, USA · National Center for Supercomputing Applications, USA
JaiTTS: A Thai Voice Cloning Model
Apr 30, 2026Jullajak Karnjanaekarin, Pontakorn Trakuekul, Narongkorn Panitsrisit +5TTS Synthesis Audio Generation
Jasmine Technology Solution · Sirindhorn International Institute of Technology · Department of Linguistics, Chulalongkorn University
The False Resonance: A Critical Examination of Emotion Embedding Similarity for Speech Generation Evaluation
Apr 29, 2026Yun-Shao Tsai, Yi-Cheng Lin, Huang-Cheng Chou +5TTS Synthesis Speech Generation Evaluation
Graduate Institute of Communication Engineering, National Taiwan University, Taiwan · Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, USA · Gilbert AI Lab, USA +2
One Voice, Many Tongues: Cross-Lingual Voice Cloning for Scientific Speech
Apr 28, 2026Amanuel Gizachew Abebe, Yasmin MoslemTTS Synthesis Text-to-Speech
Shaggar Institute of Technology · Shaggar City, Ethiopia · Trinity College Dublin +1
PSP: An Interpretable Per-Dimension Accent Benchmark for Indic Text-to-Speech
Apr 28, 2026Venkata Pushpak Teja MentaTTS Synthesis Speech Generation Evaluation
Praxel Ventures
Praxy Voice: Voice-Prompt Recovery + BUPS for Commercial-Class Indic TTS from a Frozen Non-Indic Base at Zero Commercial-Training-Data Cost
Apr 28, 2026Venkata Pushpak Teja MentaTTS Synthesis Text-to-Speech
Praxel Ventures
V.O.I.C.E (Voice, Ownership, Identity, Control, Expression): Risk Taxonomy of Synthetic Voice Generation From Empirical Data
Apr 25, 2026Tanusree Sharma, Anish Krishnagiri, Lili Dudas +2TTS Synthesis Audio Generation
Penn State University · University of Dhaka · Arizona State University
TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosis
Apr 24, 2026Xi Wang, Jie Wang, Xingchen Song +8TTS Synthesis Speech Generation Evaluation
Tsinghua University, China · MiLM Plus, Xiaomi Inc., China · The University of Tokyo, Japan
UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions
Apr 24, 2026Chunyu Qiang, Xiaopeng Wang, Kang Yin +11Text-to-Music Generation Text-to-Audio Generation
1Tianjin University, Tianjin, China · 2Kling Team, Kuaishou Technology, Beijing, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China
Preferences of a Voice-First Nation: Large-Scale Pairwise Evaluation and Preference Analysis for TTS in Indian Languages
Apr 23, 2026Srija Anand, Ashwin Sankar, Ishvinder Sethi +10Pairwise Preference Learning Human Preference Evaluation
Indian Institute of Technology Madras, India · AI4Bharat, India · Josh Talks, India
MAGIC-TTS: Fine-Grained Controllable Speech Synthesis with Explicit Local Duration and Pause Control
Apr 23, 2026Jialong Mai, Xiaofen Xing, Xiangmin XuTTS Synthesis Speech Prosody
South China University of Technology
Voice Mapping of Text-to-Speech Systems: A Metric-Based Approach for Voice Quality Assessment
Apr 21, 2026Huanchen Cai, Sten TernströmTTS Synthesis Speech Quality Assessment
Division of Speech, Music and Hearing, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, SE-100 44 Stockholm, Sweden
Self-EmoQ: Plutchik-Guided Value-based Planning to Drive Streaming Emotional TTS
Apr 21, 2026Yue Zhao, Hongyan Li, Yong Chen +1TTS Synthesis Streaming TTS Synthesis
Geely AI Lab
ATRIE: Adaptive Tuning for Robust Inference and Emotion in Persona-Driven Speech Synthesis
Apr 21, 2026Aoduo Li, Haoran Lv, Hongjian Xu +5TTS Synthesis Controllable Speech Generation
Guangdong University of Technology Guangzhou, China · South China University of Technology Guangzhou, China · Shenzhen Polytechnic University Shenzhen, China +2
MINT-Bench: A Comprehensive Multilingual Benchmark for Instruction-Following Text-to-Speech
Apr 20, 2026Huakang Chen, Jingbin Hu, Liumeng Xue +12TTS Synthesis Speech Generation Evaluation
School of Intelligence Science and Technology, Nanjing University, Suzhou, China · Yutu Zhineng, Beijing, China · Lingguang Zhaxian Technology, Shanghai, China
AST: Adaptive, Seamless, and Training-Free Precise Speech Editing
Apr 17, 2026Sihan Lv, Yechen Jin, Zhen Li +5TTS Synthesis Audio Editing
School of Software Technology, Zhejiang University, Hangzhou, China · Institute of Remote Sensing Satellite, China Academy of Space Technology, Beijing, China · Innovation and Management Center of the School of Software (Ningbo), Zhejiang University, Ningbo, China +1
Qwen3.5-Omni Technical Report
Apr 17, 2026Qwen TeamMultimodal Grounding Audio-Visual Understanding
Qwen Team
Acoustic and perceptual differences between standard and accented speech and their voice clones
Apr 2, 2026Tianle Yang, Chengzhe Sun, Phil Rose +1TTS Synthesis Audio Generation
Department of Linguistics, University at Buffalo, United States · Department of Computer Science and Engineering, University at Buffalo, United States · Emeritus Faculty, Australian National University, Australia
SelfTTS: cross-speaker style transfer through explicit embedding disentanglement and self-refinement using self-augmentation
Mar 23, 2026Lucas H. Ueda, João G. T. Lima, Pedro R. Corrêa +3Disentangled Representation Learning TTS Synthesis
Universidade Estadual de Campinas (UNICAMP), Brazil · CPQD, Brazil
WAND: Windowed Attention and Knowledge Distillation for Efficient Autoregressive Text-to-Speech Models
Mar 17, 2026Hanna Lee, Tan Dat Nguyen, Jaehoon Kang +1TTS Synthesis Self-Attention
Korea Advanced Institute of Science and Technology, Republic of Korea · Sungkyunkwan University, Republic of Korea
Speech Generation Speaker Poisoning: Capability Erasure in Zero-Shot Text-to-Speech
Mar 8, 2026Thanathai Lertpetchpun, Thanapat Trachu, Sai Praneeth Karimireddy +1TTS Synthesis Zero-Shot TTS
Signal Analysis and Interpretation Laboratory, University of Southern California · Thomas Lord Department of Computer Science, University of Southern California
CTC-TTS: LLM-based dual-streaming text-to-speech with CTC alignment
Feb 23, 2026Hanwen Liu, Saierdaer Yusuyin, Hao Huang +1TTS Synthesis Streaming TTS Synthesis
School of Computer Science and Technology, Xinjiang University, China · Speech Processing and Machine Intelligence (SPMI) Lab, Tsinghua University, China
Zero-Shot Lombard Speech Synthesis with Controllable Style Embeddings
Jan 19, 2026Seymanur Akti, Alexander WaibelTTS Synthesis Zero-Shot TTS
KIT Campus Transfer GmbH (KCT) · Karlsruhe Institute of Technology (KIT) · Carnegie Mellon University (CMU)
Decoding Order Matters in Autoregressive Speech Synthesis
Jan 13, 2026Minghui Zhao, Anton RagniAdaptive Inference TTS Synthesis
School of Computer Science, University of Sheffield, 211 Portobello, Sheffield S1 4DP, UK
SyncVoice: Simple and Effective Automatic Video Dubbing with Vision-Augmented TTS
Nov 23, 2025Kaidi Wang, Yi He, Wenhao Guan +9TTS Synthesis Audio-Visual Synchronization
School of Informatics, Xiamen University, China · MiLM Plus, Xiaomi Inc., China · School of Electronic Science and Engineering, Xiamen University, China +1
ParsVoice: A Large-Scale Multi-Speaker Persian Speech Corpus for Text-to-Speech Synthesis
Oct 12, 2025Mohammad Javad Ranjbar Kalahroodi, Heshaam Faili, Azadeh ShakeryTTS Synthesis Speech Processing
School of Electrical and Computer Engineering, University of Tehran, Iran · Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
UtterTune: LoRA-Based Target-Language Pronunciation Edit and Control in Multilingual Text-to-Speech
Aug 13, 2025Shuhei KatoTTS Synthesis Speech Prosody
Independent Researcher Tokyo, Japan
Phonikud: Overcoming Phonetic Underspecification for Hebrew Text-To-Speech
Jun 14, 2025Yakov Kolani, Maxim Melichov, Cobi Calev +1TTS Synthesis G2P Conversion
Independent Researcher · Reichman University, Israel · Cisco Systems +2

May 1, 2026, cs.CLJ/K move · Enter open · S save

SPARCLE: SPeaker-aware Aligned Representations via Contrastive Language Embeddings

Priyam Mazumdar, Yurii Halychanskyi, Steven Guo, Mark Hasegawa-Johnson+1

University of Illinois Urbana-Champaign, USA · National Center for Supercomputing Applications, USA

Representation Learning TTS Synthesis Low-Resource TTS Synthesis Controllable Speech Generation

Open paper AskPDF arXiv

Recent advances in speech synthesis have shifted from phoneme representations to direct grapheme modeling. While phonemes address the one-to-many mapping between text and acoustics, they rely on grapheme-to-phoneme (G2P) systems that fail to capture speaker-specific acoustic variation. Prior work demonstrates that grapheme-based models outperform phoneme-based systems at scale, but not in low-resource settings. In this paper, we propose SPARCLE, a speaker-aware grapheme representation model that enriches characters with their precise acoustic realizations. SPARCLE is trained with a contrastive objective to align graphemes with corresponding Wav2Vec2 acoustic representations while conditioned on speaker identity. The resulting model serves as a replacement to G2P systems for downstream text-to-speech (TTS) tasks. We demonstrate that SPARCLE improves generation quality, reducing word error rates by half in extreme low-resource settings compared to standard grapheme-based models.

Momentum

Related topics

Latest papers 178