Text-to-Speech

Also known as TTS

Follow this topic Ask about this topic

Latest papers 65

8 papers in the last four weeks, up 100% on the four weeks before. 0.0% of all new papers.

All topics

Training-Free Instruction TTS Gender Bias Calibration Using Model-Adaptive Steering
Oct 7, 2026Kuan-Yu Chen, Yi-Cheng Lin, Jeng-Lin Li +1Text-to-Speech TTS Synthesis
AI Research Center, Inventec Corporation, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan
BanglaBox: A Phonetically-Balanced Corpus and Data-Efficient Foundation-Model Adaptation for Bangla Text-to-Speech with Zero-Shot Voice Cloning
Oct 6, 2026Emtiaz Uddin Ahmed, Araf Mahmud, Sajib Hossain +3Text-to-Speech Low-Resource TTS Synthesis
Refinement Buys Intelligibility, Search Buys Identity: What Test-Time Compute Buys in Masked-Diffusion TTS
Oct 2, 2026Nityanand Mathur, Hamees Sayed, Ayush Pratap SinghTTS Synthesis Text-to-Speech
Work done outside of Blackstar Inc. · Work done at Smallest AI.
Balalaika-Longform: A Russian Speech Corpus for Continuous Long-Form Text-to-Speech
Sep 30, 2026Nikita Vasiliev, Kirill Borodin, Vasilii Kudryavtsev +2TTS Synthesis TTS Evaluation
BitmanagerAI, Dubai, UAE · lab260, Yerevan, Armenia · MTUCI, Moscow, Russia
RAWD-TTS: Ratio-Free Reward Alignment for Discrete-Diffusion Voice Cloning
Sep 29, 2026Maxim Maslov, Kirill Borodin, Vasilii Kudryavtsev +2Audio Diffusion Models Zero-Shot TTS
lab260, Yerevan, Armenia · BitmanagerAI, Dubai, UAE · MTUCI, Moscow, Russia
DualTrack: Synchronized speech-gesture generation via symmetric coupling of pretrained priors
Sep 29, 2026Yuanzhuo Hu, Zehan Liu, Xiaoyi Qin +1Human Motion Generation Co-Speech Gesture Generation
The Chinese University of Hong Kong, Shenzhen, China · X Square Robot
InstCharVoice: Grounding Natural-Language Instructions for Character-Level Control in Text-to-Speech
Sep 28, 2026Sihang Nie, Xueru Li, Xiaofen Xing +4TTS Synthesis Language Model-Based Control
South China University of Technology · Huya Inc. · The Hongkong Polytechnic University
Accent Analogy Guidance: More Speaker Similarity at Equal Accent in Cross-Lingual Voice Cloning
Sep 24, 2026Yoomee Cho, Jisun LeeTTS Synthesis Zero-Shot TTS
ESTsoft, Seoul, Republic of Korea
Bridging Data, Reasoning, and Alignment: A Unified Framework for Context-Aware Instruction-Following TTS
Sep 13, 2026Jingbin Hu, Luyu Wang, Wenjie Tian +7Text-to-Speech Speech Language Models
Shenzhen Pimei Technology Co., Ltd., Guangdong, China · School of Intelligence Science and Technology, Nanjing University, Suzhou, China · State Key Laboratory of Novel Software Technology, Nanjing University, Nanjing, China
Post-Training Zero-Shot TTS for Fine-Grained Emotion and Duration Control via Natural Language
Sep 10, 2026Lianru Gao, Yujie Guo, Yong QinTTS Synthesis Zero-Shot TTS
TMCC, College of Computer Science, Nankai University, Tianjin, China
Scalable Direction-Following TTS via Voice Impression-Guided Pseudo Triplet Construction
Sep 2, 2026Kenichi Fujita, Yusuke IjimaText-to-Speech TTS Synthesis
NTT, Inc., Japan
Diagnose, Then Refine: A Closed-Loop TTS System with AudioLLM-Guided Correction
Aug 29, 2026Zeyang Song, Tianchi Liu, Tianrui Wang +3TTS Synthesis Text-to-Speech
National University of Singapore · Tencent · LIGHTSPEED +4
ASR-Roundtrip Evaluation Can Mask Context- and Convention-Dependent Reading Errors in Chinese News TTS
Aug 11, 2026Shijun Luo, Lizhi WanASR Evaluation TTS Synthesis
NetEase Cloud Music, Hangzhou, China
Beyond Naturalness: Probing Automated Text-To-Speech Evaluators on Linguistically Grounded Dimensions
Aug 10, 2026Oluwanifemi Bamgbose, Simon Rosen, Jash Shah +6Audio-Language Model Evaluation Human Preference Evaluation
ServiceNow
DialectS2S: End-to-End Speech Dialogue Modeling for Low-Resource Chinese Dialects
Aug 8, 2026Yi Shu, Tianyu Peng, Yingzhuo Deng +5Spoken Dialogue Systems Speech Language Models
School of Artificial Intelligence, University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · Wuhan AI Research +1
Domain-Specific Evaluation of Text-to-Speech Systems: A Multi-Metric Benchmarking Study
Aug 3, 2026Ali Jafar, Amal Sarmad, Shifa Yousaf +1Speech Generation Evaluation TTS Evaluation
FAST School of Computing, National University of Computer and Emerging Sciences (FAST-NUCES), Lahore, Punjab, Pakistan
Faster IndexTTS-2: Accelerating and Streaming Autoregressive Zero-Shot Text-to-Speech Synthesis on GPUs
Jul 23, 2026Muyang Du, Shuang Yu, Junjie LaiTTS Synthesis Streaming TTS Synthesis
NVIDIA · Shanghai, China
ReGen: Hierarchical Multi-Prompt Representation Generation for Efficient Waveform Diffusion Models
Jul 10, 2026Sang-Hoon Lee, Ha-Yeong ChoiAudio Representation Learning Latent Diffusion Models
Department of Artificial Intelligence, Ajou University, Suwon, Korea · KT Corp., Seoul, Korea
Towards Digital Preservation of Efik: TTS for a Low-Resource African Language
Jul 5, 2026Offiong Bassey Edet, Emmanuel Oyo-Ita, Archibong Okon Archibong +2TTS Synthesis Speech Generation Evaluation
University of Cross River State, Nigeria · ML Collective · University of Calabar, Nigeria
Towards a Phonology-Informed Evaluation of Multilingual TTS
Jul 2, 2026Sneha Ray Barman, Neeraj Kumar Sharma, Shakuntala MahantaTTS Synthesis Speech Generation Evaluation
Centre for Linguistic Science & Technology, IIT Guwahati · Mehta Family School for Data Science & Artificial Intelligence, IIT Guwahati · Department of Humanities & Social Sciences, IIT Guwahati
Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis
Jul 1, 2026Zuda Yu, Qianhui Xu, Ting Chen +5Flow Matching Efficient Inference
Zuoyebang, China
LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish
Jun 30, 2026Nina Hosseini-Kivanani, Sandipana DowerahSpeech Processing Low-Resource TTS Synthesis
Radio T´el´evisioun L¨etzebuerg (RTL) & University of Luxembourg · Esch-sur-Alzette, Luxembourg · Tallinn University of Technology +1
Is Natural Always Appropriate? Investigating Naturalness and Appropriateness Across Different Domains for TTS Evaluation
Jun 30, 2026Dominika Woszczyk, Andreas Triantafyllopoulos, Jura Miniota +2TTS Synthesis Speech Generation Evaluation
Iconic, United Kingdom · Technische Universität München, Germany · KTH Royal Institute of Technology, Sweden +1
HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speech
Jun 26, 2026Sihang Nie, Xiaofen Xing, Rui Xing +5Reward Modeling Speech Prosody
South China University of Technology, China · Huya Inc., China · Tongyi Fun Team, Alibaba Group, China +1
Closing the Quality Gap in Low-Resource Text-to-Speech: LoRA Fine-Tuning of VoxCPM2 for Khmer and Korean
Jun 25, 2026Phannet Pov, Hyun Woo Park, Voneat Pen +3Low-Resource TTS Synthesis Low-Resource Language Processing
Department of Big Data, Chungbuk National University, Cheongju, South Korea · Institute of Digital Research and Innovation, Cambodia Academy of Digital Technology, Phnom Penh, Cambodia · Department of Management Information Systems, Chungbuk National University, Cheongju, South Korea +1
CrossAccent-TTS: Cross-Lingual Accent-Intensity Controllable Text-to-Speech via Disentangled Speaker and Accent Representations
Jun 24, 2026Ram Annamdevula, Ankit Tatawat, Ashishkumar P. Gudmalwar +2Disentangled Representation Learning TTS Synthesis
Media Analysis, Sony Research India
Sarashina2.2-TTS: Tackling Kanji Polyphony in Japanese Speech Generation via Data Scaling and Targeted Data Synthesis
Jun 24, 2026Lianbo Liu, Shiao Zhu, Kai Washizaki +10TTS Synthesis Data Augmentation
SB Intuitions
CN-NewsTTS Bench: a target-level automatic benchmark for raw-input Chinese news TTS pronunciation
Jun 23, 2026Shijun LuoSpeech Generation Evaluation TTS Evaluation
NetEase Cloud Music, Hangzhou, China
AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation
Jun 22, 2026Huadai Liu, Kaicheng Luo, Wen Wang +4Text-to-Audio Generation Flow-Based Generative Modeling
Hong Kong University of Science and Technology (HKUST) · Tongyi Fun Team, Alibaba Group
Bagpiper-TTS: Natural Language Guided Universal Speech Synthesis
Jun 22, 2026Jinchuan Tian, Haoran Wang, Siddhant Arora +6Controllable Speech Generation Text-to-Speech
Language Technologies Institute, Carnegie Mellon University · LY Corporation · NVIDIA Research

Oct 7, 2026J/K move · Enter open · S save

Training-Free Instruction TTS Gender Bias Calibration Using Model-Adaptive Steering

Kuan-Yu Chen, Yi-Cheng Lin, Jeng-Lin Li, Jian-Jiun Ding

AI Research Center, Inventec Corporation, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan

Text-to-Speech TTS Synthesis Representation Steering

Open paper AskPDF arXiv

Instruction text-to-speech (ITTS) systems systematically encode acoustic gender skews from descriptive style prompts, such as occupations or personas, even when demographic attributes are left unspecified. Calibrating the implicit gender distribution of the synthesized voices, across heterogeneous architectures and without model retraining or overriding explicit user prompts, is an open problem. In this work, we propose model-adaptive steering, a training-free bias calibration method that steers post-encoder conditioning representations using a group deviation vector paired with a coarse-to-fine strength search on a development set. A deterministic lexical gate bypasses intervention whenever explicit gender keywords are detected, preserving intended prompt semantics. Evaluated on a 12,800-prompt held-out benchmark across four ITTS models (three architectures), the proposed method reduces aggregate calibration error from 11.5--28.1 to 0.8--5.9 percentage points (e.g., shifting Parler-TTS Mini from 78.1% and PromptTTS++ from 27.3% female to 50.8--52.4%). Output rates stay within 0.9 pp across anchor set sizes at fixed operating points, while UTMOS decreases by at most 0.08 and WER degrades by at most 3.3 pp.