cs.CLJun 10, 2026

UR-BERT: Scaling Text Encoders for Massively Multilingual TTS Through Universal Romanization and Speech Token Prediction

Authors: Sangmin LeeEekgyun AhnWoongjib ChoiHong-Goo Kang

Organizations: Dept. of Electrical and Electronic Engineering, Yonsei University, Seoul, South Korea

Abstract

We propose UR-BERT, a Romanized transcription-based text-to-speech (TTS) encoder for massively multilingual TTS systems. Conventional grapheme-to-phoneme (G2P)-based approaches are limited to around 100 languages due to the availability of reliable G2P resources. In contrast, UR-BERT scales to 495 languages by unifying diverse writing systems into a shared Romanization representation. To further enhance phonetic fidelity and text-speech alignment, we introduce a speech token prediction objective during training, which encourages the encoder to learn speech-aware phonetic representations in a data-efficient manner. Experiments show that TTS systems built on UR-BERT consistently outperform recent text encoder baselines across a wide range of languages and resource conditions, and demonstrate strong generalization to unseen languages.

Explore similar work

CardsList
  1. DunbaaBERT: From Sacrifice to Semantics

    May 26, 2026Iffat Maab, Waleed Jamil, Raphael SchmittBert-Based Models