MSpoofTTS: Multi-Resolution Spoof-Guided Inference for Discrete Speech Synthesis
Organizations: School of Computing, National University of Singapore, Singapore · Department of Statistics & Data Science, National University of Singapore, Singapore
Abstract
Neural codec language models enable high-quality discrete speech synthesis, yet their inference remains vulnerable to token-level artifacts and distributional drift that degrade perceptual realism. Rather than relying on preference optimization or retraining, we propose MSpoof-TTS, a training-free inference framework that improves zero-shot synthesis through multi-resolution spoof guidance. We introduce a Multi-Resolution Token-based Spoof Detection framework that evaluates codec sequences at different temporal granularities to detect locally inconsistent or unnatural patterns. We then integrate the spoof detectors into a hierarchical decoding strategy, progressively pruning low-quality candidates and re-ranking hypotheses. This discriminator-guided generation enhances robustness without modifying model parameters. Experiments validate the effectiveness of our framework for robust and high-quality codec-based speech generation. Audio samples and code are available.
Figures & tables
| LibriSpeech | LibriTTS | |||||||
| Inference Scheme | WER | SIM | NISQA | MOSNET | WER | SIM | NISQA | MOSNET |
| Ground Truth | 0.0337 | 0.915 | 4.620 | 4.5259 | 0.0430 | 0.904 | 4.593 | 4.4766 |
| Original | 0.0694 | 0.894 | 4.462 | 4.3418 | 0.0715 | 0.872 | 4.397 | 4.1879 |
| RAS | 0.0641 | 0.905 | 4.553 | 4.2772 | 0.0657 | 0.880 | 4.425 | 4.2565 |
| EAS | 0.0576 | 0.902 | 4.571 | 4.3298 | 0.0672 | 0.883 | 4.408 | 4.1937 |
| HierRAS | 0.0591 | 0.902 | 4.596 | 4.3486 | 0.0628 | 0.886 | 4.520 | 4.3277 |
| Methods | WER | SIM | NISQA | MOSNET |
|---|---|---|---|---|
| Original | 0.1654 | 0.871 | 4.459 | 3.8692 |
| RAS | 0.1572 | 0.820 | 4.477 | 3.8754 |
| EAS | 0.1433 | 0.876 | 4.465 | 3.9265 |
| HierRAS | 0.1702 | 0.802 | 4.496 | 3.9566 |
| HierEAS | 0.1531 | 0.877 | 4.513 | 3.9802 |
| Model | Resolution | AUC | Acc | Macro-F1 |
|---|---|---|---|---|
| Model 1 | 50 | 0.9199 | 0.8616 | 0.8180 |
| Model 2 | 25 | 0.8298 | 0.8034 | 0.6892 |
| Model 3 | 10 | 0.6842 | 0.7506 | 0.5336 |
| Model 4 | 50 25 | 0.8346 | 0.7935 | 0.5973 |
| Model 5 | 50 10 | 0.6914 | 0.7456 | 0.5952 |
TTS Synthesis
Text-to-speech synthesis converts written language into intelligible, natural-sounding speech with control over voice, prosody, style, and timing.
See all 275 papers