cs.SDApr 7, 2026

Controllable Singing Style Conversion with Boundary-Aware Information Bottleneck

Authors: Zhetao Hu, Yiquan Zhou, Wenyu Wang, Zhiyu Wu, Xin Gao, Jihua Zhu

Organizations: School of Software Engineering, Xi’an Jiaotong University, Xi’an, China · SYKI-SPEECH Team, Xi’an, China · Fudan University, Shanghai, China · Division of Music and Audio Union Wheatland Culture and Media Ltd., China

Abstract

This paper presents the submission of the S4 team to the Singing Voice Conversion Challenge 2025 (SVCC2025)-a novel singing style conversion system that advances fine-grained style conversion and control within in-domain settings. To address the critical challenges of style leakage, dynamic rendering, and high-fidelity generation with limited data, we introduce three key innovations: a boundary-aware Whisper bottleneck that pools phoneme-span representations to suppress residual source style while preserving linguistic content; an explicit frame-level technique matrix, enhanced by targeted F0 processing during inference, for stable and distinct dynamic style rendering; and a perceptually motivated high-frequency band completion strategy that leverages an auxiliary standard 48kHz SVC model to augment the high-frequency spectrum, thereby overcoming data scarcity without overfitting. In the official SVCC2025 subjective evaluation, our system achieves the best naturalness performance among all submissions while maintaining competitive results in speaker similarity and technique control, despite using significantly less extra singing data than other top-performing systems. Audio samples are available online.

Figures & tables

Explore similar work

CardsList
  1. Vibrato Expression Control for Singing Voice Conversion with Improving Independent Control

    Jun 15, 2026Joon-Seung Choi, Dong-Min Byun, Seong-Whan LeeVoice Conversion

  2. SRF-SVB: Style-Consistent Singing Voice Beautifying via Rectified Flow

    Sep 22, 2026Wenhui Li, Biao Dong, Liwei Hu +2Singing Voice SynthesisAudio Editing

  3. StyleStream: Real-Time Zero-Shot Voice Style Conversion

    Feb 23, 2026Yisi Liu, Nicholas Lee, Gopala AnumanchipalliZero-Shot Voice ConversionSpeech Processing