cs.CLJul 17, 2025

Balalaika: Data-Centric, Prosody-Aware Annotation Pipeline for Russian Speech

Authors: Kirill Borodin, Nikita Vasiliev, Vasiliy Kudryavtsev, Maxim Maslov, Mikhail Gorodnichev, Grach Mkrtchian

Organizations: lab260, Moscow Technical University of Communications and Informatics, Russia · BitmanagerAI, UAE

Abstract

We introduce Balalaika, an open-source, data-centric pipeline for processing audio and producing prosody-aware annotations. It combines semantic VAD for context-preserving segmentation, multi-ASR ensembling with ROVER consensus decoding, while retaining optional word-level timestamps, followed by automatic quality and speaker-purity filtering. The text is further enriched with punctuation restoration, lexical stress and "\textipa{e}/\textipa{He}" normalization, and IPA phonemes. Using Balalaika, we build a 5.1k-hour multi-source Russian corpus with rich annotations, and show consistent gains under equalized training budgets for both speech denoising and TTS; ablations confirm complementary benefits of stress and punctuation and improved synthesis with stricter MOS filtering. The datasets are publicly available at \href{https://huggingface.co/collections/lab260/balalaika-dataset}{\underline{\textbf{HuggingFace}}}

Explore similar work

CardsList
  1. WorldSpeech: A Multilingual Speech Corpus from Around the World

    May 9, 2026Antonis Asonitis, Luca A. Lanzendörfer, Frédéric Berdoz +1Multilingual DataAccurate Transcription