cs.LGJun 22, 2026

BranchShine: Compact Raw-Audio-to-IPA Transcription with a RoPE E-Branchformer Encoder

Authors: Nikhil NavasSergio ChevtchenkoTalisson DamiaoSaeed Afshar

Organizations: 1International Centre for Neuromorphic Systems, Western Sydney University · 2Neurabuild

Abstract

Speech-to-IPA transcription is useful when the desired output is pronunciation rather than orthographic text, but competitive multilingual systems are often large and evaluation is sensitive to normalization choices. This paper presents BranchShine, a 33M-parameter raw-audio CTC recognizer with a lightweight convolutional front end and a 19-block RoPE E-Branchformer encoder. We find that BranchShine provides a compact and competitive operating point for IPA transcription under matched normalization and scoring. On a 16,660-utterance multilingual test set covering 41 language labels, BranchShine obtains 9.19% whitespace-insensitive IPA character error rate, compared with 9.78% for the 575.00M-parameter PhoneticXEUS baseline. A secondary child speech reading analysis shows a complementary operating profile: BranchShine is more conservative on incorrect readings, while Whisper-Medium is stronger on exact acceptance of correct readings. Overall, the results indicate that a compact raw-audio-to-IPA model can approach much larger baselines on character-level IPA transcription.

Explore similar work

CardsList
  1. Selective Augmentation: Improving Universal Automatic Phonetic Transcription via G2P Bootstrapping

    Apr 29, 2026Tobias Bystrich, Julia M. Pritzen, Christoph A. Schmidt +1Selective