Dynamic Block-Online Streaming ASR for Low-Resource Agglutinative Code-Switching Speech with Morphology-Aware Evaluation
Organizations: Apurba NSU R&D Lab, North South University, Dhaka, Bangladesh · Apurba Technologies, Dhaka, Bangladesh
Abstract
Low-resource, agglutinative languages challenge low-latency ASR, as fixed lookahead windows fail when grapheme order diverges, suffixes cross code-switch boundaries, or code-switching data is imbalanced. We present the first comprehensive study of streaming ASR for intra-sentential Bangla-English code-switching, identifying a mismatch between strict causal streaming and long-range morphological dependencies. We introduce a Dynamic Block-Online framework with VAD-aligned inference that balances semantics, latency, and context, enabling global bidirectional attention to preserve morphological integrity. To mitigate data scarcity, we propose Script-Anchored Loanword Injection, augmenting training text with English loanwords to model phonotactic transitions. We introduce CS-WER to diagnose switch, root, and suffix errors, and show that flexible latency budgets enhance recognition of agglutinative and mixed-language speech, with successful transfer to menstrual-medical domains.
Figures & tables
| Model | Data | w | Common Voice | ||
| CER | WER | CS-WER | |||
| Whisper Offline | |||||
| Largev3 [ 1 ] | - | Full | - | 40.30 | .94/.96/.97 |
| Largev2 [ 1 ] | - | Full | - | 62.31 | .98/.94/.99 |
| Others Offline | |||||
| MBNSpeech [ 16 ] | - | Full | 11.44 | 42.3 | 1/1/1 |
Code-Switching Speech Recognition
Code-switching speech recognition transcribes speech that shifts between languages, preserving words, language boundaries, and writing systems.
See all 26 papers