Automatic Speech Recognition for the Basaà Language: A Low-Resource Approach
Authors: Sophie Gertrude Ngo Mock, Charles Moudina Varmantchaonala, Paul Dayang, Jean Michel Nlong, Christopher Gies
Organizations: Department of Mathematics and Computer Science, Faculty of Science, University of Ngaoundere, Ngaoundere, 454, Cameroon · Institute for Physics, Faculty V, Carl von Ossietzky University of Oldenburg, 26129 Oldenburg, Germany
The rapid advancement of Artificial Intelligence (AI) and Natural Language Processing (NLP) has revolutionized the way humans interact with machines. Among the most impactful developments is Automatic Speech Recognition (ASR), which enables computers to convert spoken language into text. Systems such as those built on deep neural networks, transformer architectures, and self-supervised learning have achieved near-human performance for well-resourced languages such as English and French. Yet, these advances have disproportionately benefited a small fraction of the world's languages.
Figures & tables
Fig. 1 : An overview of the regions of Cameroon where the Basaà language is spoken, adapted from [ 7 ] .
Vowel
Short Form
Meaning
Long Form
Meaning
I
/i/
tí
to give
tíí
to touch
U
/u/
hú
audacity
húú
to return
E
/e/
é
to clear land
péé
viper
O
/o/
só
antelope
sòò
to hide
E
/E/
é
tree
EE
to cry
A
/a/
bà
to skin
bàà
to filter
TABLE I : Short/long vowel oppositions in Basaà [ 5 ]
Fig. 2 : End-to-end ASR pipeline for the Basaà language — Fine-tuned XLS-R-300M.
Epoch
Train Loss
Val. Loss
WER (Val.)
500
1.3005
0.7516
93.77%
1000
0.5123
0.2769
60.90%
1500
0.3527
0.2222
52.34%
2000
0.2750
0.2069
50.12%
2500
0.2272
0.1727
43.29%
3000
0.1910
0.1617
40.54%
TABLE II : Evolution of WER on the validation set during training
Time (sec.)
WER
Reference
Predicted
Error type
1
3.9
0.200
mudaa a ék ndap libii
mudaa a yék ndap libii
Char. substitution (é → yé)
2
4.0
0.375
u ntop bé nok maéba
u ntop bénok mayéba
Missing space + vowel change
3
3.9
0.000
men me nlok lipondo li malép
men me nlok lipondo li malép
Perfect transcription
4
3.3
0.000
me nnek bé nye
me nnek bé nye
Perfect transcription
5
3.8
0.500
bajo sañ ba mbébna
bajosañ ba mbébna
Missing word boundary
6
3.0
0.000
nyañ a yé malét
nyañ a yé malét
Perfect transcription
TABLE III : Sample transcriptions from the test set
Automatic speech recognition (ASR) for low-resource languages remains a major challenge. Sinhala, the primary language of Sri Lanka with about 16 million speakers, illustrates the difficulty: agglutinative morphology, a 54-phoneme inventory, subject-object-verb (SOV) syntax and scarce annotated speech data limit both conventional and modern ASR systems. This paper presents the first critical review of Sinhala ASR research, tracing its development from Hidden Markov Models (HMMs) through deep neural networks to self-supervised pre-trained models such as wav2vec 2.0, XLS-R, Whisper and Massively Multilingual Speech (MMS). We compare existing Sinhala systems with related low-resource ASR work on Tamil, Malayalam and Hindi in terms of architecture, training data, word error rate (WER) and robustness to real-world acoustic conditions, and we assess self-supervised and transfer learning as responses to scarce labeled data. We show that most reported WERs are not directly comparable because they differ in corpus, data split and scoring, and that the only controlled comparison in the literature attributes an 18.1% relative WER reduction to corpus correction alone. We also discuss context-aware ASR that draws on phonological, syntactic and semantic knowledge. We identify six research gaps: (1) the lack of large annotated corpora covering multiple dialects and acoustic conditions; (2) weak contextual modeling of Sinhala morphosyntax; (3) high WER in real-world conditions; (4) the absence of standardized benchmarks; (5) the lack of parameter-efficient fine-tuning studies; and (6) the absence of annotated code-switched Sinhala-English speech resources. We outline a research agenda to address these gaps, intended as a roadmap for researchers working on Sinhala and other morphologically rich languages.
MSc in Data Science and Artificial Intelligence Department of Computer Science & Engineering University of Moratuwa, Sri Lanka · University of Moratuwa, Sri Lanka
Large language models (LLMs) have driven substantial advances in speech language models (SpeechLMs), yielding strong performance in automatic speech recognition (ASR) under high-resource conditions. However, existing benchmarks predominantly focus on high-resource languages, leaving the ASR behavior of SpeechLMs in low-resource languages insufficiently understood. This gap is critical, as practical ASR systems must reliably support low-resource languages and generalize across diverse language families, and it directly hinders the deployment of SpeechLM-based ASR in real-world multilingual scenarios. As a result, it is essential to evaluate SpeechLMs on low-resource languages to ensure their generalizability across different language families. To address this problem, we propose LoASR-Bench, a comprehensive benchmark designed to evaluate low-resource automatic speech recognition (ASR) of the latest SpeechLMs across diverse language families. LoASR-Bench comprises 25 languages from 9 language families, featuring both Latin and non-Latin scripts, enabling cross-linguistic and cross-script assessment of ASR performance of current SpeechLMs. Experimental results highlight the limitations of the latest SpeechLMs in handling real-world low-resource languages.
Jianan Chen, Xiaoxue Gao, Tatsuya Kawahara +1
Kyoto University, Kyoto, Japan · Institute for Infocomm Research, Agency for Science, Technology and Research, Singapore
Telephony conversations worldwide are conducted over narrow-band channels and are often spontaneous and colloquial in nature. This paper evaluates the performance of widely used foundational automatic speech recognition (ASR) models -- both open-source and commercial -- on narrow-band conversations in Hindi, a low-resource language, and Indian-accented English, a low-resource accent. We first assess these models in a zero-shot setting and find that their performance remains suboptimal across the board. Highlighting the challenges faced by ASR models in narrow-band and low-resource language scenarios, we further investigate the impact of fine-tuning open-source models using a limited set of real-life annotated recordings. Our findings indicate that while fine-tuning provides some improvements, its effectiveness varies across languages and accents, largely influenced by the amount of data encountered during pretraining