IQRA 2026: Interspeech Challenge on Automatic Pronunciation Assessment for Modern Standard Arabic (MSA)
Authors: Yassine El Kheir, Amit Meghanani, Mostafa Shahin, Omnia Ibrahim, Shammur Absar Chowdhury, Nada AlMarwani, Youssef Elshahawy, Ahmed Ali
Organizations: DFKI & Technical University of Berlin, Germany · University of Sheffield, UK · University of New South Wales, Australia · Alexandria University, Egypt · QCRI, Qatar · Taibah University, Saudi Arabia · HUMAIN, Saudi Arabia
We present the findings of the second edition of the IQRA Interspeech Challenge, a challenge on automatic Mispronunciation Detection and Diagnosis (MDD) for Modern Standard Arabic (MSA). Building on the previous edition, this iteration introduces Iqra_Extra_IS26, a new dataset of authentic human mispronounced speech, complementing the existing training and evaluation resources. Submitted systems employed a diverse range of approaches, spanning CTC-based self-supervised learning models, two-stage fine-tuning strategies, and using large audio-language models. Compared to the first edition, we observe a substantial jump of 0.28 in F1-score, attributable both to novel architectures and modeling strategies proposed by participants and to the additional authentic mispronunciation data made available. These results demonstrate the growing maturity of Arabic MDD research and establish a stronger foundation for future work in Arabic pronunciation assessment.
Figures & tables
Split
Dataset
Type
Utts.
Hours
New
Train
Iqra_train
Real (MSA+Qur’an)
74k
∼ 79h
–
Train
Iqra_TTS
Synthetic
55.4k
∼ 52h
–
Train
Iqra_Extra_IS26
Real (mispronounced)
1,333
∼ 1.5h
✓
Test
QuranMB.v2
Real (annotated)
1,643
∼ 2.5h
–
Table 1: IQRA 2026 dataset summary. ✓= new this edition.
Rank
Team
F1 ↑
Prec. ↑
Recall ↑
Corr. ↑
TA ↑
FR ↓
FA ↓
CD ↑
PER ↓
1
whu-iasp
0.7201
0.7416
0.6998
0.9065
0.9825
0.0175
0.3002
0.8192
0.0365
2
UTokyo
0.7170
0.7325
0.7020
0.7269
0.9816
0.0184
0.2980
0.8142
0.0372
3
RAM
0.7157
0.6769
0.7593
0.9380
0.9739
0.0261
0.2407
0.7687
0.0405
4
SQZ_ww
0.6996
0.7004
0.6987
0.9436
0.9785
0.0215
0.3013
0.8433
0.0402
5
Najva
0.6894
0.7200
0.6613
0.9491
0.9815
0.0185
0.3387
0.8889
0.0400
6
Kalimat
0.6702
0.6666
0.6738
0.9379
0.9758
0.0242
0.3262
0.8508
0.0445
Table 2: Full leaderboard results on QuranMB.v2, sorted by F1-score. ↑ : higher is better; ↓ : lower is better. The organizer baseline (mHuBERT) is separated by rules. TA : True Accept rate (correct pronunciations correctly accepted); FR : False Reject rate (correct pronunciations incorrectly flagged as errors); FA : False Accept rate (mispronunciations incorrectly accepted as correct); CD : Correct Diagnosis rate (proportion of detected errors where the predicted phoneme matches the canonical form); Corr. : overall phoneme Correct Rate; PER : 1 - Accuracy. Precision and Recall are computed over correctly identified mispronunciations (True Rejects).
Accurate phoneme recognition is pivotal for mispronunciation detection and diagnosis (MDD) in modern standard Arabic (MSA), yet remains constrained by data scarcity and the synthetic-real domain gap. This work proposes a two-stage end-to-end framework. It integrates a pre-trained encoder with causal dilated temporal convolutional networks to preserve fine-grained phonetic variations. A hierarchical two-stage strategy first learns general mappings from native/synthetic corpora, then adapts to scarce real learner data to mitigate domain shift without over-correction. Prediction stability is further enhanced via multi-checkpoint ensemble inference with N-gram rescoring. Evaluated on the QuranMB.v2 test set, our system achieves an F1-score of 0.7201, a 63.1% relative improvement over baseline (0.4414). This performance ranks at the top of the IqraEval.2 Challenge, establishing a new state-of-the-art for low-resource MSA in MDD.
Jing Yang, Shuqing Zhang, Yongyi Deng +5
School of Electronic Information, Wuhan University, Wuhan Hubei, 430072, China · School of Computing and Information Systems, University of Melbourne, Melbourne, Australia · Northwestern Polytechnical University +1
Mispronunciation Detection and Diagnosis (MDD) requires modeling fine-grained acoustic deviations. However, current ASR-derived MDD systems often face inherent limitations. In particular, CTC-based models favor sequence-level alignments that neglect transient mispronunciation cues, while explicit canonical priors bias predictions toward intended targets. To address these bottlenecks, we propose a prompt-free framework decoupling acoustic fidelity from canonical guidance. First, we introduce CROTTC, an acoustic model enforcing monotonic, frame-level alignment to accurately capture pronunciation deviations. Second, we implicitly inject mispronunciation information via the IF strategy under the knowledge transfer principle. Experiments show CROTTC-IF achieves a 71.77% F1-score on L2-ARCTIC and 71.70% F1-score on the Iqra'Eval2 leaderboard. With empirical analysis, we demonstrate that decoupling acoustics from explicit priors provides highly robust MDD.
Haopeng Geng, Longfei Yang, Xi Chen +3
Graduate School of Engineering, The University of Tokyo, Japan
NADI 2026 is the seventh edition of the Nuanced Arabic Dialect Identification (NADI) shared task series and the second dedicated to multidialectal Arabic speech processing. This edition comprises five tasks and eight subtasks spanning Automatic Speech Recognition (ASR), Spoken Dialect Identification (SDID), Text-to-Speech (TTS), Spoken Language Translation (SLT), and Spoken Language Understanding (SLU). NADI 2026 emphasizes realistic evaluation through low-bandwidth, mixed-dialect, code-switched, out-of-domain, and zero-shot settings, while introducing TTS, SLT, and SLU to the series for the first time. The shared task attracted 21 participating teams from at least 13 countries, with 48 test-phase submissions and 14 submitted system-description papers. Results show that out-of-domain generalization remains a major bottleneck and highlight the effectiveness of recent Arabic-specialized speech models, multimodal dialect identification approaches, and ensemble methods. Overall, NADI 2026 provides a broader and more challenging benchmark for robust Arabic dialect speech processing.
Peter Sullivan, Bashar Talafha, Ahmed Ashraf +11
The University of British Columbia · King Fahd University of Petroleum & Minerals · Avignon Université +4