Itgan at NADI 2026 shared task: Parameter-Efficient Whisper Adaptation for Robust, Mixed-Dialect and Code-Switched Arabic ASR
Organizations: Independent Researcher
Abstract
We describe the Itgan systems for the three ASR subtasks of NADI 2026, namely robust country-level ASR (1.1), mixed-dialect ASR (1.2), and Tunisian code-switched ASR (1.3). All three share one recipe, Whisper adapted with LoRA on consumer GPUs, and each was carried by a different addition to it. On 1.1, where the dialect label is given at test time, per-dialect specialists continued from a pooled adapter gave the largest gain, and the submitted system reached 57.1% country-average WER. A post-evaluation linear probe on frozen encoder features routes utterances without the label and recovers 44% of what oracle routing gives. On 1.2 the choice of base model mattered more than adapter capacity, and system combination helped only once we added a decorrelated member, reaching 46.7% WER. On 1.3 our system placed second at 14.49% WER with the lowest CER among the leading submissions, 5.38%. Its last 0.60 WER points came without further training, mostly from an exact weight-space average of independently trained runs, with ROVER voting adding the remainder. Every comparison carries a paired-bootstrap test, and we report eight directions that did not work.
Figures & tables
| Country | Backbone | Dev | Test WER |
|---|---|---|---|
| Mauritania | turbo + spec. | 77 | |
| Algeria | turbo + spec. | 72 | |
| Morocco | turbo + spec. | 60 | |
| Egypt | turbo + spec. | 58 | |
| Yemen | large-v3 | 63 | |
| Jordan | large-v3 | 44 |
| System | Trainable | WER |
|---|---|---|
| turbo , zero-shot | n/a | 60.04 |
| turbo + LoRA (narrow) | 6.6M | 56.54 |
| turbo + LoRA (wide) | 27.9M | 55.51 |
| large-v3 , zero-shot (int8) | n/a | 57.21 |
| large-v3 + LoRA (wide, 16) | 28.8M | 52.88 |
| large-v3 + LoRA (wide) | 57.7M | 51.76 |
| Validation (731) | Practice test (842) | Blind test (2,123) | ||||
|---|---|---|---|---|---|---|
| System | Trainable | WER | CER | WER | CER | WER / CER |
| Zero-shot whisper-large-v3 † | n/a | 85.00 | 59.84 | 87.57 | 64.40 | n/a |
| LoRA ( q,v ), 3k steps | 15.7M | 21.62 | 9.11 | 24.68 | 11.79 | n/a |
| LoRA (wide), 5k steps | 57.7M | 19.84 | 8.26 | 21.74 | 10.16 | n/a |
| + dropout 0.15, SpecAugment | 57.7M | 19.46 | 8.29 | 21.19 | 10.08 | 15.09 / 5.56 |
| + adapter soup ( ) | n/a | 17.19 | 6.60 | 20.14 | 9.51 | 14.55 / 5.40 |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Configuration | Country-average WER (%) |
|---|---|
| pooled adapter, greedy | 57.59 |
| + length guard | 56.58 |
| + beam 5 | 55.31 |
| all eight specialists + guard | 54.67 |
| + beam 5 | 53.55 |
| Comparison (validation) | WER | |
|---|---|---|
| q,v wide+reg | 99% | |
| wide wide+reg | 78% | |
| wide+reg soup ( ) | 97% | |
| wide+reg soup ( ) | 100% | |
| soup ( ) soup ( ) | 21% | |
| same-run pair two-seed pair | 100% |
| Country | WER | ||
|---|---|---|---|
| Mauritania | 1,600 | 100% | |
| Yemen | 1,183 | 100% | |
| Algeria | 726 | 100% | |
| Morocco | 1,600 | 99% | |
| Egypt | 1,600 | 99% | |
| UAE | 1,600 | 100% |
| Script | Ref. words | Share | Error |
|---|---|---|---|
| Arabic | 7,887 | 66.7% | 20.2% |
| Latin (Fr/En) | 3,946 | 33.3% | 12.5% |
| Country | Steps | Spec. | Control | Spec. only |
|---|---|---|---|---|
| Algeria | 300 | -3.1 | -0.4 | -2.7 |
| Egypt | 300 | -1.8 | -0.0 | -1.7 |
| Mauritania | 300 | -2.8 | +0.1 | -2.9 |
| Morocco | 300 | -2.2 | +0.6 | -2.8 |
| Jordan | 100 | -0.6 | +0.2 | -0.9 |
| Palestine | 100 | -1.1 | +0.2 | -1.3 |
| Spec. | Egy | Jor | Alg | UAE | Mor | Mau | Yem | Pal |
|---|---|---|---|---|---|---|---|---|
| Egy | -1.8 | +2.3 | -0.3 | +1.8 | +2.2 | +0.6 | +0.7 | +2.1 |
| Jor | +2.0 | -0.6 | +1.4 | +1.5 | +1.5 | +0.2 | +1.8 | +1.1 |
| Alg | +1.4 | +1.9 | -3.1 | +1.0 | +4.0 | +0.6 | +1.3 | +1.8 |
| UAE | +0.8 | +1.4 | -1.1 | -1.6 | +1.2 | +0.3 | -0.4 | +1.2 |
| Mor | +1.5 | +2.9 | +1.3 | +1.9 | -2.2 | +1.2 | +1.7 | +2.4 |
| Mau | +2.7 | +3.7 | +0.6 | +2.5 | +3.4 | -2.8 | +2.5 | +2.0 |
| System | Country-avg WER | |
|---|---|---|
| pooled adapter | 56.56 | — |
| soup of all eight | 56.31 | 99% |
| routed by the probe | 55.73 | 100% |
| oracle routing | 54.66 | 100% |