cs.CLMar 23, 2026

DATASHI: A Parallel English-Tashlhiyt Corpus for Orthography Normalization and Low-Resource Language Processing

Authors: Nasser-Eddine Monir, Zakaria Baou

Organizations: Université de Lorraine, CNRS, Inria, LORIA, F-54000 Nancy, France · ISIMA, Université Clermont Auvergne, 63178 Aubière, France

Abstract

DATASHI is a new parallel English-Tashlhiyt corpus that fills a critical gap in computational resources for Amazigh languages. It contains 5,000 sentence pairs, including a 1,500-sentence subset with expert-standardized and non-standard user-generated versions, enabling systematic study of orthographic diversity and normalization. This dual design supports text-based NLP tasks - such as tokenization, translation, and normalization - and also serves as a foundation for read-speech data collection and multimodal alignment. Comprehensive evaluations with state-of-the-art Large Language Models (GPT-5, Claude-Sonnet-4.5, Gemini-2.5-Pro, Mistral, Qwen3-Max) show clear improvements from zero-shot to few-shot prompting, with Gemini-2.5-Pro achieving the lowest word and character-level error rates and exhibiting robust cross-lingual generalization. A fine-grained analysis of edit operations - deletions, substitutions, and insertions - across phonological classes (geminates, emphatics, uvulars, and pharyngeals) further highlights model-specific sensitivities to marked Tashlhiyt features and provides new diagnostic insights for low-resource Amazigh orthography normalization.

Figures & tables

Explore similar work

CardsList
  1. TajPersLexon: A Tajik-Persian Lexical Resource and Hybrid Model for Cross-Script Low-Resource NLP

    May 7, 2026Mullosharaf K. ArabovLow-Resource Language ProcessingCross-Lingual Transfer

  2. NepTam: A Nepali-Tamang Parallel Corpus and Baseline Machine Translation Experiments

    Mar 14, 2026Rupak Raj Ghimire, Bipesh Subedi, Balaram Prasain +7Low-Resource MTMachine Translation