cs.CLMar 25, 2026

Semantic Alignment across Ancient Egyptian Language Stages via Normalization-Aware Multitask Learning

Authors: He Huang

Organizations: Institut für Ägyptologie und Koptologie, Ludwig-Maximilians-Universität München, Katharina-von-Bora-Straße 10, 80333 München, Germany

Abstract

We study word-level semantic alignment across four historical stages of Ancient Egyptian. These stages differ in script and orthography, and parallel data are scarce. We jointly train a compact encoder-decoder model with a shared byte-level tokenizer on all four stages, combining masked language modeling (MLM), translation language modeling (TLM), sequence-to-sequence translation, and part-of-speech tagging under a task-aware loss with fixed weights and uncertainty-based scaling. To reduce surface divergence we add Latin transliteration and IPA reconstruction as auxiliary views. We integrate these views through KL-based consistency and through embedding-level fusion. We evaluate alignment quality using pairwise metrics, specifically ROC-AUC and triplet accuracy, on curated Egyptian-English and intra-Egyptian cognate datasets. Translation yields the strongest gains. IPA with KL consistency improves cross-branch alignment, while early fusion demonstrates limited efficacy. Although the overall alignment remains limited, the findings provide a reproducible baseline and practical guidance for modeling historical languages under real constraints. They also show how normalization and task design shape what counts as alignment in typologically distant settings.

Figures & tables

Explore similar work

CardsList
  1. Scaling Unsupervised Word Alignment to Documents via Structural Constraints

    Aug 21, 2026Michelle Wastl, Jannis Vamvas, Rico Sennrich

  2. Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders

    Mar 19, 2026Yana Veitsman, Yihong Liu, Hinrich SchützeCross-Lingual Representation AlignmentCross-Lingual Transfer

  3. From transcription to semantic corpus analysis: unsupervised learning of sentence representations for ancient languages

    Jul 27, 2026Th{é}otime de la SelleSemantic Textual SimilaritySentence Embeddings