What Transfers Across Cuneiform? Script-Level Substrate and Language-Specific Regularities via Segmentation and Representation
Organizations: University of California, Berkeley · FactGrid · TokenWorks LLC
Abstract
Cuneiform recorded typologically unrelated languages for more than three millennia, raising a natural question: which of its statistical regularities are properties of the shared writing system, and which belong to individual languages? We answer this with two probe pairs targeting the same script-versus-language decomposition. The first compares two unsupervised, dictionary-free segmentation methods: transitional probability (TP), grounded in infant statistical-learning research, and Morfessor. To our knowledge, this is the first systematic evaluation of dictionary-free segmentation on cuneiform; the only prior published baseline relies on a hand-built dictionary (Max-Match, F1 = 0.74). Both our methods reach F1 > 0.97 within language (Morfessor reaches F1 > 0.99 on Akkadian and Sumerian), exceeding MaxMatch by more than 23 F1 points, but diverge sharply in cross-language transfer: TP holds F1 > 0.95 across all six language pairs, while Morfessor collapses to F1 = 0.27 from the 13K-token Elamite source. A learning curve and a Hittite stress test (34.7% foreign-script logograms, where TP drops 35 points and Morfessor only 8) further isolate the two underlying mechanisms. The second probe pair extends the same decomposition to representations: concatenating Unicode and Latin features improves classification in 11 of 12 morphosyntactic tasks (p < 0.01). We release CUNEI-TOOLS and a three-language benchmark.
Figures & tables
| AKK | SUX | ELX | HIT | |
| Tokens | 1,255,669 | 146,143 | 13,383 | 170,496 |
| Texts | 13,720 | 394 | 85 | 7,099 |
| Vocabulary | 123,001 | 31,906 | 13,189 | — |
| Lemmas | 28,953 | 3,765 | 748 | — |
| POS classes | 24 | 14 | 7 | — |
| Entity types | 11 | 8 | 3 | — |
| Method | Lang | F1 | P | R |
|---|---|---|---|---|
| TP | AKK | .971 | .946 | .997 |
| SUX | .972 | .946 | .999 | |
| ELX | .989 | .993 | .984 | |
| Morfessor | AKK | .997 | .997 | .996 |
| SUX | .993 | .997 | .990 | |
| ELX | .985 | .999 | .971 |
| TP (test F1) | Morfessor (test F1) | ||||||
|---|---|---|---|---|---|---|---|
| Train | AKK | SUX | ELX | AKK | SUX | ELX | Train tokens |
| AKK | .971 † | .967 | .992 | .997 † | .981 | .984 | 1.26M |
| SUX | .960 | .972 † | .993 | .859 | .995 † | .953 | 146K |
| ELX | .959 | .969 | .989 † | .304 | .267 | .985 † | 13K |
| Morfessor source | AKK | ELX |
|---|---|---|
| SUX @ 13K stream tokens | .595 .031 | .710 .091 |
| SUX @ 8,831 (ELX budget) | .542 .051 | .637 .077 |
| SUX full (Table 3 ) | .857 | .953 |
| ELX full (Table 3 ) | .304 | — |
| Task | Repr. | AKK | SUX | ELX |
|---|---|---|---|---|
| Unified | Latin | .693 | .847 | .636 |
| Unicode | .621 | .750 | .659 ∗∗ | |
| Concat | .712 ∗∗∗ | .870 ∗∗∗ | .666 ∗∗∗ |
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Task | Repr. | AKK | SUX | ELX |
|---|---|---|---|---|
| Gram. | Latin | .669 | .872 | .615 |
| Unicode | .657 ∗ | .832 | .634 ∗∗ | |
| Concat | .682 ∗∗∗ | .888 ∗∗∗ | .642 ∗∗∗ | |
| Ent. det. | Latin | .937 | .947 | .873 |
| Unicode | .839 | .896 | .876 | |
| Concat | .939 ∗∗∗ | .954 ∗∗∗ | .882 ∗∗∗ |
| Task | Lang | Best | Cat. | |
|---|---|---|---|---|
| Uni. | AKK | .373 | .412 | +.039 |
| SUX | .428 | .451 | +.023 | |
| ELX | .471 | .489 | +.018 | |
| Gram. | AKK | .516 | .513 | .003 |
| SUX | .630 | .654 | +.024 | |
| ELX | .465 | .469 | +.004 |
| Both | Both | Latin | Uni. | |
|---|---|---|---|---|
| correct | wrong | only | only | |
| AKK | 63.1% | 18.5% | 12.4% | 6.0% |
| SUX | 85.2% | 5.2% | 7.5% | 2.1% |
| ELX | 66.9% | 20.2% | 5.5% | 7.3% |
| Rare ( 26) | Frequent ( 26) | |
|---|---|---|
| AKK | 28.9% | 19.1% |
| SUX | 16.3% | 8.5% |
| Metric | Repr. | AKK | SUX | ELX |
|---|---|---|---|---|
| Silhouette | Latin | .100 | .071 | .037 |
| Unicode | .093 | .147 | .063 | |
| Morph. coh. | Latin | .764 | .791 | .639 |
| Unicode | .796 | .839 | .644 | |
| Graph agr. | Latin | .645 | .741 | .460 |
| Unicode | .512 | .638 | .452 |
| Task | Repr. | AKK | SUX | ELX |
|---|---|---|---|---|
| Unified | Latin | .571 | .671 | .564 |
| Unicode | .334 | .422 | .543 | |
| Concat | .548 | .650 | .571 | |
| Gram. | Latin | .542 | .728 | .529 |
| Unicode | .401 | .508 | .516 | |
| Concat | .529 | .705 | .534 |
| AKK | SUX | ELX | |
|---|---|---|---|
| 0.20 | .963 | .957 | .591 |
| 0.30 | .967 | .966 | .685 |
| 0.50 | .968 | .971 | .897 |
| 0.70 | .971 | .971 | .954 |
| 0.90 | .961 | .956 | .984 |
| 0.95 | .949 | .943 | .989 |
| corpusweight | ELX | SUX | AKK |
|---|---|---|---|
| 0.25 | .998 | .994 | .996 |
| 0.5 | .999 | .994 | .997 |
| 1.0 (paper) | .985 | .993 | .996 |
| 2.0 | .063 | .076 | .122 |
| 4.0 | .057 | .065 | .065 |
| Src | Tgt | cw=1.0 | cw=0.5 | TP |
|---|---|---|---|---|
| AKK | SUX | .981 | .982 | .967 |
| AKK | ELX | .984 | .997 | .992 |
| SUX | AKK | .857 | .977 | .960 |
| SUX | ELX | .953 | .993 | .993 |
| ELX | AKK | .304 | .765 | .959 |
| ELX | SUX | .267 | .713 | .969 |
| Source | Size | AKK | SUX | ELX |
|---|---|---|---|---|
| AKK | 5K | — | .615 | .826 |
| AKK | 13K | — | .743 | .955 |
| AKK | 25K | — | .826 | .973 |
| AKK | full | — | .981 | .984 |
| SUX | 5K | .482 | — | .554 |
| SUX | 13K | .595 | — | .710 |
| Training source | TP | Morf. | Tokens |
|---|---|---|---|
| Dictionary only | .994 | .727 | 68,251 |
| Utu-našu only (paper) | .989 | .985 | 6,759 |
| Combined | .995 | .991 | 75,010 |
| Tokens | BiLSTM (sup.) | TP | Morf. |
|---|---|---|---|
| 1,000 | .957 | .961 | .637 |
| 5,000 | .957 | .964 | .908 |
| 13,000 | .962 | .968 | .963 |
| 50,000 | .994 | .968 | .991 |
Cross-Lingual Transfer
Cross-lingual transfer enables models to apply knowledge or capabilities learned in one language to tasks in another.
See all 268 papers