mlsanityData to 7 Oct 2026

Semantic Alignment across Ancient Egyptian Language Stages via Normalization-Aware Multitask Learning

arXiv 2603.24258 ↗First posted 25 Mar 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We study word-level semantic alignment across four historical stages of Ancient Egyptian. These stages differ in script and orthography, and parallel data are scarce. We jointly train a compact encoder-decoder model with a shared byte-level tokenizer on all four stages, combining masked language modeling (MLM), translation language modeling (TLM), sequence-to-sequence translation, and part-of-speech tagging under a task-aware loss with fixed weights and uncertainty-based scaling. To reduce surface divergence we add Latin transliteration and IPA reconstruction as auxiliary views. We integrate these views through KL-based consistency and through embedding-level fusion. We evaluate alignment quality using pairwise metrics, specifically ROC-AUC and triplet accuracy, on curated Egyptian-English and intra-Egyptian cognate datasets. Translation yields the strongest gains. IPA with KL consistency improves cross-branch alignment, while early fusion demonstrates limited efficacy. Although the overall alignment remains limited, the findings provide a reproducible baseline and practical guidance for modeling historical languages under real constraints. They also show how normalization and task design shape what counts as alignment in typologically distant settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 27 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

7 of 27 references.

References · 7

  1. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
  2. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  3. 2017A Survey Of Cross-lingual Word Embedding Modelscited by 142
  4. 2019Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Frameworkcited by 26
  5. 2019A Collaborative Ecosystem for Digital Coptic Studiescited by 2
  6. 2025A UD Treebank for Bohairic Copticcited by 1
  7. 2025A Case Study of Cross-Lingual Zero-Shot Generalization for Classical Languages in LLMscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Stoicheia: Character-Level Masked Diffusion for Ancient Greek Textual Restoration, Parsing, and Metrical Scansion
  2. 2025Nile-Chat: Egyptian Language Models for Arabic and Latin Scripts
  3. 2026Enhancing Multimodal Large Language Models for Ancient Chinese Character Evolution Analysis via Glyph-Driven Fine-Tuning
  4. 2024Alignment at Pre-training! Towards Native Alignment for Arabic LLMs
  5. 2026When Simpler Is Better: Evaluating Translation Pipelines for Medieval Latin Manuscripts
  6. 2025NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communities
  7. 2026LLM-to-Speech: A Synthetic Data Pipeline for Training Dialectal Text-to-Speech Models
  8. 2024Ancient Korean Archive Translation: Comparison Analysis on Statistical phrase alignment, LLM in-context learning, and inter-methodological approach