mlsanityData to 7 Oct 2026

Taxonomic Loss for Morphological Glossing of Low-Resource Languages

arXiv 2308.15055 ↗First posted 29 Aug 2023cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Morpheme glossing is a critical task in automated language documentation and can benefit other downstream applications greatly. While state-of-the-art glossing systems perform very well for languages with large amounts of existing data, it is more difficult to create useful models for low-resource languages. In this paper, we propose the use of a taxonomic loss function that exploits morphological information to make morphological glossing more performant when data is scarce. We find that while the use of this loss function does not outperform a standard loss function with regards to single-label prediction accuracy, it produces better predictions when considering the top-n predicted labels. We suggest this property makes the taxonomic loss function useful in a human-in-the-loop annotation setting.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 23 references that are in the map. First posted on arXiv 29 Aug 2023.

Builds on

5 of 23 references.

References · 5

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2017Decoupled Weight Decay Regularizationcited by 1,722
  3. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  4. 2020How Can We Accelerate Progress Towards Human-like Linguistic Generalization?cited by 114
  5. 2022MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learningcited by 12

Built on by

Not cited yet.