Taxonomic Loss for Morphological Glossing of Low-Resource Languages
Not on the map. Why?
Abstract (arXiv)
Morpheme glossing is a critical task in automated language documentation and can benefit other downstream applications greatly. While state-of-the-art glossing systems perform very well for languages with large amounts of existing data, it is more difficult to create useful models for low-resource languages. In this paper, we propose the use of a taxonomic loss function that exploits morphological information to make morphological glossing more performant when data is scarce. We find that while the use of this loss function does not outperform a standard loss function with regards to single-label prediction accuracy, it produces better predictions when considering the top-n predicted labels. We suggest this property makes the taxonomic loss function useful in a human-in-the-loop annotation setting.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 23 references that are in the map. First posted on arXiv 29 Aug 2023.
Builds on
5 of 23 references.
References · 5
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2020How Can We Accelerate Progress Towards Human-like Linguistic Generalization?cited by 114
- 2022MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learningcited by 12
Built on by
Not cited yet.