Leveraging Transformer-Based Models for Predicting Inflection Classes of Words in an Endangered Sami Language
Not on the map. Why?
Abstract (arXiv)
This paper presents a methodology for training a transformer-based model to classify lexical and morphosyntactic features of Skolt Sami, an endangered Uralic language characterized by complex morphology. The goal of our approach is to create an effective system for understanding and analyzing Skolt Sami, given the limited data availability and linguistic intricacies inherent to the language. Our end-to-end pipeline includes data extraction, augmentation, and training a transformer-based model capable of predicting inflection classes. The motivation behind this work is to support language preservation and revitalization efforts for minority languages like Skolt Sami. Accurate classification not only helps improve the state of Finite-State Transducers (FSTs) by providing greater lexical coverage but also contributes to systematic linguistic documentation for researchers working with newly discovered words from literature and native speakers. Our model achieves an average weighted F1 score of 1.00 for POS classification and 0.81 for inflection class classification. The trained model and code will be released publicly to facilitate future research in endangered NLP.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 18 references that are in the map. First posted on arXiv 4 Nov 2024.
Builds on
8 of 18 references.
References · 8
- 2017Attention Is All You Needcited by 59,932
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2019An Exponential Learning Rate Schedule for Deep Learningcited by 121
- 2020Applying the Transformer to Character-level Transductioncited by 43
- 2020FST Morphology for the Endangered Skolt Sami Languagecited by 5
- 2021Neural Morphology Dataset and Models for Multiple Languages, from the Large to the Endangeredcited by 5
- 2020Ve'rdd. Narrowing the Gap between Paper Dictionaries, Low-Resource NLP and Community Involvementcited by 3
Built on by
Not cited yet.