TiSpell: A Semi-Masked Methodology for Tibetan Spelling Correction covering Multi-Level Error with Data Augmentation
Not on the map. Why?
Abstract (arXiv)
Multi-level Tibetan spelling correction addresses errors at both the character and syllable levels within a unified model. Existing methods focus mainly on single-level correction and lack effective integration of both levels. Moreover, there are no open-source datasets or augmentation methods tailored for this task in Tibetan. To tackle this, we propose a data augmentation approach using unlabeled text to generate multi-level corruptions, and introduce TiSpell, a semi-masked model capable of correcting both character- and syllable-level errors. Although syllable-level correction is more challenging due to its reliance on global context, our semi-masked strategy simplifies this process. We synthesize nine types of corruptions on clean sentences to create a robust training set. Experiments on both simulated and real-world data demonstrate that TiSpell, trained on our dataset, outperforms baseline models and matches the performance of state-of-the-art approaches, confirming its effectiveness.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 18 of its 43 references that are in the map. First posted on arXiv 12 May 2025.
Builds on
18 of 43 references.
References · 18
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2018Deep contextualized word representationscited by 2,285
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 420
- 2015Character-Aware Neural Language Modelscited by 129
- 2020Spelling Error Correction with Soft-Masked BERTcited by 90
- 2020Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correctioncited by 59
- 2020NeuSpell: A Neural Spelling Correction Toolkitcited by 31
6 more
- 2023Rethinking Masked Language Modeling for Chinese Spelling Correctioncited by 19
- 2016Robsut Wrod Reocginiton via semi-Character Recurrent Neural Networkcited by 18
- 2024TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generationcited by 13
- 2024AraSpell: A Deep Learning Approach for Arabic Spelling Correctioncited by 5
- 2018Spelling Error Correction Using a Nested RNN Model and Pseudo Training Datacited by 3
- 2022DPCSpell: A Transformer-based Detector-Purificator-Corrector Framework for Spelling Error Correction of Bangla and Resource Scarce Indic Languagescited by 3
Built on by
Citing papers per year: 2025: 2.
2 papers.