mlsanityData to 7 Oct 2026

TiSpell: A Semi-Masked Methodology for Tibetan Spelling Correction covering Multi-Level Error with Data Augmentation

arXiv 2505.08037 ↗First posted 12 May 2025cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Multi-level Tibetan spelling correction addresses errors at both the character and syllable levels within a unified model. Existing methods focus mainly on single-level correction and lack effective integration of both levels. Moreover, there are no open-source datasets or augmentation methods tailored for this task in Tibetan. To tackle this, we propose a data augmentation approach using unlabeled text to generate multi-level corruptions, and introduce TiSpell, a semi-masked model capable of correcting both character- and syllable-level errors. Although syllable-level correction is more challenging due to its reliance on global context, our semi-masked strategy simplifies this process. We synthesize nine types of corruptions on clean sentences to create a robust training set. Experiments on both simulated and real-world data demonstrate that TiSpell, trained on our dataset, outperforms baseline models and matches the performance of state-of-the-art approaches, confirming its effectiveness.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 18 of its 43 references that are in the map. First posted on arXiv 12 May 2025.

Builds on

18 of 43 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2018Deep contextualized word representationscited by 2,285
  6. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  7. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  8. 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 420
  9. 2015Character-Aware Neural Language Modelscited by 129
  10. 2020Spelling Error Correction with Soft-Masked BERTcited by 90
  11. 2020Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correctioncited by 59
  12. 2020NeuSpell: A Neural Spelling Correction Toolkitcited by 31
6 more
  1. 2023Rethinking Masked Language Modeling for Chinese Spelling Correctioncited by 19
  2. 2016Robsut Wrod Reocginiton via semi-Character Recurrent Neural Networkcited by 18
  3. 2024TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generationcited by 13
  4. 2024AraSpell: A Deep Learning Approach for Arabic Spelling Correctioncited by 5
  5. 2018Spelling Error Correction Using a Nested RNN Model and Pseudo Training Datacited by 3
  6. 2022DPCSpell: A Transformer-based Detector-Purificator-Corrector Framework for Spelling Error Correction of Bangla and Resource Scarce Indic Languagescited by 3

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.