mlsanityData to 7 Oct 2026

Low-Latency Spell Correction for Japanese Music Search Queries

arXiv 2609.04262 ↗First posted 2 Sep 2026cs.SD cs.LG eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Spell correction for Japanese search queries presents unique challenges due to the co-existence of four writing scripts (Latin/romaji, hiragana, katakana, and kanji) and the distinct error patterns each script induces. We present a compact BART-based sequence-to-sequence model (3 encoder + 3 decoder layers) designed for low-latency spell correction of Japanese music search queries. The core contribution lies in a script-aware synthetic misspelling generation pipeline that produces realistic training data by combining keyboard-layout models (QWERTY and flick input), phonetic confusion priors mined from real query logs, voiced/unvoiced consonant alternations, and kana case errors. A key design decision is normalizing mixed-script catalog titles to a single canonical script before misspelling synthesis, which we show is critical for reducing model hallucinations. We train a custom byte-level BPE tokenizer on the target music catalog to handle all four scripts in a unified vocabulary. Experiments on a curated evaluation set show that our model achieves an exact-match accuracy of 41.09% and a character error rate (CER) of 11.62%, outperforming edit-distance baselines and achieving the lowest character error rate among all evaluated systems while maintaining sub-4ms inference latency on a single GPU. We further analyze performance across individual scripts and mixed-script queries, demonstrating the effectiveness of script-aware data augmentation through systematic ablation studies.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 15 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

8 of 15 references.

References · 8

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  4. 2017Synthetic and Natural Noise Both Break Neural Machine Translationcited by 304
  5. 2019Combating Adversarial Misspellings with Robust Word Recognitioncited by 162
  6. 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
  7. 2020Spelling Error Correction with Soft-Masked BERTcited by 90
  8. 2019GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errorscited by 22

Built on by

Not cited yet.