mlsanityData to 14 Oct 2026

fugashi, a Tool for Tokenizing Japanese in Python

arXiv 2010.06858 ↗First posted 14 Oct 2020cs.CLcited by 17

Not on the map. Why?

Abstract (arXiv)

Recent years have seen an increase in the number of large-scale multilingual NLP projects. However, even in such projects, languages with special processing requirements are often excluded. One such language is Japanese. Japanese is written without spaces, tokenization is non-trivial, and while high quality open source tokenizers exist they can be hard to use and lack English documentation. This paper introduces fugashi, a MeCab wrapper for Python, and gives an introduction to tokenizing Japanese.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 4; 2023: 5; 2024: 2; 2025: 3; 2026: 2.

17 papers.

Sort:

By area:

  1. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  2. 2023Revisiting non-English Text Simplification: A Unified Multilingual Benchmarkcited by 27
  3. 2023The taste of IPA: Towards open-vocabulary keyword spotting and forced alignment in any languagecited by 14
  4. 2025Confounding Factors in Relating Model Performance to Morphologycited by 14
  5. 2023Large Scale Multi-Lingual Multi-Modal Summarization Datasetcited by 12
  6. 2024Against All Odds: Overcoming Typology, Script, and Language Confusion in Multilingual Embedding Inversion Attackscited by 10
  7. 2025Parameterized Synthetic Text Generation with SimpleStoriescited by 10
  8. 2022Combining Static and Contextualised Multilingual Embeddingscited by 8
  9. 2024Large Language Models are Easily Confused: A Quantitative Metric, Security Implications and Typological Analysiscited by 7
  10. 2026IndexTTS 2.5 Technical Reportcited by 6
  11. 2022cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillationcited by 1
  12. 2022A Cascade Model for Argument Mining in Japanese Political Discussions: the QA Lab-PoliInfo-3 Case Studycited by 1
5 more
  1. 2022CinPatent: Datasets for Patent Classificationcited by 0
  2. 2023FewShotTextGCN: K-hop neighborhood regularization for few-shot learning on graphscited by 0
  3. 2023The Effects of Political Martyrdom on Election Results: The Assassination of Abecited by 0
  4. 2025CONCAP: Seeing Beyond English with Concepts Retrieval-Augmented Captioningcited by 0
  5. 2026TalkMatrix: Generating Character Dialogue that is Both Consistent and Diversecited by 0