mlsanityData to 7 Oct 2026

The SIGMORPHON 2022 Shared Task on Morpheme Segmentation

arXiv 2206.07615 ↗First posted 15 Jun 2022cs.CLcited by 25

Not on the map. Why?

Abstract (arXiv)

The SIGMORPHON 2022 shared task on morpheme segmentation challenged systems to decompose a word into a sequence of morphemes and covered most types of morphology: compounds, derivations, and inflections. Subtask 1, word-level morpheme segmentation, covered 5 million words in 9 languages (Czech, English, Spanish, Hungarian, French, Italian, Russian, Latin, Mongolian) and received 13 system submissions from 7 teams and the best system averaged 97.29% F1 score across all languages, ranging English (93.84%) to Latin (99.38%). Subtask 2, sentence-level morpheme segmentation, covered 18,735 sentences in 3 languages (Czech, English, Mongolian), received 10 system submissions from 3 teams, and the best systems outperformed all three state-of-the-art subword tokenization methods (BPE, ULM, Morfessor2) by 30.71% absolute. To facilitate error analysis and support any type of future studies, we released all system predictions, the evaluation script, and all gold standard datasets.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 29 of its 82 references that are in the map. First posted on arXiv 15 Jun 2022.

Builds on

29 of 82 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  7. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  8. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 632
  9. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
  10. 2019BPE-Dropout: Simple and Effective Subword Regularizationcited by 189
  11. 2021Charformer: Fast Character Transformers via Gradient-based Subword Tokenizationcited by 158
  12. 2021Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLPcited by 130
17 more
  1. 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 110
  2. 2017Comparative Study of CNN and RNN for Natural Language Processingcited by 81
  3. 2021Multi-view Subword Regularizationcited by 40
  4. 2020Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translationcited by 38
  5. 2022KinyaBERT: a Morphology-aware Kinyarwanda Language Modelcited by 27
  6. 2018How Much Does Tokenization Affect Neural Machine Translation?cited by 26
  7. 2017Linguistically Motivated Vocabulary Reduction for Neural Machine Translation from Turkish to Englishcited by 23
  8. 2022Improving Tokenisation by Alternative Treatment of Spacescited by 19
  9. 2018Morphological and Language-Agnostic Word Segmentation for NMTcited by 16
  10. 2021The Effectiveness of Morphology-aware Segmentation in Low-Resource Neural Machine Translationcited by 16
  11. 2021Joint Optimization of Tokenization and Downstream Modelcited by 15
  12. 2018Fortification of Neural Morphological Segmentation Models for Polysynthetic Minimal-Resource Languagescited by 13
  13. 2020Morfessor EM+Prune: Improved Subword Segmentation with Expectation Maximization and Pruningcited by 11
  14. 2022UniMorph 4.0: Universal Morphologycited by 11
  15. 2018Imitation Learning for Neural Morphological String Transductioncited by 10
  16. 2020Neural Polysynthetic Language Modellingcited by 7
  17. 2022Word Segmentation and Morphological Parsing for Sanskritcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 7; 2025: 9; 2026: 3.

25 papers.

Sort:

  1. 2023Analyzing Cognitive Plausibility of Subword Tokenizationcited by 30
  2. 2025MorphBPE: A Morpho-Aware Tokenizer Bridging Linguistic Complexity for Efficient LLM Training Across Morphologiescited by 23
  3. 2023Words, Subwords, and Morphemes: What Really Matters in the Surprisal-Reading Time Relationship?cited by 13
  4. 2024Lexically Grounded Subword Segmentationcited by 13
  5. 2023Effects of sub-word segmentation on performance of transformer language modelscited by 12
  6. 2024From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemescited by 11
  7. 2023MorphPiece : A Linguistic Tokenizer for Large Language Modelscited by 9
  8. 2025See the Text: From Tokenization to Visual Readingcited by 9
  9. 2023Biomedical Language Models are Robust to Sub-optimal Tokenizationcited by 8
  10. 2024Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challengecited by 8
  11. 2023CompoundPiece: Evaluating and Improving Decompounding Performance of Language Modelscited by 7
  12. 2025Interdisciplinary Research in Conversation: A Case Study in Computational Morphology for Language Documentationcited by 4
13 more
  1. 2025Understanding Subword Compositionality of Large Language Modelscited by 3
  2. 2024Revisiting subword tokenization: A case study on affixal negation in large language modelscited by 2
  3. 2024Recent advancements in computational morphology : A comprehensive surveycited by 2
  4. 2025Incorporating Domain Knowledge into Materials Tokenizationcited by 2
  5. 2025The Learning Dynamics of Subword Segmentation for Morphologically Diverse Languagescited by 2
  6. 2024Can a Neural Model Guide Fieldwork? A Case Study on Morphological Data Collectioncited by 1
  7. 2025Contextual morphologically-guided tokenization for Latin encoder modelscited by 1
  8. 2026Evaluating Morphological Plausibility of Subword Tokenization via Statistical Alignment with Morpho-Syntactic Featurescited by 1
  9. 2024Team Ryu's Submission to SIGMORPHON 2024 Shared Task on Subword Tokenizationcited by 0
  10. 2025Improving Low-Resource Morphological Inflection via Self-Supervised Objectivescited by 0
  11. 2025Morpheme Induction for Emergent Languagecited by 0
  12. 2026Comonadic Morphophonology: A Compositional Framework for Context-Dependent Morphological Rules in Finnishcited by 0
  13. 2026Subword Segmental BabyLMs: Learning to Tokenise for Sample-Efficient Pretrainingcited by 0