# Parser agreement and disagreement in L2 Korean UD: Implications for human-in-the-loop annotation

arXiv: https://arxiv.org/abs/2605.06625 · HTML: https://mlsanity.com/paper/2605.06625/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 6 of its 38 references that are in the map.
- First posted on arXiv 7 May 2026.

## Builds on (most cited first, 6 of 6)

- [Stanza: A Python Natural Language Processing Toolkit for Many Human Languages](https://mlsanity.com/paper/2003.07082/) (2020)
- [Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing](https://mlsanity.com/paper/2101.03289/) (2021)
- [What to do about non-standard (or non-canonical) language in NLP](https://mlsanity.com/paper/1608.07836/) (2016)
- [Universal Dependencies for Learner English](https://mlsanity.com/paper/1605.04278/) (2016)
- [Second language Korean Universal Dependency treebank v1.2: Focus on data augmentation and annotation scheme refinement](https://mlsanity.com/paper/2503.14718/) (2025)
- [UD-KSL Treebank v1.3: A semi-automated framework for aligning XPOS-extracted units with UPOS tags](https://mlsanity.com/paper/2506.09009/) (2025)

## Abstract (arXiv)

We propose a simplified human-in-the-loop workflow for second language (L2) Korean morphosyntactic annotation by leveraging agreement between two domain-adapted parsers. We first evaluate whether parser agreement can serve as a proxy for annotation correctness by comparing it with independent human judgments. The results show strong correspondence between parser and human judgments, supporting the feasibility of semi-automatic L2-Korean UD annotation. Further analysis demonstrates that parser disagreements cluster in linguistically predictable domains such as grammatical-relation distinctions and clause-boundary ambiguity. While many disagreement cases are tractable for iterative model refinement, others reflect deeper representational challenges inherent in parsing and tagging L2-Korean corpora.