Arabic Morphosyntactic Tagging and Dependency Parsing with Large Language Models
Not on the map. Why?
Abstract (arXiv)
LLMs perform strongly across NLP, but their ability to produce explicit grammatical analyses remains unclear. Arabic provides a challenging testbed due to its rich morphology and orthographic ambiguity, which create strong morphology-syntax interactions. We present a unified evaluation of LLMs on Arabic morphosyntactic tagging and dependency parsing, covering pre-tokenized, raw-text, and cascaded settings. We compare zero-shot prompting with retrieval-based in-context learning. Relevant demonstrations substantially improve performance. The strongest LLMs approach supervised tagging and parsing systems; however, they require substantial annotated data for demonstration retrieval and considerable computational resources. We make all code and data used in this paper publicly available.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 67 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
18 of 67 references.
References · 18
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
- 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 269
- 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 118
- 2022Prompting Language Models for Linguistic Structurecited by 39
- 2023Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigationcited by 22
- 2024Evaluating Morphological Compositional Generalization in Large Language Modelscited by 16
- 2021Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its Dialectscited by 14
- 2024Can we teach language models to gloss endangered languages?cited by 14
6 more
- 2019Joint Diacritization, Lemmatization, Normalization, and Fine-Grained Morphological Taggingcited by 12
- 2013LDC Arabic Treebanks and Associated Corpora: Data Divisions Manualcited by 11
- 2019Adversarial Multitask Learning for Joint Multi-Feature and Multi-Dialect Morphological Modelingcited by 9
- 2025Self-Correction Makes LLMs Better Parserscited by 4
- 2025Better Benchmarking LLMs for Zero-Shot Dependency Parsingcited by 2
- 2025Step-by-step Instructions and a Simple Tabular Output Format Improve the Dependency Parsing Accuracy of LLMscited by 2
Built on by
Not cited yet.