mlsanityData to 14 Oct 2026

Unveiling Factors for Enhanced POS Tagging: A Study of Low-Resource Medieval Romance Languages

arXiv 2506.17715 ↗First posted 21 Jun 2025cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Part-of-speech (POS) tagging remains a foundational component in natural language processing pipelines, particularly critical for historical text analysis at the intersection of computational linguistics and digital humanities. Despite significant advancements in modern large language models (LLMs) for ancient languages, their application to Medieval Romance languages presents distinctive challenges stemming from diachronic linguistic evolution, spelling variations, and labeled data scarcity. This study systematically investigates the central determinants of POS tagging performance across diverse corpora of Medieval Occitan, Medieval Spanish, and Medieval French texts, spanning biblical, hagiographical, medical, and dietary domains. Through rigorous experimentation, we evaluate how fine-tuning approaches, prompt engineering, model architectures, decoding strategies, and cross-lingual transfer learning techniques affect tagging accuracy. Our results reveal both notable limitations in LLMs' ability to process historical language variations and non-standardized spelling, as well as promising specialized techniques that effectively address the unique challenges presented by low-resource historical languages.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 21 Jun 2025.

Builds on

30 of 44 references.

References · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  7. 2017Beam Search Strategies for Neural Machine Translationcited by 232
  8. 2019Low-Resource Name Tagging Learned with Weakly Labeled Datacited by 32
  9. 2019A Large-Scale Comparison of Historical Text Normalization Systemscited by 25
  10. 2020Parameter Space Factorization for Zero-Shot Learning across Tasks and Languagescited by 22
  11. 2021Improving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noisecited by 19
  12. 2023Does Manipulating Tokenization Aid Cross-Lingual Transfer? A Study on POS Tagging for Non-Standardized Languagescited by 19
18 more
  1. 2020Reducing Confusion in Active Learning for Part-Of-Speech Taggingcited by 11
  2. 2018Part-of-Speech Tagging on an Endangered Language: a Parallel Griko-Italian Resourcecited by 10
  3. 2018Distant Supervision from Disparate Sources for Low-Resource Part-of-Speech Taggingcited by 8
  4. 2019A Grounded Unsupervised Universal Part-of-Speech Tagger for Low-Resource Languagescited by 7
  5. 2020Weakly Supervised POS Taggers Perform Poorly on Truly Low-Resource Languagescited by 7
  6. 2024ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Taskscited by 7
  7. 2021A Falta de Pan, Buenas Son Tortas: The Efficacy of Predicted UPOS Tags for Low Resource UD Parsingcited by 5
  8. 2022From FreEM to D'AlemBERT: a Large Corpus and a Language Model for Early Modern Frenchcited by 4
  9. 2022Graph-Based Multilingual Label Propagation for Low-Resource Part-of-Speech Taggingcited by 4
  10. 2021Corpus and Models for Lemmatisation and POS-tagging of Old Frenchcited by 3
  11. 2018The Best of Both Worlds: Lexical Resources To Improve Low-Resource Part-of-Speech Taggingcited by 2
  12. 2021How Low is Too Low? A Computational Perspective on Extremely Low-Resource Languagescited by 2
  13. 2022The Importance of Context in Very Low Resource Language Modelingcited by 2
  14. 2024Zero Resource Cross-Lingual Part Of Speech Taggingcited by 2
  15. 2025Modern Models, Medieval Texts: A POS Tagging Study of Old Occitancited by 2
  16. 2022Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Taggingcited by 1
  17. 2024Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical Transformerscited by 1
  18. 2024Recipe for Zero-shot POS Tagging: Is It Useful in Realistic Scenarios?cited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Lost in Translation? Exploring the Shift in Grammatical Gender from Latin to Occitancited by 0