mlsanityData to 7 Oct 2026

Noise-Aware Named Entity Recognition for Historical VET Documents

arXiv 2601.00488 ↗First posted 1 Jan 2026cs.CL cs.IR cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper addresses Named Entity Recognition (NER) in the domain of Vocational Education and Training (VET), focusing on historical, digitized documents that suffer from OCR-induced noise. We propose a robust NER approach leveraging Noise-Aware Training (NAT) with synthetically injected OCR errors, transfer learning, and multi-stage fine-tuning. Three complementary strategies, training on noisy, clean, and artificial data, are systematically compared. Our method is one of the first to recognize multiple entity types in VET documents. It is applied to German documents but transferable to arbitrary languages. Experimental results demonstrate that domain-specific and noise-aware fine-tuning substantially increases robustness and accuracy under noisy conditions. We provide publicly available code for reproducible noise-aware NER in domain-specific contexts.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 64 references that are in the map. First posted on arXiv 1 Jan 2026.

Builds on

22 of 64 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  5. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  6. 2016Neural Architectures for Named Entity Recognitioncited by 548
  7. 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
  8. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  9. 2021OCR-free Document Understanding Transformercited by 400
  10. 2019Using Pre-Training Can Improve Model Robustness and Uncertaintycited by 373
  11. 2018Learning Word Vectors for 157 Languagescited by 279
  12. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
10 more
  1. 2023Overwriting Pretrained Bias with Finetuning Datacited by 32
  2. 2021JobBERT: Understanding Job Titles through Skillscited by 29
  3. 2020NAT: Noise-Aware Training for Robust Neural Sequence Labelingcited by 17
  4. 2019Robust Named Entity Recognition with Truecasing Pretrainingcited by 11
  5. 2023SkillGPT: a RESTful API service for skill extraction and standardization using a Large Language Modelcited by 11
  6. 2024Rethinking Skill Extraction in the Job Market Domain using Large Language Modelscited by 10
  7. 2021Empirical Error Modeling Improves Robustness of Noisy Neural Sequence Labelingcited by 8
  8. 2019Efficient, Lexicon-Free OCR using Deep Learningcited by 5
  9. 2021How Different Text-preprocessing Techniques Using The BERT Model Affect The Gender Profiling of Authorscited by 4
  10. 2021Robust Learning for Text Classification with Multi-source Noise Simulation and Hard Example Miningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.