mlsanityData to 7 Oct 2026

Language corpora for the Dutch medical domain

arXiv 2604.25374 ↗First posted 28 Apr 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Background: Dutch medical corpora are scarce, limiting NLP development. Methods: We translated English datasets, identified medical text in generic corpora, and extracted open Dutch medical resources. Results: The resulting corpus comprises +- 36 billion tokens across the medical domain in about 105 million documents, freely available on Hugging Face. Conclusion: This work establishes the first large-scale Dutch medical language corpus for pre-training and downstream NLP tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 28 Apr 2026.

Builds on

17 of 26 references.

References · 17

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  4. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  5. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  6. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,104
  7. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  8. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 282
  9. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
  10. 2020A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languagescited by 131
  11. 2016De-identification of Patient Notes with Recurrent Neural Networkscited by 88
  12. 2020RobBERT: a Dutch RoBERTa-based Language Modelcited by 88
5 more
  1. 2024Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B Peoplecited by 38
  2. 2022BioLORD: Learning Ontological Representations from Definitions (for Biomedical Concepts and their Textual Descriptions)cited by 20
  3. 2025MIRIAD: Augmenting LLMs with millions of medical query-response pairscited by 8
  4. 2023BioLORD-2023: Semantic Textual Representations Fusing LLM and Clinical Knowledge Graph Insightscited by 7
  5. 2023Automatic Glossary of Clinical Terminology: a Large-Scale Dictionary of Biomedical Definitions Generated from Ontological Knowledgecited by 5

Built on by

Not cited yet.