Transparency-First Medical Language Models: Datasheets, Model Cards, and End-to-End Data Provenance for Clinical NLP
Not on the map. Why?
Abstract (arXiv)
We introduce TeMLM, a set of transparency-first release artifacts for clinical language models. TeMLM unifies provenance, data transparency, modeling transparency, and governance into a single, machine-checkable release bundle. We define an artifact suite (TeMLM-Card, TeMLM-Datasheet, TeMLM-Provenance) and a lightweight conformance checklist for repeatable auditing. We instantiate the artifacts on Technetium-I, a large-scale synthetic clinical NLP dataset with 498,000 notes, 7.74M PHI entity annotations across 10 types, and ICD-9-CM diagnosis labels, and report reference results for ProtactiniumBERT (about 100 million parameters) on PHI de-identification (token classification) and top-50 ICD-9 code extraction (multi-label classification). We emphasize that synthetic benchmarks are valuable for tooling and process validation, but models should be validated on real clinical data prior to deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 54 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
21 of 54 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2018Datasheets for Datasetscited by 1,371
- 2018Model Cards for Model Reportingcited by 1,068
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
9 more
- 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 364
- 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2018Explainable Prediction of Medical Codes from Clinical Textcited by 231
- 2015Characterizing Concept Driftcited by 93
- 2016De-identification of Patient Notes with Recurrent Neural Networkscited by 88
- 2021Does the Magic of BERT Apply to Medical Code Assignment? A Quantitative Studycited by 39
Built on by
Not cited yet.