mlsanityData to 14 Oct 2026

Clinical XLNet: Modeling Sequential Clinical Notes and Predicting Prolonged Mechanical Ventilation

arXiv 1912.11975 ↗First posted 27 Dec 2019cs.CL cs.LGcited by 30

Not on the map. Why?

Abstract (arXiv)

Clinical notes contain rich data, which is unexploited in predictive modeling compared to structured data. In this work, we developed a new text representation Clinical XLNet for clinical notes which also leverages the temporal information of the sequence of the notes. We evaluated our models on prolonged mechanical ventilation prediction problem and our experiments demonstrated that Clinical XLNet outperforms the best baselines consistently.

Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Dec 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 8; 2022: 7; 2023: 8; 2024: 4; 2025: 3.

30 papers.

Sort:

By area:

  1. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  2. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
  3. 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
  4. 2023Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domaincited by 38
  5. 2021GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domaincited by 36
  6. 2021AMMU : A Survey of Transformer-based Biomedical Pretrained Language Modelscited by 32
  7. 2023The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRscited by 29
  8. 2023Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Healthcited by 25
  9. 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 23
  10. 2021Literature-Augmented Clinical Outcome Predictioncited by 20
  11. 2023Transformers in Healthcare: A Surveycited by 17
  12. 2022In-BoXBART: Get Instructions into Biomedical Multi-Task Learningcited by 16
18 more
  1. 2022Multimodal data matters: language model pre-training over structured and unstructured electronic health recordscited by 13
  2. 2022Hierarchical Label-wise Attention Transformer Model for Explainable ICD Codingcited by 13
  3. 2021Estimating Redundancy in Clinical Textcited by 10
  4. 2021Clinical Relation Extraction Using Transformer-based Modelscited by 9
  5. 2024MedINST: Meta Dataset of Biomedical Instructionscited by 7
  6. 2021Deep learning models are not robust against noise in clinical textcited by 6
  7. 2022Using Bottleneck Adapters to Identify Cancer in Clinical Notes under Low-Resource Constraintscited by 5
  8. 2022Deep Learning, Natural Language Processing, and Explainable Artificial Intelligence in the Biomedical Domaincited by 4
  9. 2021Interpretable bias mitigation for textual data: Reducing gender bias in patient notes while maintaining classification performancecited by 3
  10. 2024Contrastive Learning on Multimodal Analysis of Electronic Health Recordscited by 3
  11. 2024OrthoDoc: Multimodal Large Language Model for Assisting Diagnosis in Computed Tomographycited by 3
  12. 2022Using Selective Masking as a Bridge between Pre-training and Fine-tuningcited by 2
  13. 2023Clinical Note Owns its Hierarchy: Multi-Level Hypergraph Neural Networks for Patient-Level Representation Learningcited by 2
  14. 2023An Empirical Analysis for Zero-Shot Multi-Label Classification on COVID-19 CT Scans and Uncurated Reportscited by 2
  15. 2025Equitable Electronic Health Record Prediction with FAME: Fairness-Aware Multimodal Embeddingcited by 2
  16. 2025CURENet: Combining Unified Representations for Efficient Chronic Disease Predictioncited by 1
  17. 2023A Multi-View Joint Learning Framework for Embedding Clinical Codes and Text Using Graph Neural Networkscited by 0
  18. 2025Early Risk Prediction with Temporally and Contextually Grounded Clinical Language Processingcited by 0