Bespoke Large Language Models for Digital Triage Assistance in Mental Health Care
Not on the map. Why?
Abstract (arXiv)
Contemporary large language models (LLMs) may have utility for processing unstructured, narrative free-text clinical data contained in electronic health records (EHRs) -- a particularly important use-case for mental health where a majority of routinely-collected patient data lacks structured, machine-readable content. A significant problem for the the United Kingdom's National Health Service (NHS) are the long waiting lists for specialist mental healthcare. According to NHS data, in each month of 2023, there were between 370,000 and 470,000 individual new referrals into secondary mental healthcare services. Referrals must be triaged by clinicians, using clinical information contained in the patient's EHR to arrive at a decision about the most appropriate mental healthcare team to assess and potentially treat these patients. The ability to efficiently recommend a relevant team by ingesting potentially voluminous clinical notes could help services both reduce referral waiting times and with the right technology, improve the evidence available to justify triage decisions. We present and evaluate three different approaches for LLM-based, end-to-end ingestion of variable-length clinical EHR data to assist clinicians when triaging referrals. Our model is able to deliver triage recommendations consistent with existing clinical practices and it's architecture was implemented on a single GPU, making it practical for implementation in resource-limited NHS environments where private implementations of LLM technology will be necessary to ensure confidential clinical data is appropriately controlled and governed.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 28 Mar 2024.
Builds on
20 of 43 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 487
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2018Explainable Prediction of Medical Codes from Clinical Textcited by 231
8 more
- 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 67
- 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
- 2022PLM-ICD: Automatic ICD Coding with Pretrained Language Modelscited by 49
- 2023Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Studycited by 48
- 2021Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integrationcited by 43
- 2022Clinical Prompt Learning with Frozen Language Modelscited by 19
- 2020Med7: a transferable clinical natural language processing model for electronic health recordscited by 15
- 2021Estimating Redundancy in Clinical Textcited by 10
Built on by
Citing papers per year: 2025: 1.
1 paper.