Large Language Model as a Universal Clinical Multi-task Decoder
Not on the map. Why?
Abstract (arXiv)
The development of effective machine learning methodologies for enhancing the efficiency and accuracy of clinical systems is crucial. Despite significant research efforts, managing a plethora of diversified clinical tasks and adapting to emerging new tasks remain significant challenges. This paper presents a novel paradigm that employs a pre-trained large language model as a universal clinical multi-task decoder. This approach leverages the flexibility and diversity of language expressions to handle task topic variations and associated arguments. The introduction of a new task simply requires the addition of a new instruction template. We validate this framework across hundreds of tasks, demonstrating its robustness in facilitating multi-task predictions, performing on par with traditional multi-task learning and single-task learning approaches. Moreover, it shows exceptional adaptability to new tasks, with impressive zero-shot performance in some instances and superior data efficiency in few-shot scenarios. This novel approach offers a unified solution to manage a wide array of new and emerging tasks in clinical applications.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 18 Jun 2024.
Builds on
23 of 37 references.
References · 23
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2017A Survey on Multi-Task Learningcited by 838
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2017Multitask learning and benchmarking with clinical time series datacited by 287
- 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 234
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
- 2019Set Functions for Time Seriescited by 137
- 2019MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-IIIcited by 121
- 2023Large Language Models are Few-Shot Health Learnerscited by 115
11 more
- 2021Self-Supervised Transformer for Sparse and Irregularly Sampled Multivariate Clinical Time-Seriescited by 96
- 2023Frozen Language Model Helps ECG Zero-Shot Learningcited by 62
- 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 54
- 2019AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibrationcited by 50
- 2018RAIM: Recurrent Attentive and Intensive Model of Multimodal Patient Monitoring Datacited by 47
- 2021HiRID-ICU-Benchmark -- A Comprehensive Machine Learning Benchmark on High-resolution ICU Datacited by 38
- 2021MUFASA: Multimodal Fusion Architecture Search for Electronic Health Recordscited by 30
- 2018Learning Tasks for Multitask Learning: Heterogenous Patient Populations in the ICUcited by 21
- 2018A Deep Active Survival Analysis Approach for Precision Treatment Recommendations: Application of Prostate Cancercited by 12
- 2023Clairvoyance: A Pipeline Toolkit for Medical Time Seriescited by 12
- 2018The Effectiveness of Multitask Learning for Phenotyping with Electronic Health Records Datacited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.