mlsanityData to 7 Oct 2026

Large Language Model as a Universal Clinical Multi-task Decoder

arXiv 2406.12738 ↗First posted 18 Jun 2024cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

The development of effective machine learning methodologies for enhancing the efficiency and accuracy of clinical systems is crucial. Despite significant research efforts, managing a plethora of diversified clinical tasks and adapting to emerging new tasks remain significant challenges. This paper presents a novel paradigm that employs a pre-trained large language model as a universal clinical multi-task decoder. This approach leverages the flexibility and diversity of language expressions to handle task topic variations and associated arguments. The introduction of a new task simply requires the addition of a new instruction template. We validate this framework across hundreds of tasks, demonstrating its robustness in facilitating multi-task predictions, performing on par with traditional multi-task learning and single-task learning approaches. Moreover, it shows exceptional adaptability to new tasks, with impressive zero-shot performance in some instances and superior data efficiency in few-shot scenarios. This novel approach offers a unified solution to manage a wide array of new and emerging tasks in clinical applications.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

23 of 37 references.

References · 23

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2017A Survey on Multi-Task Learningcited by 838
  3. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  4. 2023A decoder-only foundation model for time-series forecastingcited by 650
  5. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
  6. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  7. 2017Multitask learning and benchmarking with clinical time series datacited by 287
  8. 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 234
  9. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
  10. 2019Set Functions for Time Seriescited by 137
  11. 2019MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-IIIcited by 121
  12. 2023Large Language Models are Few-Shot Health Learnerscited by 115
11 more
  1. 2021Self-Supervised Transformer for Sparse and Irregularly Sampled Multivariate Clinical Time-Seriescited by 96
  2. 2023Frozen Language Model Helps ECG Zero-Shot Learningcited by 62
  3. 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 54
  4. 2019AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibrationcited by 50
  5. 2018RAIM: Recurrent Attentive and Intensive Model of Multimodal Patient Monitoring Datacited by 47
  6. 2021HiRID-ICU-Benchmark -- A Comprehensive Machine Learning Benchmark on High-resolution ICU Datacited by 38
  7. 2021MUFASA: Multimodal Fusion Architecture Search for Electronic Health Recordscited by 30
  8. 2018Learning Tasks for Multitask Learning: Heterogenous Patient Populations in the ICUcited by 21
  9. 2018A Deep Active Survival Analysis Approach for Precision Treatment Recommendations: Application of Prostate Cancercited by 12
  10. 2023Clairvoyance: A Pipeline Toolkit for Medical Time Seriescited by 12
  11. 2018The Effectiveness of Multitask Learning for Phenotyping with Electronic Health Records Datacited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.