AI for Biomedicine in the Era of Large Language Models
Not on the map. Why?
Abstract (arXiv)
The capabilities of AI for biomedicine span a wide spectrum, from the atomic level, where it solves partial differential equations for quantum systems, to the molecular level, predicting chemical or protein structures, and further extending to societal predictions like infectious disease outbreaks. Recent advancements in large language models, exemplified by models like ChatGPT, have showcased significant prowess in natural language tasks, such as translating languages, constructing chatbots, and answering questions. When we consider biomedical data, we observe a resemblance to natural language in terms of sequences: biomedical literature and health records presented as text, biological sequences or sequencing data arranged in sequences, or sensor data like brain signals as time series. The question arises: Can we harness the potential of recent large language models to drive biomedical knowledge discoveries? In this survey, we will explore the application of large language models to three crucial categories of biomedical data: 1) textual data, 2) biological sequences, and 3) brain signals. Furthermore, we will delve into large language model challenges in biomedical research, including ensuring trustworthiness, achieving personalization, and adapting to multi-modal data representation
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 39 of its 111 references that are in the map. First posted on arXiv 23 Mar 2024.
Builds on
39 of 111 references.
References · 39
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
27 more
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2023PaLM 2 Technical Reportcited by 1,154
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
- 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
- 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
- 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 187
- 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 160
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
- 2018Construction of the Literature Graph in Semantic Scholarcited by 118
- 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
- 2021SciFive: a text-to-text transformer model for biomedical literaturecited by 99
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
- 2023Decoding Natural Images from EEG for Object Recognitioncited by 79
- 2023ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Textscited by 78
- 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 70
- 2023Structure-informed Language Models Are Protein Designerscited by 68
- 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
- 2024xTrimoPGLM: Unified 100B-Scale Pre-trained Transformer for Deciphering the Language of Proteincited by 49
- 2023Prot2Text: Multimodal Protein's Function Generation with GNNs and Transformerscited by 32
- 2023EEG2IMAGE: Image Reconstruction from EEG Brain Signalscited by 30
- 2023Towards Voice Reconstruction from EEG during Imagined Speechcited by 26
- 2023ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervisioncited by 7
- 2023Compositional Zero-Shot Domain Transfer with Text-to-Text Modelscited by 6
Built on by
Citing papers per year: 2024: 3.
3 papers.