mlsanityData to 7 Oct 2026

AI for Biomedicine in the Era of Large Language Models

arXiv 2403.15673 ↗First posted 23 Mar 2024cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

The capabilities of AI for biomedicine span a wide spectrum, from the atomic level, where it solves partial differential equations for quantum systems, to the molecular level, predicting chemical or protein structures, and further extending to societal predictions like infectious disease outbreaks. Recent advancements in large language models, exemplified by models like ChatGPT, have showcased significant prowess in natural language tasks, such as translating languages, constructing chatbots, and answering questions. When we consider biomedical data, we observe a resemblance to natural language in terms of sequences: biomedical literature and health records presented as text, biological sequences or sequencing data arranged in sequences, or sensor data like brain signals as time series. The question arises: Can we harness the potential of recent large language models to drive biomedical knowledge discoveries? In this survey, we will explore the application of large language models to three crucial categories of biomedical data: 1) textual data, 2) biological sequences, and 3) brain signals. Furthermore, we will delve into large language model challenges in biomedical research, including ensuring trustworthiness, achieving personalization, and adapting to multi-modal data representation

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 39 of its 111 references that are in the map. First posted on arXiv 23 Mar 2024.

Builds on

39 of 111 references.

References · 39

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  6. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  7. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  9. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  10. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  11. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  12. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
27 more
  1. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  2. 2023PaLM 2 Technical Reportcited by 1,154
  3. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  4. 2019Publicly Available Clinical BERT Embeddingscited by 995
  5. 2022Galactica: A Large Language Model for Sciencecited by 736
  6. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  7. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
  8. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  9. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
  10. 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 187
  11. 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 160
  12. 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
  13. 2018Construction of the Literature Graph in Semantic Scholarcited by 118
  14. 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
  15. 2021SciFive: a text-to-text transformer model for biomedical literaturecited by 99
  16. 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
  17. 2023Decoding Natural Images from EEG for Object Recognitioncited by 79
  18. 2023ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Textscited by 78
  19. 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 70
  20. 2023Structure-informed Language Models Are Protein Designerscited by 68
  21. 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
  22. 2024xTrimoPGLM: Unified 100B-Scale Pre-trained Transformer for Deciphering the Language of Proteincited by 49
  23. 2023Prot2Text: Multimodal Protein's Function Generation with GNNs and Transformerscited by 32
  24. 2023EEG2IMAGE: Image Reconstruction from EEG Brain Signalscited by 30
  25. 2023Towards Voice Reconstruction from EEG during Imagined Speechcited by 26
  26. 2023ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervisioncited by 7
  27. 2023Compositional Zero-Shot Domain Transfer with Text-to-Text Modelscited by 6

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.