mlsanityData to 7 Oct 2026

Developing ChatGPT for Biology and Medicine: A Complete Review of Biomedical Question Answering

arXiv 2401.07510 ↗First posted 15 Jan 2024cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

ChatGPT explores a strategic blueprint of question answering (QA) in delivering medical diagnosis, treatment recommendations, and other healthcare support. This is achieved through the increasing incorporation of medical domain data via natural language processing (NLP) and multimodal paradigms. By transitioning the distribution of text, images, videos, and other modalities from the general domain to the medical domain, these techniques have expedited the progress of medical domain question answering (MDQA). They bridge the gap between human natural language and sophisticated medical domain knowledge or expert manual annotations, handling large-scale, diverse, unbalanced, or even unlabeled data analysis scenarios in medical contexts. Central to our focus is the utilizing of language models and multimodal paradigms for medical question answering, aiming to guide the research community in selecting appropriate mechanisms for their specific medical research requirements. Specialized tasks such as unimodal-related question answering, reading comprehension, reasoning, diagnosis, relation extraction, probability modeling, and others, as well as multimodal-related tasks like vision question answering, image caption, cross-modal retrieval, report summarization, and generation, are discussed in detail. Each section delves into the intricate specifics of the respective method under consideration. This paper highlights the structures and advancements of medical domain explorations against general domain methods, emphasizing their applications across different tasks and datasets. It also outlines current challenges and opportunities for future medical domain research, paving the way for continued innovation and application in this rapidly evolving field.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 44 of its 64 references that are in the map. First posted on arXiv 15 Jan 2024.

Builds on

44 of 64 references.

References · 44

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2022Training language models to follow instructions with human feedbackcited by 15,712
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  10. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  11. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  12. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
32 more
  1. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  2. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  6. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  7. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  8. 2022Galactica: A Large Language Model for Sciencecited by 736
  9. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  10. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
  11. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  12. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  13. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  14. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
  15. 2019Deep Modular Co-Attention Networks for Visual Question Answeringcited by 338
  16. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
  17. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
  18. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
  19. 2022Can large language models reason about medical questions?cited by 194
  20. 2023MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learningcited by 171
  21. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  22. 2023SAM-Med2Dcited by 123
  23. 2023The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuningcited by 106
  24. 2021VLM: Task-agnostic Video-Language Model Pre-training for Video Understandingcited by 102
  25. 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 99
  26. 2021Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?cited by 85
  27. 2023ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluationcited by 85
  28. 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferencescited by 43
  29. 2023Q2ATransformer: Improving Medical VQA via an Answer Querying Decodercited by 31
  30. 2023An Early Evaluation of GPT-4V(ision)cited by 31
  31. 2023AltDiffusion: A Multilingual Text-to-Image Diffusion Modelcited by 30
  32. 2023Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learningcited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

  1. 2025BALI: Enhancing Biomedical Language Representations through Knowledge Graph and Language Model Alignmentcited by 2
  2. 2025RAG-BioQA: A Retrieval-Augmented Generation Framework for Long-Form Biomedical Question Answeringcited by 0
  3. 2026From Single to Multi-Agent Reasoning: Advancing GeneGPT for Genomics QAcited by 0