# Enhancing Healthcare through Large Language Models: A Study on Medical Question Answering

arXiv: https://arxiv.org/abs/2408.04138 · HTML: https://mlsanity.com/paper/2408.04138/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 31 references that are in the map.
- First posted on arXiv 8 Aug 2024.

## Builds on (most cited first, 16 of 16)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [BioBERT: a pre-trained biomedical language representation model for biomedical text mining](https://mlsanity.com/paper/1901.08746/) (2019)
- [ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission](https://mlsanity.com/paper/1904.05342/) (2019)
- [Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets](https://mlsanity.com/paper/1906.05474/) (2019)
- [Contrastive Clustering](https://mlsanity.com/paper/2009.09687/) (2020)
- [Explainable Prediction of Medical Codes from Clinical Text](https://mlsanity.com/paper/1802.05695/) (2018)
- [Automatic News Generation and Fact-Checking System Based on Language Processing](https://mlsanity.com/paper/2405.10492/) (2024)
- [Enhanced Detection Classification via Clustering SVM for Various Robot Collaboration Task](https://mlsanity.com/paper/2405.03026/) (2024)
- [DeepGI: An Automated Approach for Gastrointestinal Tract Segmentation in MRI Scans](https://mlsanity.com/paper/2401.15354/) (2024)
- [Development and Application of a Monte Carlo Tree Search Algorithm for Simulating Da Vinci Code Game Strategies](https://mlsanity.com/paper/2403.10720/) (2024)
- [Meta-Learning for Fast Cross-Lingual Adaptation in Dependency Parsing](https://mlsanity.com/paper/2104.04736/) (2021)
- [Ensemble Methodology:Innovations in Credit Default Prediction Using LightGBM, XGBoost, and LocalEnsemble](https://mlsanity.com/paper/2402.17979/) (2024)
- [Parameterized Decision-making with Multi-modal Perception for Autonomous Driving](https://mlsanity.com/paper/2312.11935/) (2023)
- [Adaptive Energy Management for Real Driving Conditions via Transfer Reinforcement Learning](https://mlsanity.com/paper/2007.12560/) (2020)
- [Rapid Review of Generative AI in Smart Medical Applications](https://mlsanity.com/paper/2406.06627/) (2024)
- [Towards Automated Augmentation and Instrumentation of Legacy Cryptographic Executables: Extended Version](https://mlsanity.com/paper/2004.09713/) (2020)

## Built on by (most cited first, 14 of 14)

- [SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment](https://mlsanity.com/paper/2509.03934/) (2025)
- [Improving Academic Skills Assessment with NLP and Ensemble Learning](https://mlsanity.com/paper/2409.19013/) (2024)
- [Hallucinations and Key Information Extraction in Medical Texts: A Comprehensive Assessment of Open-Source Large Language Models](https://mlsanity.com/paper/2504.19061/) (2025)
- [Enhancing Skin Lesion Diagnosis with Ensemble Learning](https://mlsanity.com/paper/2409.04381/) (2024)
- [Enhancing Exchange Rate Forecasting with Explainable Deep Learning Models](https://mlsanity.com/paper/2410.19241/) (2024)
- [Application of Vision-Language Model to Pedestrians Behavior and Scene Understanding in Autonomous Driving](https://mlsanity.com/paper/2501.06680/) (2025)
- [SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillation](https://mlsanity.com/paper/2410.16924/) (2024)
- [Zoom In Disparities in Healthcare LLM Q&A](https://mlsanity.com/paper/2510.17476/) (2025)
- [RW-NSGCN: A Robust Approach to Structural Attacks via Negative Sampling](https://mlsanity.com/paper/2408.06665/) (2024)
- [Innovative Deep Learning Techniques for Obstacle Recognition: A Comparative Study of Modern Detection Algorithms](https://mlsanity.com/paper/2410.10096/) (2024)
- [Personalized Causal Graph Reasoning for LLMs: An Implementation for Dietary Recommendations](https://mlsanity.com/paper/2503.00134/) (2025)
- [Hierarchical Multi-Stage BERT Fusion Framework with Dual Attention for Enhanced Cyberbullying Detection in Social Media](https://mlsanity.com/paper/2503.00342/) (2025)
- [FocusMed: A Large Language Model-based Framework for Enhancing Medical Question Summarization with Focus Identification](https://mlsanity.com/paper/2510.04671/) (2025)
- [Memory-Augmented Knowledge Fusion with Safety-Aware Decoding for Domain-Adaptive Question Answering](https://mlsanity.com/paper/2512.02363/) (2025)

## Abstract (arXiv)

In recent years, the application of Large Language Models (LLMs) in healthcare has shown significant promise in improving the accessibility and dissemination of medical knowledge. This paper presents a detailed study of various LLMs trained on the MedQuAD medical question-answering dataset, with a focus on identifying the most effective model for providing accurate medical information. Among the models tested, the Sentence-t5 combined with Mistral 7B demonstrated superior performance, achieving a precision score of 0.762. This model's enhanced capabilities are attributed to its advanced pretraining techniques, robust architecture, and effective prompt construction methodologies. By leveraging these strengths, the Sentence-t5 + Mistral 7B model excels in understanding and generating precise medical answers. Our findings highlight the potential of integrating sophisticated LLMs in medical contexts to facilitate efficient and accurate medical knowledge retrieval, thus significantly enhancing patient education and support.