Optimized Biomedical Question-Answering Services with LLM and Multi-BERT Integration
Not on the map. Why?
Abstract (arXiv)
We present a refined approach to biomedical question-answering (QA) services by integrating large language models (LLMs) with Multi-BERT configurations. By enhancing the ability to process and prioritize vast amounts of complex biomedical data, this system aims to support healthcare professionals in delivering better patient outcomes and informed decision-making. Through innovative use of BERT and BioBERT models, combined with a multi-layer perceptron (MLP) layer, we enable more specialized and efficient responses to the growing demands of the healthcare sector. Our approach not only addresses the challenge of overfitting by freezing one BERT model while training another but also improves the overall adaptability of QA services. The use of extensive datasets, such as BioASQ and BioMRC, demonstrates the system's ability to synthesize critical information. This work highlights how advanced language models can make a tangible difference in healthcare, providing reliable and responsive tools for professionals to manage complex information, ultimately serving the broader goal of improved care and data-driven insights.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 27 references that are in the map. First posted on arXiv 11 Oct 2024.
Builds on
10 of 27 references.
References · 10
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
- 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
- 2018QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehensioncited by 164
- 2020BIOMRC: A Dataset for Biomedical Machine Reading Comprehensioncited by 35
- 2016Attention-over-Attention Neural Networks for Reading Comprehensioncited by 31
- 2021Towards BERT-based Automatic ICD Coding: Limitations and Opportunitiescited by 25
- 2024Question answering systems for health professionals at the point of care -- a systematic reviewcited by 3
Built on by
Citing papers per year: 2025: 2.
2 papers.