Multilingual Medical Question Answering and Information Retrieval for Rural Health Intelligence Access
Not on the map. Why?
Abstract (arXiv)
In rural regions of several developing countries, access to quality healthcare, medical infrastructure, and professional diagnosis is largely unavailable. Many of these regions are gradually gaining access to internet infrastructure, although not with a strong enough connection to allow for sustained communication with a medical practitioner. Several deaths resulting from this lack of medical access, absence of patient's previous health records, and the unavailability of information in indigenous languages can be easily prevented. In this paper, we describe an approach leveraging the phenomenal progress in Machine Learning and NLP (Natural Language Processing) techniques to design a model that is low-resource, multilingual, and a preliminary first-point-of-contact medical assistant. Our contribution includes defining the NLP pipeline required for named-entity-recognition, language-agnostic sentence embedding, natural language translation, information retrieval, question answering, and generative pre-training for final query processing. We obtain promising results for this pipeline and preliminary results for EHR (Electronic Health Record) analysis with text summarization for medical practitioners to peruse for their diagnosis. Through this NLP pipeline, we aim to provide preliminary medical information to the user and do not claim to supplant diagnosis from qualified medical practitioners. Using the input from subject matter experts, we have compiled a large corpus to pre-train and fine-tune our BioBERT based NLP model for the specific tasks. We expect recent advances in NLP architectures, several of which are efficient and privacy-preserving models, to further the impact of our solution and improve on individual task performance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 2 Jun 2021.
Builds on
12 of 21 references.
References · 12
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2020Reformer: The Efficient Transformercited by 1,668
- 2020Language-agnostic BERT Sentence Embeddingcited by 627
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
- 2019Massively Multilingual Neural Machine Translation in the Wild: Findings and Challengescited by 257
- 2020Multilingual Transfer Learning for QA Using Translation as Data Augmentationcited by 20
Built on by
Citing papers per year: 2021: 1.
1 paper.
- 2021Natural Language Processing for Smart Healthcarecited by 14
- 2021Natural Language Processing for Smart Healthcare19 Oct 2021