Uncertainty-Aware Text-to-Program for Question Answering on Structured Electronic Health Records
Not on the map. Why?
Abstract (arXiv)
Question Answering on Electronic Health Records (EHR-QA) has a significant impact on the healthcare domain, and it is being actively studied. Previous research on structured EHR-QA focuses on converting natural language queries into query language such as SQL or SPARQL (NLQ2Query), so the problem scope is limited to pre-defined data types by the specific query language. In order to expand the EHR-QA task beyond this limitation to handle multi-modal medical data and solve complex inference in the future, more primitive systemic language is needed. In this paper, we design the program-based model (NLQ2Program) for EHR-QA as the first step towards the future direction. We tackle MIMICSPARQL*, the graph-based EHR-QA dataset, via a program-based approach in a semi-supervised manner in order to overcome the absence of gold programs. Without the gold program, our proposed model shows comparable performance to the previous state-of-the-art model, which is an NLQ2Query model (0.9% gain). In addition, for a reliable EHR-QA model, we apply the uncertainty decomposition method to measure the ambiguity in the input question. We empirically confirmed data uncertainty is most indicative of the ambiguity in the input question.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 14 Mar 2022.
Builds on
19 of 30 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2021On Hallucination and Predictive Uncertainty in Conditional Language Generationcited by 176
- 2018emrQA: A Large Corpus for Question Answering on Electronic Medical Recordscited by 135
- 2020Data Uncertainty Learning in Face Recognitioncited by 134
- 2016Sequence-to-Sequence Learning as Beam-Search Optimizationcited by 127
- 2018Analyzing Uncertainty in Neural Machine Translationcited by 126
- 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 103
- 2019Text-to-SQL Generation for Question Answering on Electronic Medical Recordscited by 77
7 more
- 2018Complex Sequential Question Answering: Towards Learning to Converse Over Linked Question Answer Pairs with a Knowledge Graphcited by 67
- 2019Analyzing the Role of Model Uncertainty for Electronic Health Recordscited by 41
- 2018CliCR: A Dataset of Clinical Case Reports for Machine Reading Comprehensioncited by 34
- 2020Understanding Neural Abstractive Summarization Models via Uncertaintycited by 34
- 2020Knowledge Graph-based Question Answering with Electronic Health Recordscited by 19
- 2020Less is More: Data-Efficient Complex Question Answering over Knowledge Basescited by 9
- 2021Question Answering for Complex Electronic Health Records Database using Unified Encoder-Decoder Architecturecited by 9
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 1.
4 papers.
- 2024TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoringcited by 17
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promisescited by 13
- 2023Question Answering for Electronic Health Records: A Scoping Review of datasets and modelscited by 7
- 2025Comprehensive Modeling and Question Answering of Cancer Clinical Practice Guidelines using LLMscited by 2
- 2025Comprehensive Modeling and Question Answering of Cancer Clinical Practice Guidelines using LLMs23 Jan 2025
- 2024TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoring23 Mar 2024
- 2023Question Answering for Electronic Health Records: A Scoping Review of datasets and models12 Oct 2023
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promises7 Jun 2023