mlsanityData to 14 Oct 2026

Question Answering for Complex Electronic Health Records Database using Unified Encoder-Decoder Architecture

arXiv 2111.14703 ↗First posted 14 Nov 2021cs.CL cs.AI cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

An intelligent machine that can answer human questions based on electronic health records (EHR-QA) has a great practical value, such as supporting clinical decisions, managing hospital administration, and medical chatbots. Previous table-based QA studies focusing on translating natural questions into table queries (NLQ2SQL), however, suffer from the unique nature of EHR data due to complex and specialized medical terminology, hence increased decoding difficulty. In this paper, we design UniQA, a unified encoder-decoder architecture for EHR-QA where natural language questions are converted to queries such as SQL or SPARQL. We also propose input masking (IM), a simple and effective method to cope with complex medical terms and various typos and better learn the SQL/SPARQL syntax. Combining the unified architecture with an effective auxiliary training objective, UniQA demonstrated a significant performance improvement against the previous state-of-the-art model for MIMICSQL* (14.2% gain), the most complex NLQ2SQL dataset in the EHR domain, and its typo-ridden versions (approximately 28.8% gain). In addition, we confirmed consistent results for the graph-based EHR-QA dataset, MIMICSPARQL*.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 17 of its 32 references that are in the map. First posted on arXiv 14 Nov 2021.

Builds on

17 of 32 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  5. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  6. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  7. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
  8. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
  9. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 424
  10. 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
  11. 2019Leveraging Pre-trained Checkpoints for Sequence Generation Taskscited by 182
  12. 2018emrQA: A Large Corpus for Question Answering on Electronic Medical Recordscited by 135
5 more
  1. 2018Coarse-to-Fine Decoding for Neural Semantic Parsingcited by 110
  2. 2019A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualizationcited by 88
  3. 2019Text-to-SQL Generation for Question Answering on Electronic Medical Recordscited by 77
  4. 2018CliCR: A Dataset of Clinical Case Reports for Machine Reading Comprehensioncited by 34
  5. 2020Knowledge Graph-based Question Answering with Electronic Health Recordscited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 4; 2024: 0; 2025: 0; 2026: 4.

9 papers.