mlsanityData to 14 Oct 2026

Clinical QA 2.0: Multi-Task Learning for Answer Extraction and Categorization

arXiv 2502.13108 ↗First posted 18 Feb 2025cs.CL cs.AI cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Clinical Question Answering (CQA) plays a crucial role in medical decision-making, enabling physicians to extract relevant information from Electronic Medical Records (EMRs). While transformer-based models such as BERT, BioBERT, and ClinicalBERT have demonstrated state-of-the-art performance in CQA, existing models lack the ability to categorize extracted answers, which is critical for structured retrieval, content filtering, and medical decision support. To address this limitation, we introduce a Multi-Task Learning (MTL) framework that jointly trains CQA models for both answer extraction and medical categorization. In addition to predicting answer spans, our model classifies responses into five standardized medical categories: Diagnosis, Medication, Symptoms, Procedure, and Lab Reports. This categorization enables more structured and interpretable outputs, making clinical QA models more useful in real-world healthcare settings. We evaluate our approach on emrQA, a large-scale dataset for medical question answering. Results show that MTL improves F1-score by 2.2% compared to standard fine-tuning, while achieving 90.7% accuracy in answer categorization. These findings suggest that MTL not only enhances CQA performance but also introduces an effective mechanism for categorization and structured medical information retrieval.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 17 of its 39 references that are in the map. First posted on arXiv 18 Feb 2025.

Builds on

17 of 39 references.

References · 17

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  4. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  5. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  6. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  7. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  8. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  9. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  10. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  11. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
  12. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
5 more
  1. 2018emrQA: A Large Corpus for Question Answering on Electronic Medical Recordscited by 135
  2. 2019BAM! Born-Again Multi-Task Networks for Natural Language Understandingcited by 85
  3. 2024Survey of Large Multimodal Model Datasets, Application Categories and Taxonomycited by 17
  4. 2024LLM for Barcodes: Generating Diverse Synthetic Data for Identity Documentscited by 12
  5. 2024Enhancing Document AI Data Generation Through Graph-Based Synthetic Layoutscited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 3.

9 papers.