Pregnant Questions: The Importance of Pragmatic Awareness in Maternal Health Question Answering
Not on the map. Why?
Abstract (arXiv)
Questions posed by information-seeking users often contain implicit false or potentially harmful assumptions. In a high-risk domain such as maternal and infant health, a question-answering system must recognize these pragmatic constraints and go beyond simply answering user questions, examining them in context to respond helpfully. To achieve this, we study assumptions and implications, or pragmatic inferences, made when mothers ask questions about pregnancy and infant care by collecting a dataset of 2,727 inferences from 500 questions across three diverse sources. We study how health experts naturally address these inferences when writing answers, and illustrate that informing existing QA pipelines with pragmatic inferences produces responses that are more complete, mitigating the propagation of harmful beliefs.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 16 Nov 2023.
Builds on
20 of 39 references.
References · 20
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
- 2022Prompting GPT-3 To Be Reliablecited by 260
- 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
8 more
- 2023A Critical Evaluation of Evaluations for Long-form Question Answeringcited by 111
- 2020Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositioncited by 77
- 2022CREPE: Open-Domain Question Answering with False Presuppositionscited by 72
- 2022(QA)2: Question Answering with Questionable Assumptionscited by 51
- 2020Challenges in Information-Seeking QA: Unanswerable Questions and Paragraph Retrievalcited by 44
- 2021Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answeringcited by 41
- 2021NOPE: A Corpus of Naturally-Occurring Presuppositions in Englishcited by 23
- 2019Harnessing the linguistic signal to predict scalar inferencescited by 17
Built on by
Citing papers per year: 2025: 5; 2026: 9.
14 papers.
Sort:
By area:
- 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challengescited by 31
- 2025Cancer-Myth: Evaluating Large Language Models on Patient Questions with False Presuppositionscited by 15
- 2025LLMs Struggle to Reject False Presuppositions when Misinformation Stakes are Highcited by 12
- 2025NLI under the Microscope: What Atomic Hypothesis Decomposition Revealscited by 11
- 2025Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questionscited by 10
- 2026The Aftermath of DrawEduMath: Vision Language Models Underperform with Struggling Students and Misdiagnose Errorscited by 1
- 2026ObGynLongBench: Revealing the Evidence-to-EHR Gap in Longitudinal EHR Decision-Makingcited by 1
- 2026MedRedFlag: Investigating how LLMs Redirect Misconceptions in Real-World Health Communicationcited by 0
- 2026What Patients Really Ask: Exploring the Effect of False Assumptions in Patient Information Seekingcited by 0
- 2026When Contextual Inference Fails: Cancelability in Interactive Instruction Followingcited by 0
- 2026DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answeringcited by 0
- 2026DRInQ: Evaluating Conversational Implicature with Controlled Context Variationcited by 0
- 2026Pushback in a Haystack: Language Models Respond to Factual Errors Ambiguously and Ineffectively13 Oct 2026
- 2026ObGynLongBench: Revealing the Evidence-to-EHR Gap in Longitudinal EHR Decision-Making7 Sep 2026
- 2026Evaluating Large Language Models on Misconceptions in Multi-Turn Medical Conversations14 Jul 2026
- 2026DRInQ: Evaluating Conversational Implicature with Controlled Context Variation22 May 2026
- 2026DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answering16 Apr 2026
- 2026When Contextual Inference Fails: Cancelability in Interactive Instruction Following20 Mar 2026
- 2026The Aftermath of DrawEduMath: Vision Language Models Underperform with Struggling Students and Misdiagnose Errors1 Mar 2026
- 2026What Patients Really Ask: Exploring the Effect of False Assumptions in Patient Information Seeking22 Jan 2026
- 2026MedRedFlag: Investigating how LLMs Redirect Misconceptions in Real-World Health Communication14 Jan 2026
- 2025Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questions10 Jun 2025
- 2025LLMs Struggle to Reject False Presuppositions when Misinformation Stakes are High28 May 2025
- 2025Cancer-Myth: Evaluating Large Language Models on Patient Questions with False Presuppositions15 Apr 2025
- 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challengescited by 31
- 2025Cancer-Myth: Evaluating Large Language Models on Patient Questions with False Presuppositionscited by 15
- 2025LLMs Struggle to Reject False Presuppositions when Misinformation Stakes are Highcited by 12
- 2025NLI under the Microscope: What Atomic Hypothesis Decomposition Revealscited by 11
- 2025Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questionscited by 10
- 2026ObGynLongBench: Revealing the Evidence-to-EHR Gap in Longitudinal EHR Decision-Makingcited by 1
- 2026MedRedFlag: Investigating how LLMs Redirect Misconceptions in Real-World Health Communicationcited by 0
- 2026What Patients Really Ask: Exploring the Effect of False Assumptions in Patient Information Seekingcited by 0
- 2026When Contextual Inference Fails: Cancelability in Interactive Instruction Followingcited by 0
- 2026DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answeringcited by 0
- 2026DRInQ: Evaluating Conversational Implicature with Controlled Context Variationcited by 0
- 2026Evaluating Large Language Models on Misconceptions in Multi-Turn Medical Conversationscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Pushback in a Haystack: Language Models Respond to Factual Errors Ambiguously and Ineffectively13 Oct 2026
- 2026ObGynLongBench: Revealing the Evidence-to-EHR Gap in Longitudinal EHR Decision-Making7 Sep 2026
- 2026Evaluating Large Language Models on Misconceptions in Multi-Turn Medical Conversations14 Jul 2026
- 2026DRInQ: Evaluating Conversational Implicature with Controlled Context Variation22 May 2026
- 2026DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answering16 Apr 2026
- 2026When Contextual Inference Fails: Cancelability in Interactive Instruction Following20 Mar 2026
- 2026What Patients Really Ask: Exploring the Effect of False Assumptions in Patient Information Seeking22 Jan 2026
- 2026MedRedFlag: Investigating how LLMs Redirect Misconceptions in Real-World Health Communication14 Jan 2026
- 2025Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questions10 Jun 2025
- 2025LLMs Struggle to Reject False Presuppositions when Misinformation Stakes are High28 May 2025
- 2025Cancer-Myth: Evaluating Large Language Models on Patient Questions with False Presuppositions15 Apr 2025
- 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges17 Feb 2025
12 newest of 13 All 13 (JSON)