Question Answering is a Format; When is it Useful?
Not on the map. Why?
Abstract (arXiv)
Recent years have seen a dramatic expansion of tasks and datasets posed as question answering, from reading comprehension, semantic role labeling, and even machine translation, to image and video understanding. With this expansion, there are many differing views on the utility and definition of "question answering" itself. Some argue that its scope should be narrow, or broad, or that it is overused in datasets today. In this opinion piece, we argue that question answering should be considered a format which is sometimes useful for studying particular phenomena, not a phenomenon or task in itself. We discuss when a task is correctly described as question answering, and when a task is usefully posed as question answering, instead of using some other format.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 5; 2024: 3; 2025: 2; 2026: 2.
25 papers.
Sort:
By area:
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021Few-Shot Self-Rationalization with Natural Language Promptscited by 83
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 75
- 2022CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negationcited by 38
- 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
- 2023It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performancecited by 25
- 2021Question Answering Infused Pre-training of General-Purpose Contextualized Representationscited by 19
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasetscited by 18
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2021Dependency Parsing as MRC-based Span-Span Predictioncited by 13
- 2021Hey AI, Can You Solve Complex Tasks by Talking to Agents?cited by 13
- 2022Calibrating Trust of Multi-Hop Question Answering Systems with Decompositional Probescited by 9
13 more
- 2025ProMQA-Assembly: Multimodal Procedural QA Dataset on Assemblycited by 5
- 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervisioncited by 4
- 2023RadLing: Towards Efficient Radiology Report Understandingcited by 4
- 2024Promptly Predicting Structures: The Return of Inferencecited by 4
- 2023Improving Information Extraction on Business Documents with Specific Pre-Training Taskscited by 3
- 2022On Event Individuation for Document-Level Information Extractioncited by 2
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLPcited by 2
- 2024Assessing biomedical knowledge robustness in large language models by query-efficient sampling attackscited by 1
- 2024A Systematic Survey of Natural Language Processing for the Greek Languagecited by 1
- 2025Mapping the Course for Prompt-based Structured Predictioncited by 1
- 2021Is Sluice Resolution really just Question Answering?cited by 0
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Carecited by 0
- 2026Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulnesscited by 0
- 2026Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness30 Sep 2026
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Care7 Sep 2026
- 2025ProMQA-Assembly: Multimodal Procedural QA Dataset on Assembly3 Sep 2025
- 2025Mapping the Course for Prompt-based Structured Prediction20 Aug 2025
- 2024A Systematic Survey of Natural Language Processing for the Greek Language13 Jul 2024
- 2024Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks16 Feb 2024
- 2024Promptly Predicting Structures: The Return of Inference12 Jan 2024
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP1 Dec 2023
- 2023Improving Information Extraction on Business Documents with Specific Pre-Training Tasks11 Sep 2023
- 2023RadLing: Towards Efficient Radiology Report Understanding4 Jun 2023
- 2023It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performance15 May 2023
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasets27 Feb 2023
13 more
- 2022On Event Individuation for Document-Level Information Extraction19 Dec 2022
- 2022CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negation1 Nov 2022
- 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervision16 Jun 2022
- 2022Calibrating Trust of Multi-Hop Question Answering Systems with Decompositional Probes16 Apr 2022
- 2021Few-Shot Self-Rationalization with Natural Language Prompts16 Nov 2021
- 2021Hey AI, Can You Solve Complex Tasks by Talking to Agents?16 Oct 2021
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension27 Jul 2021
- 2021FaVIQ: FAct Verification from Information-seeking Questions5 Jul 2021
- 2021Question Answering Infused Pre-training of General-Purpose Contextualized Representations15 Jun 2021
- 2021Is Sluice Resolution really just Question Answering?29 May 2021
- 2021Dependency Parsing as MRC-based Span-Span Prediction17 May 2021
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning12 Apr 2021
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graph23 Mar 2021
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2021Few-Shot Self-Rationalization with Natural Language Promptscited by 83
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 75
- 2022CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negationcited by 38
- 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
- 2023It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performancecited by 25
- 2021Question Answering Infused Pre-training of General-Purpose Contextualized Representationscited by 19
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasetscited by 18
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2021Dependency Parsing as MRC-based Span-Span Predictioncited by 13
- 2021Hey AI, Can You Solve Complex Tasks by Talking to Agents?cited by 13
- 2025ProMQA-Assembly: Multimodal Procedural QA Dataset on Assemblycited by 5
12 most cited of 22 All 22 (JSON)
- 2025ProMQA-Assembly: Multimodal Procedural QA Dataset on Assembly3 Sep 2025
- 2025Mapping the Course for Prompt-based Structured Prediction20 Aug 2025
- 2024A Systematic Survey of Natural Language Processing for the Greek Language13 Jul 2024
- 2024Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks16 Feb 2024
- 2024Promptly Predicting Structures: The Return of Inference12 Jan 2024
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP1 Dec 2023
- 2023Improving Information Extraction on Business Documents with Specific Pre-Training Tasks11 Sep 2023
- 2023RadLing: Towards Efficient Radiology Report Understanding4 Jun 2023
- 2023It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performance15 May 2023
- 2023Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasets27 Feb 2023
- 2022On Event Individuation for Document-Level Information Extraction19 Dec 2022
- 2022CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negation1 Nov 2022
12 newest of 22 All 22 (JSON)