Crowdsourcing Question-Answer Meaning Representations
Not on the map. Why?
Abstract (arXiv)
We introduce Question-Answer Meaning Representations (QAMRs), which represent the predicate-argument structure of a sentence as a set of question-answer pairs. We also develop a crowdsourcing scheme to show that QAMRs can be labeled with very little training, and gather a dataset with over 5,000 sentences and 100,000 questions. A detailed qualitative analysis demonstrates that the crowd-generated question-answer pairs cover the vast majority of predicate-argument relationships in existing datasets (including PropBank, NomBank, QA-SRL, and AMR) along with many previously under-resourced ones, including implicit arguments and relations. The QAMR data and annotation code is made publicly available to enable future work on how best to model these complex phenomena.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 5; 2023: 4; 2024: 1; 2025: 1; 2026: 1.
21 papers.
Sort:
By area:
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 287
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 77
- 2021Comparing Test Sets with Item Response Theorycited by 57
- 2021ISEEQ: Information Seeking Question Generation using Dynamic Meta-Information Retrieval and Knowledge Graphscited by 22
- 2021Do Question Answering Modeling Improvements Hold Across Benchmarks?cited by 20
- 2021Question Answering Infused Pre-training of General-Purpose Contextualized Representationscited by 19
- 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainabilitycited by 16
- 2021MetaQA: Combining Expert Agents for Multi-Skill Question Answeringcited by 15
- 2023CALM : A Multi-task Benchmark for Comprehensive Assessment of Language Model Biascited by 14
- 2022QASem Parsing: Text-to-text Modeling of QA-based Semanticscited by 12
- 2023Localized Symbolic Knowledge Distillation for Visual Commonsense Modelscited by 12
9 more
- 2022A Survey on Open Information Extraction from Rule-based Model to Large Language Modelcited by 8
- 2022QA Is the New KR: Question-Answer Pairs as Knowledge Basescited by 6
- 2021ASQ: Automatically Generating Question-Answer Pairs using AMRscited by 2
- 2023Covering Uncommon Ground: Gap-Focused Question Generation for Answer Assessmentcited by 2
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLPcited by 2
- 2022Enriching Artificial Intelligence Explanations with Knowledge Fragmentscited by 1
- 2025QA-Noun: Representing Nominal Semantics via Natural Language Question-Answer Pairscited by 1
- 2026Learning from Child-Directed Speech in Two-Language Scenarios: A French-English Case Studycited by 1
- 2024FarFetched: Entity-centric Reasoning and Claim Validation for the Greek Language based on Textually Represented Environmentscited by 0
- 2026Learning from Child-Directed Speech in Two-Language Scenarios: A French-English Case Study13 Mar 2026
- 2025QA-Noun: Representing Nominal Semantics via Natural Language Question-Answer Pairs16 Nov 2025
- 2024FarFetched: Entity-centric Reasoning and Claim Validation for the Greek Language based on Textually Represented Environments13 Jul 2024
- 2023Localized Symbolic Knowledge Distillation for Visual Commonsense Models8 Dec 2023
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP1 Dec 2023
- 2023CALM : A Multi-task Benchmark for Comprehensive Assessment of Language Model Bias24 Aug 2023
- 2023Covering Uncommon Ground: Gap-Focused Question Generation for Answer Assessment6 Jul 2023
- 2022RARR: Researching and Revising What Language Models Say, Using Language Models17 Oct 2022
- 2022A Survey on Open Information Extraction from Rule-based Model to Large Language Model18 Aug 2022
- 2022QA Is the New KR: Question-Answer Pairs as Knowledge Bases1 Jul 2022
- 2022QASem Parsing: Text-to-text Modeling of QA-based Semantics23 May 2022
- 2022Enriching Artificial Intelligence Explanations with Knowledge Fragments12 Apr 2022
9 more
- 2021ISEEQ: Information Seeking Question Generation using Dynamic Meta-Information Retrieval and Knowledge Graphs13 Dec 2021
- 2021MetaQA: Combining Expert Agents for Multi-Skill Question Answering3 Dec 2021
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey1 Nov 2021
- 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainability11 Sep 2021
- 2021Question Answering Infused Pre-training of General-Purpose Contextualized Representations15 Jun 2021
- 2021Comparing Test Sets with Item Response Theory1 Jun 2021
- 2021ASQ: Automatically Generating Question-Answer Pairs using AMRs20 May 2021
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning12 Apr 2021
- 2021Do Question Answering Modeling Improvements Hold Across Benchmarks?1 Feb 2021
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 287
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 77
- 2021Comparing Test Sets with Item Response Theorycited by 57
- 2021ISEEQ: Information Seeking Question Generation using Dynamic Meta-Information Retrieval and Knowledge Graphscited by 22
- 2021Do Question Answering Modeling Improvements Hold Across Benchmarks?cited by 20
- 2021Question Answering Infused Pre-training of General-Purpose Contextualized Representationscited by 19
- 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainabilitycited by 16
- 2021MetaQA: Combining Expert Agents for Multi-Skill Question Answeringcited by 15
- 2023CALM : A Multi-task Benchmark for Comprehensive Assessment of Language Model Biascited by 14
- 2022QASem Parsing: Text-to-text Modeling of QA-based Semanticscited by 12
- 2022A Survey on Open Information Extraction from Rule-based Model to Large Language Modelcited by 8
12 most cited of 20 All 20 (JSON)
- 2026Learning from Child-Directed Speech in Two-Language Scenarios: A French-English Case Study13 Mar 2026
- 2025QA-Noun: Representing Nominal Semantics via Natural Language Question-Answer Pairs16 Nov 2025
- 2024FarFetched: Entity-centric Reasoning and Claim Validation for the Greek Language based on Textually Represented Environments13 Jul 2024
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP1 Dec 2023
- 2023CALM : A Multi-task Benchmark for Comprehensive Assessment of Language Model Bias24 Aug 2023
- 2023Covering Uncommon Ground: Gap-Focused Question Generation for Answer Assessment6 Jul 2023
- 2022RARR: Researching and Revising What Language Models Say, Using Language Models17 Oct 2022
- 2022A Survey on Open Information Extraction from Rule-based Model to Large Language Model18 Aug 2022
- 2022QA Is the New KR: Question-Answer Pairs as Knowledge Bases1 Jul 2022
- 2022QASem Parsing: Text-to-text Modeling of QA-based Semantics23 May 2022
- 2022Enriching Artificial Intelligence Explanations with Knowledge Fragments12 Apr 2022
- 2021ISEEQ: Information Seeking Question Generation using Dynamic Meta-Information Retrieval and Knowledge Graphs13 Dec 2021
12 newest of 20 All 20 (JSON)