Large-Scale QA-SRL Parsing
Not on the map. Why?
Abstract (arXiv)
We present a new large-scale corpus of Question-Answer driven Semantic Role Labeling (QA-SRL) annotations, and the first high-quality QA-SRL parser. Our corpus, QA-SRL Bank 2.0, consists of over 250,000 question-answer pairs for over 64,000 sentences across 3 domains and was gathered with a new crowd-sourcing scheme that we show has high precision and good recall at modest cost. We also present neural models for two QA-SRL subtasks: detecting argument spans for a predicate and generating questions to label the semantic relationship. The best models achieve question accuracy of 82.6% and span-level accuracy of 77.6% (under human evaluation) on the full pipelined QA-SRL prediction task. They can also, as we show, be used to gather additional annotations at low cost.
Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 12; 2023: 10; 2024: 5; 2025: 3; 2026: 4.
45 papers.
Sort:
By area:
- 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
- 2022PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognitioncited by 29
- 2023Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answeringcited by 28
- 2021Asking It All: Generating Contextualized Questions for any Semantic Rolecited by 22
- 2022Life is a Circus and We are the Clowns: Automatically Finding Analogies between Situations and Processescited by 22
- 2021Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violencecited by 19
- 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainabilitycited by 16
- 2021QA-Align: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositionscited by 16
- 2021LSOIE: A Large-Scale Dataset for Supervised Open Information Extractioncited by 15
- 2021Draw Me a Flower: Processing and Grounding Abstraction in Natural Languagecited by 14
- 2023Design Choices for Crowdsourcing Implicit Discourse Relations: Revealing the Biases Introduced by Task Designcited by 14
- 2024Localizing Factual Inconsistencies in Attributable Text Generationcited by 14
33 more
- 2022QASem Parsing: Text-to-text Modeling of QA-based Semanticscited by 12
- 2022DetIE: Multilingual Open Information Extraction Inspired by Object Detectioncited by 11
- 2024Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRLcited by 10
- 2021Text-based NP Enrichmentcited by 8
- 2022A Survey on Open Information Extraction from Rule-based Model to Large Language Modelcited by 8
- 2023Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extractioncited by 8
- 2024QAPyramid: Fine-grained Evaluation of Content Selection for Text Summarizationcited by 8
- 2022"What makes a question inquisitive?" A Study on Type-Controlled Inquisitive Question Generationcited by 7
- 2022QA Is the New KR: Question-Answer Pairs as Knowledge Basescited by 6
- 2022A Question-Answer Driven Approach to Reveal Affirmative Interpretations from Verbal Negationscited by 5
- 2022Asking the Right Questions in Low Resource Template Extractioncited by 4
- 2022Semantic Role Labeling Meets Definition Modeling: Using Natural Language to Describe Predicate-Argument Structurescited by 4
- 2024Promptly Predicting Structures: The Return of Inferencecited by 4
- 2024Explicating the Implicit: Argument Detection Beyond Sentence Boundariescited by 4
- 2023Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolutioncited by 3
- 2023Dense Retrieval as Indirect Supervision for Large-space Decision Makingcited by 3
- 2021ASQ: Automatically Generating Question-Answer Pairs using AMRscited by 2
- 2021Sister Help: Data Augmentation for Frame-Semantic Role Labelingcited by 2
- 2022Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Codecited by 2
- 2022Query Your Model with Definitions in FrameNet: An Effective Method for Frame Semantic Role Labelingcited by 2
- 2023Creating Custom Event Data Without Dictionaries: A Bag-of-Trickscited by 2
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLPcited by 2
- 2021Robustly Optimized and Distilled Training for Natural Language Understandingcited by 1
- 2023Imitation of Life: A Search Engine for Biologically Inspired Designcited by 1
- 2025Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesiscited by 1
- 2025QA-Noun: Representing Nominal Semantics via Natural Language Question-Answer Pairscited by 1
- 2025Zero-Shot Open-Vocabulary Human Motion Grounding with Test-Time Trainingcited by 1
- 2026Effective QA-driven Annotation of Predicate-Argument Relations Across Languagescited by 1
- 2023Shall We Trust All Relational Tuples by Open Information Extraction? A Study on Speculation Detectioncited by 0
- 2023Learning Semantic Role Labeling from Compatible Label Sequencescited by 0
- 2026SocraticKG: Knowledge Graph Construction via QA-Driven Fact Extractioncited by 0
- 2026Emergent Semantic Role Understanding in Language Modelscited by 0
- 2026Task Decomposition for Efficient Annotationcited by 0
- 2026Task Decomposition for Efficient Annotation23 Jun 2026
- 2026Emergent Semantic Role Understanding in Language Models9 May 2026
- 2026Effective QA-driven Annotation of Predicate-Argument Relations Across Languages26 Feb 2026
- 2026SocraticKG: Knowledge Graph Construction via QA-Driven Fact Extraction15 Jan 2026
- 2025Zero-Shot Open-Vocabulary Human Motion Grounding with Test-Time Training19 Nov 2025
- 2025QA-Noun: Representing Nominal Semantics via Natural Language Question-Answer Pairs16 Nov 2025
- 2025Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesis6 Aug 2025
- 2024QAPyramid: Fine-grained Evaluation of Content Selection for Text Summarization10 Dec 2024
- 2024Localizing Factual Inconsistencies in Attributable Text Generation9 Oct 2024
- 2024Explicating the Implicit: Argument Detection Beyond Sentence Boundaries8 Aug 2024
- 2024Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRL10 May 2024
- 2024Promptly Predicting Structures: The Return of Inference12 Jan 2024
33 more
- 2023Imitation of Life: A Search Engine for Biologically Inspired Design20 Dec 2023
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP1 Dec 2023
- 2023Dense Retrieval as Indirect Supervision for Large-space Decision Making28 Oct 2023
- 2023Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolution24 May 2023
- 2023Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answering24 May 2023
- 2023Learning Semantic Role Labeling from Compatible Label Sequences24 May 2023
- 2023Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extraction23 May 2023
- 2023Shall We Trust All Relational Tuples by Open Information Extraction? A Study on Speculation Detection7 May 2023
- 2023Creating Custom Event Data Without Dictionaries: A Bag-of-Tricks3 Apr 2023
- 2023Design Choices for Crowdsourcing Implicit Discourse Relations: Revealing the Biases Introduced by Task Design3 Apr 2023
- 2022PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition21 Dec 2022
- 2022Query Your Model with Definitions in FrameNet: An Effective Method for Frame Semantic Role Labeling5 Dec 2022
- 2022Semantic Role Labeling Meets Definition Modeling: Using Natural Language to Describe Predicate-Argument Structures2 Dec 2022
- 2022Life is a Circus and We are the Clowns: Automatically Finding Analogies between Situations and Processes21 Oct 2022
- 2022A Survey on Open Information Extraction from Rule-based Model to Large Language Model18 Aug 2022
- 2022QA Is the New KR: Question-Answer Pairs as Knowledge Bases1 Jul 2022
- 2022DetIE: Multilingual Open Information Extraction Inspired by Object Detection24 Jun 2022
- 2022Asking the Right Questions in Low Resource Template Extraction25 May 2022
- 2022A Question-Answer Driven Approach to Reveal Affirmative Interpretations from Verbal Negations23 May 2022
- 2022QASem Parsing: Text-to-text Modeling of QA-based Semantics23 May 2022
- 2022"What makes a question inquisitive?" A Study on Type-Controlled Inquisitive Question Generation17 May 2022
- 2022Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code29 Apr 2022
- 2021QA-Align: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositions26 Sep 2021
- 2021Text-based NP Enrichment24 Sep 2021
- 2021Sister Help: Data Augmentation for Frame-Semantic Role Labeling16 Sep 2021
- 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainability11 Sep 2021
- 2021Asking It All: Generating Contextualized Questions for any Semantic Role10 Sep 2021
- 2021Draw Me a Flower: Processing and Grounding Abstraction in Natural Language27 Jun 2021
- 2021Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence27 May 2021
- 2021ASQ: Automatically Generating Question-Answer Pairs using AMRs20 May 2021
- 2021Robustly Optimized and Distilled Training for Natural Language Understanding16 Mar 2021
- 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them13 Feb 2021
- 2021LSOIE: A Large-Scale Dataset for Supervised Open Information Extraction27 Jan 2021
- 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
- 2022PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognitioncited by 29
- 2023Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answeringcited by 28
- 2021Asking It All: Generating Contextualized Questions for any Semantic Rolecited by 22
- 2022Life is a Circus and We are the Clowns: Automatically Finding Analogies between Situations and Processescited by 22
- 2021Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violencecited by 19
- 2021An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainabilitycited by 16
- 2021QA-Align: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositionscited by 16
- 2021LSOIE: A Large-Scale Dataset for Supervised Open Information Extractioncited by 15
- 2021Draw Me a Flower: Processing and Grounding Abstraction in Natural Languagecited by 14
- 2023Design Choices for Crowdsourcing Implicit Discourse Relations: Revealing the Biases Introduced by Task Designcited by 14
- 2024Localizing Factual Inconsistencies in Attributable Text Generationcited by 14
12 most cited of 43 All 43 (JSON)
- 2026Task Decomposition for Efficient Annotation23 Jun 2026
- 2026Emergent Semantic Role Understanding in Language Models9 May 2026
- 2026Effective QA-driven Annotation of Predicate-Argument Relations Across Languages26 Feb 2026
- 2025Zero-Shot Open-Vocabulary Human Motion Grounding with Test-Time Training19 Nov 2025
- 2025QA-Noun: Representing Nominal Semantics via Natural Language Question-Answer Pairs16 Nov 2025
- 2025Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesis6 Aug 2025
- 2024QAPyramid: Fine-grained Evaluation of Content Selection for Text Summarization10 Dec 2024
- 2024Localizing Factual Inconsistencies in Attributable Text Generation9 Oct 2024
- 2024Explicating the Implicit: Argument Detection Beyond Sentence Boundaries8 Aug 2024
- 2024Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRL10 May 2024
- 2024Promptly Predicting Structures: The Return of Inference12 Jan 2024
- 2023Imitation of Life: A Search Engine for Biologically Inspired Design20 Dec 2023
12 newest of 43 All 43 (JSON)