Asking the Right Questions in Low Resource Template Extraction
Not on the map. Why?
Abstract (arXiv)
Information Extraction (IE) researchers are mapping tasks to Question Answering (QA) in order to leverage existing large QA resources, and thereby improve data efficiency. Especially in template extraction (TE), mapping an ontology to a set of questions can be more time-efficient than collecting labeled examples. We ask whether end users of TE systems can design these questions, and whether it is beneficial to involve an NLP practitioner in the process. We compare questions to other ways of phrasing natural language prompts for TE. We propose a novel model to perform TE with prompts, and find it benefits from questions over other styles of prompts, and that they do not require an NLP background to author.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 33 references that are in the map. First posted on arXiv 25 May 2022.
Builds on
27 of 33 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2021GPT Understands, Toocited by 716
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 669
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 476
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
- 2021Learning How to Ask: Querying LMs with Mixtures of Soft Promptscited by 377
- 2017End-to-end Neural Coreference Resolutioncited by 241
15 more
- 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 236
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2021How Many Data Points is a Prompt Worth?cited by 198
- 2020Event Extraction by Answering (Almost) Natural Questionscited by 177
- 2021Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Modelscited by 139
- 2019Deeper Text Understanding for IR with Contextual Neural Language Modelingcited by 113
- 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
- 2019Coreference Resolution as Query-based Span Predictioncited by 91
- 2019Multi-Sentence Argument Linkingcited by 81
- 2019Dialog State Tracking: A Neural Reading Comprehension Approachcited by 62
- 2018Large-Scale QA-SRL Parsingcited by 45
- 2019NLProlog: Reasoning with Weak Unification for Question Answering in Natural Languagecited by 37
- 2020Document-Level Event Role Filler Extraction using Multi-Granularity Contextualized Encodingcited by 28
- 2019Reading the Manual: Event Extraction as Definition Comprehensioncited by 26
- 2020Hierarchical Entity Typing via Multi-level Learning to Rankcited by 18
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 1.
4 papers.
- 2022On Event Individuation for Document-Level Information Extractioncited by 2
- 2023FAMuS: Frames Across Multiple Sourcescited by 2
- 2022Gradient Imitation Reinforcement Learning for General Low-Resource Information Extractioncited by 0
- 2024Small Models Are (Still) Effective Cross-Domain Argument Extractorscited by 0
- 2024Small Models Are (Still) Effective Cross-Domain Argument Extractors12 Apr 2024
- 2023FAMuS: Frames Across Multiple Sources9 Nov 2023
- 2022On Event Individuation for Document-Level Information Extraction19 Dec 2022
- 2022Gradient Imitation Reinforcement Learning for General Low-Resource Information Extraction11 Nov 2022