ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizations
Not on the map. Why?
Abstract (arXiv)
The current workflow for Information Extraction (IE) analysts involves the definition of the entities/relations of interest and a training corpus with annotated examples. In this demonstration we introduce a new workflow where the analyst directly verbalizes the entities/relations, which are then used by a Textual Entailment model to perform zero-shot IE. We present the design and implementation of a toolkit with a user interface, as well as experiments on four IE tasks that show that the system achieves very good performance at zero-shot learning using only 5--15 minutes per type of a user's effort. Our demonstration system is open-sourced at https://github.com/BBN-E/ZS4IE . A demonstration video is available at https://vimeo.com/676138340 .
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 25 Mar 2022.
Builds on
17 of 33 references.
References · 17
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2018Constituency Parsing with a Self-Attentive Encodercited by 199
5 more
- 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
- 2021Entailment as Few-Shot Learnercited by 123
- 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
- 2021Zero-Shot Information Extraction as a Unified Text-to-Triple Translationcited by 22
- 2021Ask2Transformers: Zero-Shot Domain labelling with Pre-trained Language Modelscited by 13
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 3.
7 papers.
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 119
- 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learningcited by 25
- 2023What do Language Models know about word senses? Zero-Shot WSD with Language Models and Domain Inventoriescited by 9
- 2024On the use of Silver Standard Data for Zero-shot Classification Tasks in Information Extractioncited by 3
- 2024Improving Recall of Large Language Models: A Model Collaboration Approach for Relational Triple Extractioncited by 3
- 2024Event Extraction in Basque: Typologically motivated Cross-Lingual Transfer-Learning Analysiscited by 2
- 2024Improving Recall of Large Language Models: A Model Collaboration Approach for Relational Triple Extraction15 Apr 2024
- 2024Event Extraction in Basque: Typologically motivated Cross-Lingual Transfer-Learning Analysis9 Apr 2024
- 2024On the use of Silver Standard Data for Zero-shot Classification Tasks in Information Extraction28 Feb 2024
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction5 Oct 2023
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPT20 Feb 2023
- 2023What do Language Models know about word senses? Zero-Shot WSD with Language Models and Domain Inventories7 Feb 2023
- 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning3 May 2022