Improving Zero-Shot Event Extraction via Sentence Simplification
Not on the map. Why?
Abstract (arXiv)
The success of sites such as ACLED and Our World in Data have demonstrated the massive utility of extracting events in structured formats from large volumes of textual data in the form of news, social media, blogs and discussion forums. Event extraction can provide a window into ongoing geopolitical crises and yield actionable intelligence. With the proliferation of large pretrained language models, Machine Reading Comprehension (MRC) has emerged as a new paradigm for event extraction in recent times. In this approach, event argument extraction is framed as an extractive question-answering task. One of the key advantages of the MRC-based approach is its ability to perform zero-shot extraction. However, the problem of long-range dependencies, i.e., large lexical distance between trigger and argument words and the difficulty of processing syntactically complex sentences plague MRC-based approaches. In this paper, we present a general approach to improve the performance of MRC-based event extraction by performing unsupervised sentence simplification guided by the MRC model itself. We evaluate our approach on the ICEWS geopolitical event extraction dataset, with specific attention to `Actor' and `Target' argument roles. We show how such context simplification can improve the performance of MRC-based event extraction by more than 5% for actor extraction and more than 10% for target extraction.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 16 of its 34 references that are in the map. First posted on arXiv 6 Apr 2022.
Builds on
16 of 34 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
- 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
- 2020Event Extraction by Answering (Almost) Natural Questionscited by 177
- 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
- 2018Jointly Multiple Events Extraction via Attention-based Graph Information Aggregationcited by 73
- 2017Zero-Shot Transfer Learning for Event Extractioncited by 66
- 2019EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editingcited by 63
- 2018Sentence-Level Fluency Evaluation: References Help, But Can Be Spared!cited by 43
4 more
- 2018Extending a Parser to Distant Domains Using a Few Dozen Partially Annotated Examplescited by 34
- 2020Iterative Edit-Based Unsupervised Sentence Simplificationcited by 33
- 2020Resource-Enhanced Neural Model for Event Argument Extractioncited by 15
- 2014'Beating the news' with EMBERS: Forecasting Civil Unrest using Open Source Indicatorscited by 10
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 2.
5 papers.
- 2023Global Constraints with Prompting for Zero-Shot Event Argument Classificationcited by 8
- 2022Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2022): Workshop and Shared Task Reportcited by 4
- 2024On the use of Silver Standard Data for Zero-shot Classification Tasks in Information Extractioncited by 3
- 2024Robust Claim Verification Through Fact Detectioncited by 3
- 2023A Monte Carlo Language Model Pipeline for Zero-Shot Sociopolitical Event Extractioncited by 2
- 2024Robust Claim Verification Through Fact Detection25 Jul 2024
- 2024On the use of Silver Standard Data for Zero-shot Classification Tasks in Information Extraction28 Feb 2024
- 2023A Monte Carlo Language Model Pipeline for Zero-Shot Sociopolitical Event Extraction24 May 2023
- 2023Global Constraints with Prompting for Zero-Shot Event Argument Classification9 Feb 2023
- 2022Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2022): Workshop and Shared Task Report21 Nov 2022