EDM3: Event Detection as Multi-task Text Generation
Not on the map. Why?
Abstract (arXiv)
Event detection refers to identifying event occurrences in a text and comprises of two subtasks; event identification and classification. We present EDM3, a novel approach for Event Detection that formulates three generative tasks: identification, classification, and combined detection. We show that EDM3 helps to learn transferable knowledge that can be leveraged to perform Event Detection and its subtasks concurrently, mitigating the error propagation inherent in pipelined approaches. Unlike previous dataset- or domain-specific approaches, EDM3 utilizes the existing knowledge of language models, allowing it to be trained over any classification schema. We evaluate EDM3 on multiple event detection datasets: RAMS, WikiEvents, MAVEN, and MLEE, showing that EDM3 outperforms 1) single-task performance by 8.4% on average and 2) multi-task performance without instructional prompts by 2.4% on average. We obtain SOTA results on RAMS (71.3% vs. 65.1% F-1) and competitive performance on other datasets. We analyze our approach to demonstrate its efficacy in low-resource and multi-sentence settings. We also show the effectiveness of this approach on non-standard event configurations such as multi-word and multi-class event triggers. Overall, our results show that EDM3 is a promising approach for Event Detection that has the potential for real-world applications.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 52 of its 119 references that are in the map. First posted on arXiv 25 May 2023.
Builds on
52 of 119 references.
References · 52
- 2017Attention Is All You Needcited by 59,932
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
- 2021Do Prompt-Based Models Really Understand the Meaning of their Prompts?cited by 324
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
- 2018code2vec: Learning Distributed Representations of Codecited by 249
38 more
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2022Unified Structure Generation for Universal Information Extractioncited by 220
- 2017Learning to Represent Programs with Graphscited by 219
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2020Event Extraction by Answering (Almost) Natural Questionscited by 177
- 2021Reframing Instructional Prompts to GPTk's Languagecited by 176
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
- 2021Document-Level Event Argument Extraction by Conditional Generationcited by 154
- 2016DeepCoder: Learning to Write Programscited by 145
- 2021Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extractioncited by 129
- 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
- 2020MAVEN: A Massive General Domain Event Detection Datasetcited by 103
- 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
- 2020The Turking Test: Can Language Models Understand Instructions?cited by 82
- 2019Multi-Sentence Argument Linkingcited by 80
- 2021When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Datacited by 75
- 2018Jointly Multiple Events Extraction via Attention-based Graph Information Aggregationcited by 73
- 2017Code Completion with Neural Attention and Pointer Networkscited by 49
- 2021Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions?cited by 46
- 2018Neural-Guided Deductive Search for Real-Time Program Synthesis from Examplescited by 39
- 2018Learning to Represent Editscited by 34
- 2021Learning to Generate Task-Specific Adapters from Task Descriptioncited by 28
- 2020Unsupervised Label-aware Event Trigger and Argument Classificationcited by 27
- 2020Event-QA: A Dataset for Event-Centric Question Answering over Knowledge Graphscited by 26
- 2021Query and Extract: Refining Event Extraction as Type-oriented Binary Decodingcited by 26
- 2020Event Detection: Gate Diversity and Syntactic Importance Scoresfor Graph Convolution Neural Networkscited by 23
- 2021OntoED: Low-resource Event Detection with Ontology Embeddingcited by 23
- 2023InstructABSA: Instruction Learning for Aspect Based Sentiment Analysiscited by 22
- 2021Context-NER : Contextual Phrase Generation at Scalecited by 11
- 2018Implicit Argument Prediction with Event Knowledgecited by 9
- 2022The Art of Prompting: Event Detection based on Type Specific Promptscited by 9
- 2018Event Nugget Detection with Forward-Backward Recurrent Neural Networkscited by 7
- 2021Generating Disentangled Arguments with Prompts: A Simple Event Extraction Framework that Workscited by 6
- 2019Extending Event Detection to New Types with Learning from Keywordscited by 5
- 2021Empirical Analysis on Effectiveness of NLP Methods for Predicting Code Smellcited by 4
- 2021An Empirical Study on Predictability of Software Code Smell Using Deep Learning Modelscited by 4
- 2017Biomedical Event Trigger Identification Using Bidirectional Recurrent Neural Network Based Modelscited by 3
- 2021Prediction of Students performance with Artificial Neural Network using Demographic Traitscited by 3
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2023: 3.
3 papers.