Zero-Shot On-the-Fly Event Schema Induction
Not on the map. Why?
Abstract (arXiv)
What are the events involved in a pandemic outbreak? What steps should be taken when planning a wedding? The answers to these questions can be found by collecting many documents on the complex event of interest, extracting relevant information, and analyzing it. We present a new approach in which large language models are utilized to generate source documents that allow predicting, given a high-level event definition, the specific events, arguments, and relations between them to construct a schema that describes the complex event in its entirety. Using our model, complete schemas on any topic can be generated on-the-fly without any manual data collection, i.e., in a zero-shot manner. Moreover, we develop efficient methods to extract pertinent information from texts and demonstrate in a series of experiments that these schemas are considered to be more complete than human-curated ones in the majority of examined scenarios. Finally, we show that this framework is comparable in performance with previous supervised schema induction methods that rely on collecting real texts while being more general and flexible without the need for a predefined ontology.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 26 of its 85 references that are in the map. First posted on arXiv 12 Oct 2022.
Builds on
26 of 85 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 262
- 2020Task-Oriented Dialogue as Dataflow Synthesiscited by 122
- 2017Zero-Shot Transfer Learning for Event Extractioncited by 66
- 2020Reasoning about Goals, Steps, and Temporal Ordering with WikiHowcited by 66
- 2019Joint Reasoning for Temporal and Causal Relationscited by 62
- 2020Temporal Reasoning on Implicit Events from Distant Supervisioncited by 58
- 2019Joint Event and Temporal Relation Extraction with Shared Representations and Structured Predictioncited by 53
14 more
- 2020Joint Constrained Learning for Event-Event Relation Extractioncited by 53
- 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 40
- 2020Temporal Common Sense Acquisition with Minimal Supervisioncited by 39
- 2019An Improved Neural Baseline for Temporal Relation Extractioncited by 32
- 2020Unsupervised Label-aware Event Trigger and Argument Classificationcited by 27
- 2020Analogous Process Structure Induction for Sub-event Sequence Predictioncited by 26
- 2020Causal Inference of Script Knowledgecited by 17
- 2017Event Representations with Tensor-based Compositionscited by 14
- 2013Probabilistic Frame Inductioncited by 12
- 2016Joint Learning Templates and Slots for Event Schema Inductioncited by 9
- 2020Pairwise Representation Learning for Event Coreferencecited by 9
- 2021Learning Constraints and Descriptive Segmentation for Subevent Detectioncited by 9
- 2016Two Discourse Driven Language Models for Semanticscited by 8
- 2022Mining Logical Event Schemas From Pre-Trained Language Modelscited by 2
Built on by
Citing papers per year: 2023: 5; 2024: 1; 2025: 3.
9 papers.
- 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoningcited by 45
- 2023Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verificationcited by 19
- 2024Devil's Advocate: Anticipatory Reflection for LLM Agentscited by 17
- 2023Human-in-the-Loop Schema Inductioncited by 13
- 2023Drafting Event Schemas using Language Modelscited by 6
- 2025LOGOS: LLM-driven End-to-End Grounded Theory Development and Schema Induction for Qualitative Researchcited by 6
- 2023We are what we repeatedly do: Inducing and deploying habitual schemas in persona-based responsescited by 3
- 2025Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactionscited by 2
- 2025Event Causality Identification with Synthetic Controlcited by 2
- 2025LOGOS: LLM-driven End-to-End Grounded Theory Development and Schema Induction for Qualitative Research29 Sep 2025
- 2025Event Causality Identification with Synthetic Control16 Sep 2025
- 2025Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactions25 Apr 2025
- 2024Devil's Advocate: Anticipatory Reflection for LLM Agents25 May 2024
- 2023We are what we repeatedly do: Inducing and deploying habitual schemas in persona-based responses10 Oct 2023
- 2023Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verification5 Jul 2023
- 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoning26 May 2023
- 2023Drafting Event Schemas using Language Models24 May 2023
- 2023Human-in-the-Loop Schema Induction25 Feb 2023