mlsanityData to 7 Oct 2026

Harvesting Event Schemas from Large Language Models

arXiv 2305.07280 ↗First posted 12 May 2023cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Event schema provides a conceptual, structural and formal language to represent events and model the world event knowledge. Unfortunately, it is challenging to automatically induce high-quality and high-coverage event schemas due to the open nature of real-world events, the diversity of event expressions, and the sparsity of event knowledge. In this paper, we propose a new paradigm for event schema induction -- knowledge harvesting from large-scale pre-trained language models, which can effectively resolve the above challenges by discovering, conceptualizing and structuralizing event schemas from PLMs. And an Event Schema Harvester (ESHer) is designed to automatically induce high-quality event schemas via in-context generation-based conceptualization, confidence-aware schema structuralization and graph-based schema aggregation. Empirical results show that ESHer can induce high-quality and high-coverage event schemas on varying domains.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 12 May 2023.

Builds on

24 of 55 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2019Language Models as Knowledge Bases?cited by 1,922
  5. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 553
  6. 2019Linguistic Knowledge and Transferability of Contextual Representationscited by 382
  7. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  8. 2022Unified Structure Generation for Universal Information Extractioncited by 220
  9. 2019oLMpics -- On what Language Model Pre-training Capturescited by 161
  10. 2021Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extractioncited by 129
  11. 2022Explanations from Large Language Models Make Small Reasoners Bettercited by 123
  12. 2019Evaluating Commonsense in Pre-trained Language Modelscited by 95
12 more
  1. 2022What Language Model to Train if You Have One Million GPU Hours?cited by 92
  2. 2019Doc2EDAG: An End-to-End Document-level Framework for Chinese Financial Event Extractioncited by 54
  3. 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
  4. 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 39
  5. 2019Open Domain Event Extraction Using Neural Latent Variable Modelscited by 17
  6. 2021Corpus-based Open-Domain Event Type Inductioncited by 17
  7. 2021Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge Transfercited by 17
  8. 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualizationcited by 17
  9. 2013Probabilistic Frame Inductioncited by 12
  10. 2016Joint Learning Templates and Slots for Event Schema Inductioncited by 9
  11. 2022Open Relation and Event Type Discovery with Type Abstractioncited by 9
  12. 2018Unsupervised Semantic Frame Induction using Triclusteringcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 2; 2026: 2.

6 papers.