Event Extraction in Large Language Model
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
Large language models (LLMs) and multimodal LLMs are changing event extraction (EE): prompting and generation can often produce structured outputs in zero shot or few shot settings. Yet LLM based pipelines face deployment gaps, including hallucinations under weak constraints, fragile temporal and causal linking over long contexts and across documents, and limited long horizon knowledge management within a bounded context window. We argue that EE should be viewed as a system component that provides a cognitive scaffold for LLM centered solutions. Event schemas and slot constraints create interfaces for grounding and verification; event centric structures act as controlled intermediate representations for stepwise reasoning; event links support relation aware retrieval with graph based RAG; and event stores offer updatable episodic and agent memory beyond the context window. This survey covers EE in text and multimodal settings, organizing tasks and taxonomy, tracing method evolution from rule based and neural models to instruction driven and generative frameworks, and summarizing formulations, decoding strategies, architectures, representations, datasets, and evaluation. We also review cross lingual, low resource, and domain specific settings, and highlight open challenges and future directions for reliable event centric systems. Finally, we outline open challenges and future directions that are central to the LLM era, aiming to evolve EE from static extraction into a structurally reliable, agent ready perception and memory layer for open world systems.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 195 of its 444 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
195 of 444 references.
Closest ancestors · 1
Same direction, newest first
Other references · 194
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2023Visual Instruction Tuningcited by 7,869
38 more
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2024GPT-4o System Cardcited by 4,588
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2021Video Swin Transformercited by 1,091
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
- 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 451
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 262
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2022Unified Structure Generation for Universal Information Extractioncited by 221
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2020Event Extraction by Answering (Almost) Natural Questionscited by 177
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
- 2021Document-Level Event Argument Extraction by Conditional Generationcited by 155
- 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 133
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
- 2021Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extractioncited by 129
- 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 119
- 2020MAVEN: A Massive General Domain Event Detection Datasetcited by 104
- 2021DEGREE: A Data-Efficient Generation-Based Event Extraction Modelcited by 83
- 2019Multi-Sentence Argument Linkingcited by 81
- 2020Grounded Situation Recognitioncited by 78
- 2018A Multi-Axis Annotation Scheme for Event Temporal Relationscited by 75
- 2018Jointly Multiple Events Extraction via Attention-based Graph Information Aggregationcited by 73
- 2022Code4Struct: Code Generation for Few-Shot Event Structure Predictioncited by 70
- 2022MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extractioncited by 66
- 2020Cross-media Structured Common Space for Multimedia Event Extractioncited by 61
50 most cited of 194 All 194 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Graph is a Substrate Across Data Modalitiescited by 14
- 2026AILS-NTUA at SemEval-2026 Task 12: Graph-Based Retrieval and Reflective Prompting for Abductive Event Reasoningcited by 2
- 2026How Confident Is the First Token? An Uncertainty-Calibrated Prompt Optimization Framework for Large Language Model Classification and Understandingcited by 1
- 2026A Multimodal Text- and Graph-Based Approach for Open-Domain Event Extraction from Documentscited by 0
- 2026LMT: A Bayesian Framework for Causal Discovery from Textual Alarm Records in Manufacturing Systemscited by 0
- 2026LMT: A Bayesian Framework for Causal Discovery from Textual Alarm Records in Manufacturing Systems3 Jun 2026
- 2026A Multimodal Text- and Graph-Based Approach for Open-Domain Event Extraction from Documents23 Apr 2026
- 2026AILS-NTUA at SemEval-2026 Task 12: Graph-Based Retrieval and Reflective Prompting for Abductive Event Reasoning4 Mar 2026
- 2026How Confident Is the First Token? An Uncertainty-Calibrated Prompt Optimization Framework for Large Language Model Classification and Understanding23 Feb 2026
- 2026Graph is a Substrate Across Data Modalities29 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024Decompose, Enrich, and Extract! Schema-aware Event Extraction using LLMs
- 2025Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generation
- 2024Event Temporal Relation Extraction based on Retrieval-Augmented on LLMs
- 2026From Single- to Cross-Document: Benchmarking Multi-Granularity Event Analysis of Large Language Models
- 2025Reflective Agreement: Combining Self-Mixture of Agents with a Sequence Tagger for Robust Event Extraction
- 2022Distilling Multi-Scale Knowledge for Event Temporal Relation Extraction
- 2024Analyzing Temporal Complex Events with Large Language Models? A Benchmark towards Temporal, Long Context Understanding
- 2026Evaluating Temporal Reasoning in Large Language Models: Event Temporal Relation Extraction with Allen's Interval Algebra, Logical Consistency, and Relative Time in Narratives