Zero-Shot Cross-Lingual Document-Level Event Causality Identification with Heterogeneous Graph Contrastive Transfer Learning
Not on the map. Why?
Abstract (arXiv)
Event Causality Identification (ECI) refers to the detection of causal relations between events in texts. However, most existing studies focus on sentence-level ECI with high-resource languages, leaving more challenging document-level ECI (DECI) with low-resource languages under-explored. In this paper, we propose a Heterogeneous Graph Interaction Model with Multi-granularity Contrastive Transfer Learning (GIMC) for zero-shot cross-lingual document-level ECI. Specifically, we introduce a heterogeneous graph interaction network to model the long-distance dependencies between events that are scattered over a document. Then, to improve cross-lingual transferability of causal knowledge learned from the source language, we propose a multi-granularity contrastive transfer learning module to align the causal representations across languages. Extensive experiments show our framework outperforms the previous state-of-the-art model by 9.4% and 8.2% of average F1 score on monolingual and multilingual scenarios respectively. Notably, in the multilingual scenario, our zero-shot framework even exceeds GPT-3.5 with few-shot learning by 24.3% in overall performance.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 23 of its 51 references that are in the map. First posted on arXiv 5 Mar 2024.
Builds on
23 of 51 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
- 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Promptingcited by 163
- 2021Explaining Answers with Entailment Treescited by 148
- 2023M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language Modelscited by 109
- 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
- 2020CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLPcited by 79
11 more
- 2021Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processingcited by 68
- 2020How Far are We from Effective Context Modeling? An Exploratory Study on Semantic Parsing in Contextcited by 53
- 2019Attention-Informed Mixed-Language Training for Zero-shot Cross-lingual Task-oriented Dialogue Systemscited by 42
- 2023The Life Cycle of Knowledge in Big Language Models: A Surveycited by 23
- 2021Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statementcited by 21
- 2022ERGO: Event Relational Graph Transformer for Document-level Event Causality Identificationcited by 19
- 2016Extracting Temporal and Causal Relations between Eventscited by 16
- 2023Semantic Structure Enhanced Event Causality Identificationcited by 15
- 2021EventNarrative: A large-scale Event-centric Dataset for Knowledge Graph-to-Text Generationcited by 14
- 2022GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understandingcited by 14
- 2019Searching News Articles Using an Event Knowledge Graph Leveraged by Wikidatacited by 13
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 1.
3 papers.
- 2024Document-level Causal Relation Extraction with Knowledge-guided Binary Question Answeringcited by 12
- 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospectscited by 6
- 2026SemEval-2026 Task 12: Abductive Event Reasoning: Towards Real-World Event Causal Inference for Large Language Modelscited by 0
- 2026SemEval-2026 Task 12: Abductive Event Reasoning: Towards Real-World Event Causal Inference for Large Language Models23 Mar 2026
- 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospects15 Nov 2024
- 2024Document-level Causal Relation Extraction with Knowledge-guided Binary Question Answering7 Oct 2024