mlsanityData to 7 Oct 2026

Zero-Shot Cross-Lingual Document-Level Event Causality Identification with Heterogeneous Graph Contrastive Transfer Learning

arXiv 2403.02893 ↗First posted 5 Mar 2024cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Event Causality Identification (ECI) refers to the detection of causal relations between events in texts. However, most existing studies focus on sentence-level ECI with high-resource languages, leaving more challenging document-level ECI (DECI) with low-resource languages under-explored. In this paper, we propose a Heterogeneous Graph Interaction Model with Multi-granularity Contrastive Transfer Learning (GIMC) for zero-shot cross-lingual document-level ECI. Specifically, we introduce a heterogeneous graph interaction network to model the long-distance dependencies between events that are scattered over a document. Then, to improve cross-lingual transferability of causal knowledge learned from the source language, we propose a multi-granularity contrastive transfer learning module to align the causal representations across languages. Extensive experiments show our framework outperforms the previous state-of-the-art model by 9.4% and 8.2% of average F1 score on monolingual and multilingual scenarios respectively. Notably, in the multilingual scenario, our zero-shot framework even exceeds GPT-3.5 with few-shot learning by 24.3% in overall performance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 23 of its 51 references that are in the map. First posted on arXiv 5 Mar 2024.

Builds on

23 of 51 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  6. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  7. 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
  8. 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Promptingcited by 163
  9. 2021Explaining Answers with Entailment Treescited by 148
  10. 2023M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language Modelscited by 109
  11. 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
  12. 2020CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLPcited by 79
11 more
  1. 2021Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processingcited by 68
  2. 2020How Far are We from Effective Context Modeling? An Exploratory Study on Semantic Parsing in Contextcited by 53
  3. 2019Attention-Informed Mixed-Language Training for Zero-shot Cross-lingual Task-oriented Dialogue Systemscited by 42
  4. 2023The Life Cycle of Knowledge in Big Language Models: A Surveycited by 23
  5. 2021Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statementcited by 21
  6. 2022ERGO: Event Relational Graph Transformer for Document-level Event Causality Identificationcited by 19
  7. 2016Extracting Temporal and Causal Relations between Eventscited by 16
  8. 2023Semantic Structure Enhanced Event Causality Identificationcited by 15
  9. 2021EventNarrative: A large-scale Event-centric Dataset for Knowledge Graph-to-Text Generationcited by 14
  10. 2022GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understandingcited by 14
  11. 2019Searching News Articles Using an Event Knowledge Graph Leveraged by Wikidatacited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 1.

3 papers.