mlsanityData to 14 Oct 2026

Zero-shot Temporal Relation Extraction with ChatGPT

arXiv 2304.05454 ↗First posted 11 Apr 2023cs.CL cs.AIcited by 53

Not on the map. Why?

Abstract (arXiv)

The goal of temporal relation extraction is to infer the temporal relation between two events in the document. Supervised models are dominant in this task. In this work, we investigate ChatGPT's ability on zero-shot temporal relation extraction. We designed three different prompt techniques to break down the task and evaluate ChatGPT. Our experiments show that ChatGPT's performance has a large gap with that of supervised methods and can heavily rely on the design of prompts. We further demonstrate that ChatGPT can infer more small relation classes correctly than supervised methods. The current shortcomings of ChatGPT on temporal relation extraction are also discussed in this paper. We found that ChatGPT cannot keep consistency during temporal inference and it fails in actively long-dependency temporal inference.

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 21 of its 43 references that are in the map. First posted on arXiv 11 Apr 2023.

Builds on

21 of 43 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  6. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  7. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  8. 2017Zero-Shot Learning -- The Good, the Bad and the Uglycited by 255
  9. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  10. 2023A Categorical Archive of ChatGPT Failurescited by 168
  11. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 154
  12. 2023Exploring the Feasibility of ChatGPT for Event Extractioncited by 76
9 more
  1. 2018A Multi-Axis Annotation Scheme for Event Temporal Relationscited by 75
  2. 2019Joint Event and Temporal Relation Extraction with Shared Representations and Structured Predictioncited by 53
  3. 2019TEQUILA: Temporal Question Answering over Knowledge Basescited by 47
  4. 2019A Structured Learning Approach to Temporal Relation Extractioncited by 25
  5. 2019Deep Structured Neural Network for Event Temporal Relation Extractioncited by 25
  6. 2018Improving Temporal Relation Extraction with a Globally Acquired Statistical Resourcecited by 17
  7. 2022Extracting or Guessing? Improving Faithfulness of Event Temporal Relation Extractioncited by 15
  8. 2022Distilling Multi-Scale Knowledge for Event Temporal Relation Extractioncited by 6
  9. 2018Temporal Grounding Graphs for Language Understanding with Accrued Visual-Linguistic Contextcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 16; 2024: 21; 2025: 13; 2026: 3.

53 papers.

Sort:

By area:

  1. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
  2. 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
  3. 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasetscited by 123
  4. 2023HI-TOM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Modelscited by 63
  5. 2024Reinforcement Learning from Human Feedback with Active Queriescited by 43
  6. 2023Exploring the Potential of Large Language Models in Computational Argumentationcited by 42
  7. 2023ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relationscited by 40
  8. 2023Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistancecited by 33
  9. 2024Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoringcited by 33
  10. 2023Primacy Effect of ChatGPTcited by 27
  11. 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
  12. 2023An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processingcited by 19
38 more
  1. 2024UrbanKGent: A Unified Large Language Model Agent Framework for Urban Knowledge Graph Constructioncited by 15
  2. 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 15
  3. 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questionscited by 15
  4. 2023Getting Sick After Seeing a Doctor? Diagnosing and Mitigating Knowledge Conflicts in Event Temporal Reasoningcited by 13
  5. 2024ULTRA: Unleash LLMs' Potential for Event Argument Extraction through Hierarchical Modeling and Pair-wise Self-Refinementcited by 12
  6. 2025A Study into Investigating Temporal Robustness of LLMscited by 11
  7. 2025A Large-Language Model Framework for Relative Timeline Extraction from PubMed Case Reportscited by 10
  8. 2025Hypothesis-Driven Feature Manifold Analysis in LLMs via Supervised Multi-Dimensional Scalingcited by 8
  9. 2024Analysing zero-shot temporal relation extraction on clinical notes using temporal consistencycited by 7
  10. 2024Are LLMs Good Annotators for Discourse-level Event Relation Extraction?cited by 7
  11. 2023EvEval: A Comprehensive Evaluation of Event Semantics for Large Language Modelscited by 6
  12. 2023The Limits of ChatGPT in Extracting Aspect-Category-Opinion-Sentiment Quadruples: A Comparative Analysiscited by 6
  13. 2024Will LLMs Replace the Encoder-Only Models in Temporal Relation Classification?cited by 6
  14. 2025CoRank: LLM-Based Compact Reranking with Document Features for Scientific Retrievalcited by 5
  15. 2024A Comprehensive Evaluation on Event Reasoning of Large Language Modelscited by 4
  16. 2025Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approachcited by 4
  17. 2024Improving Recall of Large Language Models: A Model Collaboration Approach for Relational Triple Extractioncited by 3
  18. 2024Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Modelscited by 3
  19. 2024Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasingcited by 3
  20. 2025Beyond Pairwise: Global Zero-shot Temporal Graph Generationcited by 3
  21. 2025GLiDRE: Generalist Lightweight model for Document-level Relation Extractioncited by 3
  22. 2023A Monte Carlo Language Model Pipeline for Zero-Shot Sociopolitical Event Extractioncited by 2
  23. 2023Leveraging Codebook Knowledge with NLI and ChatGPT for Zero-Shot Political Relation Classificationcited by 2
  24. 2024Exploring ChatGPT for Next-generation Information Retrieval: Opportunities and Challengescited by 2
  25. 2024Adaptation of Biomedical and Clinical Pretrained Models to French Long Documents: A Comparative Studycited by 2
  26. 2024Formulation Comparison for Timeline Construction using LLMscited by 2
  27. 2024RAG-based Crowdsourcing Task Decomposition via Masked Contrastive Learning with Promptscited by 2
  28. 2024Exploring Spatial Representations in the Historical Lake District Texts with LLM-based Relation Extractioncited by 2
  29. 2025Beyond path selection: Better LLMs for Scientific Information Extraction with MimicSFT and Relevance and Rule-induced(R2)GRPOcited by 2
  30. 2025GDLLM: A Global Distance-aware Modeling Approach Based on Large Language Models for Event Temporal Relation Extractioncited by 2
  31. 2023Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environmentcited by 1
  32. 2023BOOST: Harnessing Black-Box Control to Boost Commonsense in LMs' Generationcited by 1
  33. 2024Evaluation of General Large Language Models in Contextually Assessing Semantic Concepts Extracted from Adult Critical Care Electronic Health Record Notescited by 1
  34. 2024TemPrompt: Multi-Task Prompt Learning for Temporal Relation Extraction in RAG-based Crowdsourcing Systemscited by 1
  35. 2025Transformer-Based Temporal Information Extraction and Application: A Reviewcited by 1
  36. 2025Distilling Closed-Source LLM's Knowledge for Locally Stable and Economic Biomedical Entity Linkingcited by 1
  37. 2024Predicting Rewards Alongside Tokens: Non-disruptive Parameter Insertion for Efficient Inference Intervention in Large Language Modelcited by 0
  38. 2025A Structured Literature Review on Traditional Approaches in Current Natural Language Processingcited by 0

50 most cited of 53 All 53 (JSON)