mlsanityData to 14 Oct 2026

Transformer-Based Temporal Information Extraction and Application: A Review

arXiv 2504.07470 ↗First posted 10 Apr 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Temporal information extraction (IE) aims to extract structured temporal information from unstructured text, thereby uncovering the implicit timelines within. This technique is applied across domains such as healthcare, newswire, and intelligence analysis, aiding models in these areas to perform temporal reasoning and enabling human users to grasp the temporal structure of text. Transformer-based pre-trained language models have produced revolutionary advancements in natural language processing, demonstrating exceptional performance across a multitude of tasks. Despite the achievements garnered by Transformer-based approaches in temporal IE, there is a lack of comprehensive reviews on these endeavors. In this paper, we aim to bridge this gap by systematically summarizing and analyzing the body of work on temporal IE using Transformers while highlighting potential future research directions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 114 references that are in the map. First posted on arXiv 10 Apr 2025.

Builds on

41 of 114 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  8. 2024Large Language Models Can Learn Temporal Reasoningcited by 111
  9. 2018A Multi-Axis Annotation Scheme for Event Temporal Relationscited by 75
  10. 2019Joint Event and Temporal Relation Extraction with Shared Representations and Structured Predictioncited by 53
  11. 2020Joint Constrained Learning for Event-Event Relation Extractioncited by 53
  12. 2023Zero-shot Temporal Relation Extraction with ChatGPTcited by 53
29 more
  1. 2022Generative Knowledge Graph Construction: A Reviewcited by 49
  2. 2020ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoningcited by 38
  3. 2019An Improved Neural Baseline for Temporal Relation Extractioncited by 32
  4. 2019Deep Structured Neural Network for Event Temporal Relation Extractioncited by 25
  5. 2020Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inferencecited by 20
  6. 2021Extracting Temporal Event Relation with Syntax-guided Graph Transformercited by 16
  7. 2020Domain Knowledge Empowered Structured Neural Net for End-to-End Event Temporal Relation Extractioncited by 15
  8. 2022Extracting or Guessing? Improving Faithfulness of Event Temporal Relation Extractioncited by 15
  9. 2023More than Classification: A Unified Framework for Event Temporal Relation Extractioncited by 15
  10. 2023Salient Span Masking for Temporal Understandingcited by 14
  11. 2021Extracting Event Temporal Relations via Hyperbolic Geometrycited by 13
  12. 2020Severing the Edge Between Before and After: Neural Architectures for Temporal Ordering of Eventscited by 12
  13. 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoningcited by 11
  14. 2020A Survey on Temporal Reasoning for Temporal Information Extraction from Text (Extended Abstract)cited by 10
  15. 2023Event Temporal Relation Extraction with Bayesian Translational Modelcited by 10
  16. 2020Effective Distant Supervision for Temporal Relation Extractioncited by 8
  17. 2020Exploring Contextualized Neural Language Models for Temporal Dependency Parsingcited by 7
  18. 2022Multilingual Normalization of Temporal Expressions with Masked Language Modelscited by 7
  19. 2020What time is it? Temporal Analysis of Novelscited by 6
  20. 2022Distilling Multi-Scale Knowledge for Event Temporal Relation Extractioncited by 6
  21. 2019Contextualized Word Embeddings Enhanced Event Temporal Relation Extraction for Story Understandingcited by 5
  22. 2023Dynamically Updating Event Representations for Temporal Relation Classification with Multi-category Learningcited by 5
  23. 2019NarrativeTime: Dense Temporal Annotation on a Timelinecited by 4
  24. 2021BERT got a Date: Introducing Transformers to Temporal Taggingcited by 4
  25. 2022XLTime: A Cross-Lingual Knowledge Transfer Framework for Temporal Expression Extractioncited by 4
  26. 2023Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answeringcited by 3
  27. 2025Beyond Pairwise: Global Zero-shot Temporal Graph Generationcited by 3
  28. 2018Structured Interpretation of Temporal Relationscited by 2
  29. 2020Evaluating the Effect of Timeline Shape on Visualization Task Performancecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026CRAFT: LLM-Based Iterative Refinement for Temporal Reasoning over Clinical Narrativescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models
  2. 2025Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approach
  3. 2025Fusing Large Language Models with Temporal Transformers for Time Series Forecasting
  4. 2025Linguistic Interpretability of Transformer-based Language Models: a systematic review
  5. 2025A Survey on Transformer Context Extension: Approaches and Evaluation
  6. 2025Event Extraction in Large Language Model
  7. 2024Event Temporal Relation Extraction based on Retrieval-Augmented on LLMs
  8. 2025It's High Time: A Survey of Temporal Question Answering