# Exploring Contextualized Neural Language Models for Temporal Dependency Parsing

arXiv: https://arxiv.org/abs/2004.14577 · HTML: https://mlsanity.com/paper/2004.14577/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Apr 2020.

## Built on by (most cited first, 7 of 7)

- [Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey](https://mlsanity.com/paper/2111.01243/) (2021)
- [A Survey on Deep Learning Event Extraction: Approaches and Applications](https://mlsanity.com/paper/2107.02126/) (2021)
- [Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answering](https://mlsanity.com/paper/2310.19292/) (2023)
- [Modeling Document-level Temporal Structures for Building Temporal Dependency Graphs](https://mlsanity.com/paper/2210.11787/) (2022)
- [TemPrompt: Multi-Task Prompt Learning for Temporal Relation Extraction in RAG-based Crowdsourcing Systems](https://mlsanity.com/paper/2406.14825/) (2024)
- [Transformer-Based Temporal Information Extraction and Application: A Review](https://mlsanity.com/paper/2504.07470/) (2025)
- [Looking for the Bottleneck in Fine-grained Temporal Relation Classification](https://mlsanity.com/paper/2604.24620/) (2026)

## Abstract (arXiv)

Extracting temporal relations between events and time expressions has many applications such as constructing event timelines and time-related question answering. It is a challenging problem which requires syntactic and semantic information at sentence or discourse levels, which may be captured by deep contextualized language models (LMs) such as BERT (Devlin et al., 2019). In this paper, we develop several variants of BERT-based temporal dependency parser, and show that BERT significantly improves temporal dependency parsing (Zhang and Xue, 2018a). We also present a detailed analysis on why deep contextualized neural LMs help and where they may fall short. Source code and resources are made available at https://github.com/bnmin/tdp_ranking.