mlsanityData to 7 Oct 2026

Structured yet Bounded Temporal Understanding in Large Language Models

arXiv 2510.16685 ↗First posted 19 Oct 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) increasingly show strong performance on temporally grounded tasks, such as timeline construction, temporal question answering, and event ordering. However, it remains unclear how their behavior depends on the way time is anchored in language. In this work, we study LLMs' temporal understanding through temporal frames of reference (t-FoRs), contrasting deictic framing (past-present-future) and sequential framing (before-after). Using a large-scale dataset of real-world events from Wikidata and similarity judgement task, we examine how LLMs' outputs vary with temporal distance, interval relations, and event duration. Our results show that LLMs systematically adapt to both t-FoRs, but the resulting similarity patterns differ significantly. Under deictic t-FoR, the similarity judgement scores form graded and asymmetric structures centered on the present, with sharper decline for future events and higher variance in the past. Under sequential t-FoR, similarity becomes strongly negative once events are temporally separated. Temporal judgements are also shaped by interval algebra and duration, with instability concentrated in overlap- and containment-based relations, and duration influencing only past events under deictic t-FoR. Overall, these findings characterize how LLMs organize temporal representation under different reference structures and identify the factors that most strongly shape their temporal understanding.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 19 Oct 2025.

Builds on

22 of 49 references.

References · 22

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  3. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  4. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
  5. 2021A Dataset for Answering Time-Sensitive Questionscited by 150
  6. 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
  7. 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 123
  8. 2019"Going on a vacation" takes longer than "Going for a walk": A Study of Temporal Commonsense Understandingcited by 121
  9. 2024Large Language Models Can Learn Temporal Reasoningcited by 110
  10. 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 83
  11. 2018A Multi-Axis Annotation Scheme for Event Temporal Relationscited by 73
  12. 2021Complex Temporal Question Answering on Knowledge Graphscited by 69
10 more
  1. 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialogcited by 55
  2. 2023Time is Encoded in the Weights of Finetuned Language Modelscited by 31
  3. 2023Are Large Language Models Temporally Grounded?cited by 25
  4. 2024Timo: Towards Better Temporal Reasoning for Language Modelscited by 21
  5. 2023Towards Robust Temporal Reasoning of Large Language Models via a Multi-Hop QA Dataset and Pseudo-Instruction Tuningcited by 18
  6. 2018Improving Temporal Relation Extraction with a Globally Acquired Statistical Resourcecited by 17
  7. 2025ChronoSense: Exploring Temporal Understanding in Large Language Models with Time Intervals of Eventscited by 17
  8. 2023Question Answering as Programming for Solving Time-Sensitive Questionscited by 14
  9. 2023Unlocking Temporal Question Answering for Large Language Models with Tailor-Made Reasoning Logiccited by 7
  10. 2025The Other Mind: How Language Models Exhibit Human Temporal Cognitioncited by 4

Built on by

Not cited yet.