mlsanityData to 14 Oct 2026

Question Answering Over Temporal Knowledge Graphs

arXiv 2106.01515 ↗First posted 3 Jun 2021cs.LGcited by 99

Not on the map. Why?

Abstract (arXiv)

Temporal Knowledge Graphs (Temporal KGs) extend regular Knowledge Graphs by providing temporal scopes (start and end times) on each edge in the KG. While Question Answering over KG (KGQA) has received some attention from the research community, QA over Temporal KGs (Temporal KGQA) is a relatively unexplored area. Lack of broad coverage datasets has been another factor limiting progress in this area. We address this challenge by presenting CRONQUESTIONS, the largest known Temporal KGQA dataset, clearly stratified into buckets of structural complexity. CRONQUESTIONS expands the only known previous dataset by a factor of 340x. We find that various state-of-the-art KGQA methods fall far short of the desired performance on this new dataset. In response, we also propose CRONKGQA, a transformer-based solution that exploits recent advances in Temporal KG embeddings, and achieves performance superior to all baselines, with an increase of 120% in accuracy over the next best performing method. Through extensive experiments, we give detailed insights into the workings of CRONKGQA, as well as situations where significant further improvements appear possible. In addition to the dataset, we have released our code as well.

Key facts. Cited by 99 papers in the map (data through 14 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 3 Jun 2021.

Builds on

24 of 43 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  7. 2019Language Models as Knowledge Bases?cited by 1,936
  8. 2016Complex Embeddings for Simple Link Predictioncited by 902
  9. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
  10. 2019Knowledge Enhanced Contextual Word Representationscited by 296
  11. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  12. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
12 more
  1. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  2. 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
  3. 2018Learning Sequence Encoders for Temporal Knowledge Graph Completioncited by 145
  4. 2020Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasetscited by 138
  5. 2015Large-scale Simple Question Answering with Memory Networkscited by 127
  6. 2020Tensor Decompositions for temporal knowledge base completioncited by 115
  7. 2019Diachronic Embedding for Temporal Knowledge Graph Completioncited by 104
  8. 2020Entities as Experts: Sparse Memory Access with Entity Supervisioncited by 100
  9. 2020TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questionscited by 65
  10. 2019InteractE: Improving Convolution-based Knowledge Graph Embeddings by Increasing Feature Interactionscited by 58
  11. 2020Scalable Neural Methods for Reasoning With a Symbolic Knowledge Basecited by 32
  12. 2020Temporal Knowledge Base Completion: New Algorithms and Evaluation Protocolscited by 30

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 7; 2022: 14; 2023: 18; 2024: 21; 2025: 27; 2026: 12.

99 papers.

Sort:

By area:

  1. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
  2. 2021A Dataset for Answering Time-Sensitive Questionscited by 154
  3. 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
  4. 2023Document Understanding Dataset and Evaluation (DUDE)cited by 135
  5. 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 126
  6. 2021Complex Temporal Question Answering on Knowledge Graphscited by 69
  7. 2023Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Modelscited by 37
  8. 2021ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collectionscited by 30
  9. 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
  10. 2023Time-aware Multiway Adaptive Fusion Network for Temporal Knowledge Graph Question Answeringcited by 27
  11. 2023TempTabQA: Temporal Question Answering for Semi-Structured Tablescited by 27
  12. 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
38 more
  1. 2022Improving Time Sensitivity for Question Answering over Temporal Knowledge Graphscited by 26
  2. 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answeringcited by 25
  3. 2024Set the Clock: Temporal Alignment of Pretrained Language Modelscited by 25
  4. 2023TEILP: Time Prediction over Knowledge Graphs via Logical Reasoningcited by 23
  5. 2022Learning to Sample and Aggregate: Few-shot Reasoning over Temporal Knowledge Graphscited by 21
  6. 2024Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Modelscited by 18
  7. 2025ChronoSense: Exploring Temporal Understanding in Large Language Models with Time Intervals of Eventscited by 18
  8. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  9. 2024UnSeenTimeQA: Time-Sensitive Question-Answering Beyond LLMs' Memorizationcited by 17
  10. 2024MRAG: A Modular Retrieval Framework for Time-Sensitive Question Answeringcited by 17
  11. 2022ReaRev: Adaptive Reasoning for Question Answering over Knowledge Graphscited by 16
  12. 2024PAT-Questions: A Self-Updating Benchmark for Present-Anchored Temporal Question-Answeringcited by 15
  13. 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questionscited by 15
  14. 2022Knowledge Graph Question Answering Leaderboard: A Community Resource to Prevent a Replication Crisiscited by 14
  15. 2023TempEL: Linking Dynamically Evolving and Newly Emerging Entitiescited by 14
  16. 2023Question Answering as Programming for Solving Time-Sensitive Questionscited by 14
  17. 2025Episodic Memories Generation and Evaluation Benchmark for Large Language Modelscited by 14
  18. 2025It's High Time: A Survey of Temporal Question Answeringcited by 14
  19. 2022Knowledge Graph Question Answering Datasets and Their Generalizability: Are They Enough for Future Research?cited by 13
  20. 2023zrLLM: Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Modelscited by 13
  21. 2024Faithful Temporal Question Answering over Heterogeneous Sourcescited by 13
  22. 2024EvoWiki: Evaluating LLMs on Evolving Knowledgecited by 13
  23. 2025HoH: A Dynamic Benchmark for Evaluating the Impact of Outdated Information on Retrieval-Augmented Generationcited by 13
  24. 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
  25. 2024TrustUQA: A Trustful Framework for Unified Structured Data Question Answeringcited by 12
  26. 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoningcited by 11
  27. 2024GrowOVER: How Can LLMs Adapt to Growing Real-World Knowledge?cited by 11
  28. 2025A Study into Investigating Temporal Robustness of LLMscited by 11
  29. 2022TwiRGCN: Temporally Weighted Graph Convolution for Question Answering over Temporal Knowledge Graphscited by 10
  30. 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answeringcited by 10
  31. 2022A Benchmark for Generalizable and Interpretable Temporal Question Answering over Knowledge Basescited by 9
  32. 2022ForecastTKGQuestions: A Benchmark for Temporal Question Answering and Forecasting over Temporal Knowledge Graphscited by 9
  33. 2024Temporal Knowledge Graph Question Answering: A Surveycited by 9
  34. 2024Enhancing Temporal Sensitivity and Reasoning for Time-Sensitive Question Answeringcited by 9
  35. 2021SYGMA: System for Generalizable Modular Question Answering OverKnowledge Basescited by 8
  36. 2023Toward Practical Entity Alignment Method Design: Insights from New Highly Heterogeneous Knowledge Graph Datasetscited by 8
  37. 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tablescited by 8
  38. 2025TCP: a Benchmark for Temporal Constraint-Based Planningcited by 8

50 most cited of 99 All 99 (JSON)