Complex Temporal Question Answering on Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
Question answering over knowledge graphs (KG-QA) is a vital topic in IR. Questions with temporal intent are a special class of practical importance, but have not received much attention in research. This work presents EXAQT, the first end-to-end system for answering complex temporal questions that have multiple entities and predicates, and associated temporal conditions. EXAQT answers natural language questions over KGs in two stages, one geared towards high recall, the other towards precision at top ranks. The first step computes question-relevant compact subgraphs within the KG, and judiciously enhances them with pertinent temporal facts, using Group Steiner Trees and fine-tuned BERT models. The second step constructs relational graph convolutional networks (R-GCNs) from the first step's output, and enhances the R-GCNs with time-aware entity embeddings and attention over temporal relations. We evaluate EXAQT on TimeQuestions, a large dataset of 16k temporal questions we compiled from a variety of general purpose KG-QA benchmarks. Results show that EXAQT outperforms three state-of-the-art systems for answering complex questions over KGs, thereby justifying specialized treatment of temporal QA.
Key facts. Cited by 69 papers in the map (data through 14 Oct 2026). Builds on 26 of its 81 references that are in the map. First posted on arXiv 18 Sep 2021.
Builds on
26 of 81 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
- 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
- 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
- 2017Know-Evolve: Deep Temporal Reasoning for Dynamic Knowledge Graphscited by 149
- 2018Learning Sequence Encoders for Temporal Knowledge Graph Completioncited by 145
- 2020Tensor Decompositions for temporal knowledge base completioncited by 115
14 more
- 2019Diachronic Embedding for Temporal Knowledge Graph Completioncited by 104
- 2021Question Answering Over Temporal Knowledge Graphscited by 99
- 2020Efficient One-Pass End-to-End Entity Linking for Questionscited by 76
- 2020REL: An Entity Linker Standing on the Shoulders of Giantscited by 61
- 2020UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answeringcited by 61
- 2019TEQUILA: Temporal Question Answering over Knowledge Basescited by 47
- 2018ComQA: A Community-sourced Dataset for Complex Factoid Question Answering with Paraphrase Clusterscited by 29
- 2020Event-QA: A Dataset for Event-Centric Question Answering over Knowledge Graphscited by 26
- 2019Message Passing for Complex Question Answering over Knowledge Graphscited by 24
- 2019Answering Complex Questions by Joining Multi-Document Evidence with Quasi Knowledge Graphscited by 21
- 2021Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphscited by 18
- 2020Question Answering over Curated and Open Web Sourcescited by 6
- 2014Enhancing QA Systems with Complex Temporal Question Processing Capabilitiescited by 4
- 2015Combining Temporal Information and Topic Modeling for Cross-Document Event Orderingcited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 12; 2023: 12; 2024: 19; 2025: 14; 2026: 10.
69 papers.
Sort:
By area:
- 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 126
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 88
- 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Modelscited by 73
- 2023Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Modelscited by 37
- 2022Modern Baselines for SPARQL Semantic Parsingcited by 34
- 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunitiescited by 31
- 2023Time-aware Multiway Adaptive Fusion Network for Temporal Knowledge Graph Question Answeringcited by 27
- 2023TempTabQA: Temporal Question Answering for Semi-Structured Tablescited by 27
- 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
- 2022Improving Time Sensitivity for Question Answering over Temporal Knowledge Graphscited by 26
- 2022Conversational Question Answering on Heterogeneous Sourcescited by 26
- 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answeringcited by 25
38 more
- 2024Set the Clock: Temporal Alignment of Pretrained Language Modelscited by 25
- 2024Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Modelscited by 18
- 2025ChronoSense: Exploring Temporal Understanding in Large Language Models with Time Intervals of Eventscited by 18
- 2024MRAG: A Modular Retrieval Framework for Time-Sensitive Question Answeringcited by 17
- 2024PAT-Questions: A Self-Updating Benchmark for Present-Anchored Temporal Question-Answeringcited by 15
- 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questionscited by 15
- 2022Knowledge Graph Question Answering Leaderboard: A Community Resource to Prevent a Replication Crisiscited by 14
- 2023Question Answering as Programming for Solving Time-Sensitive Questionscited by 14
- 2025It's High Time: A Survey of Temporal Question Answeringcited by 14
- 2022Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuningcited by 13
- 2022Knowledge Graph Question Answering Datasets and Their Generalizability: Are They Enough for Future Research?cited by 13
- 2024Faithful Temporal Question Answering over Heterogeneous Sourcescited by 13
- 2024EvoWiki: Evaluating LLMs on Evolving Knowledgecited by 13
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
- 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoningcited by 11
- 2022TwiRGCN: Temporally Weighted Graph Convolution for Question Answering over Temporal Knowledge Graphscited by 10
- 2022A Benchmark for Generalizable and Interpretable Temporal Question Answering over Knowledge Basescited by 9
- 2022ForecastTKGQuestions: A Benchmark for Temporal Question Answering and Forecasting over Temporal Knowledge Graphscited by 9
- 2024Temporal Knowledge Graph Question Answering: A Surveycited by 9
- 2024Enhancing Temporal Sensitivity and Reasoning for Time-Sensitive Question Answeringcited by 9
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tablescited by 8
- 2025Hypothesis-Driven Feature Manifold Analysis in LLMs via Supervised Multi-Dimensional Scalingcited by 8
- 2022Interactive Question Answering Systems: Literature Reviewcited by 7
- 2024RAG-based Question Answering over Heterogeneous Data and Textcited by 7
- 2023GETT-QA: Graph Embedding based T2T Transformer for Knowledge Graph Question Answeringcited by 6
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
- 2024Joint Multi-Facts Reasoning Network For Complex Temporal Question Answering Over Knowledge Graphcited by 6
- 2024Self-Improvement Programming for Temporal Knowledge Graph Question Answeringcited by 5
- 2025TimelineKGQA: A Comprehensive Question-Answer Pair Generator for Temporal Knowledge Graphscited by 5
- 2026Temp-R1: A Unified Autonomous Agent for Complex Temporal KGQA via Reverse Curriculum Reinforcement Learningcited by 5
- 2022Semantic Framework based Query Generation for Temporal Question Answering over Knowledge Graphscited by 3
- 2023Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answeringcited by 3
- 2025TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit Referencescited by 3
- 2024Temporally Consistent Factuality Probing for Large Language Modelscited by 2
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answeringcited by 2
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrievalcited by 2
- 2024Semantic Parsing with Candidate Expressions for Knowledge Base Question Answeringcited by 1
- 2025A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphscited by 1
50 most cited of 69 All 69 (JSON)
- 2026TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval23 Sep 2026
- 2026TimelyRAG: Semantic-Temporal Hybrid Retrieval for Time-Critical Question Answering in Overlapping-Evolving Documents10 Sep 2026
- 2026SCoP: Structured Constraint Parsing for Evidence-Space Control in Temporal Knowledge Graph Question Answering2 Sep 2026
- 2026SABET-QA: Temporal Knowledge Graph Question Answering20 Aug 2026
- 2026FITTER: Vocabulary-Agnostic Cross-Domain Inference on Temporal Knowledge Graphs11 Aug 2026
- 2026Poisson-Gamma Modeling of Inter-Relational Dependencies in Dynamic Knowledge Graphs3 Jul 2026
- 2026Knowledge Graphs Meet Graph Neural Networks: A Comprehensive Survey12 May 2026
- 2026Let the Agent Search: Autonomous Exploration Beats Rigid Workflows in Temporal Question Answering2 Mar 2026
- 2026Temp-R1: A Unified Autonomous Agent for Complex Temporal KGQA via Reverse Curriculum Reinforcement Learning26 Jan 2026
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrieval9 Jan 2026
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering6 Nov 2025
- 2025Structured yet Bounded Temporal Understanding in Large Language Models19 Oct 2025
38 more
- 2025Temporal Referential Consistency: Do LLMs Favor Sequences Over Absolute Time References?17 Oct 2025
- 2025Hypothesis-Driven Feature Manifold Analysis in LLMs via Supervised Multi-Dimensional Scaling1 Oct 2025
- 2025Evaluating List Construction and Temporal Understanding capabilities of Large Language Models26 Jun 2025
- 2025A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs17 Jun 2025
- 2025It's High Time: A Survey of Temporal Question Answering26 May 2025
- 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunities26 May 2025
- 2025TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit References2 May 2025
- 2025Beyond Single Pass, Looping Through Time: KG-IRAG with Iterative Knowledge Retrieval18 Mar 2025
- 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questions28 Feb 2025
- 2025MTPChat: A Multimodal Time-Aware Persona Dataset for Conversational Agents9 Feb 2025
- 2025TimelineKGQA: A Comprehensive Question-Answer Pair Generator for Temporal Knowledge Graphs8 Jan 2025
- 2025ChronoSense: Exploring Temporal Understanding in Large Language Models with Time Intervals of Events6 Jan 2025
- 2024MRAG: A Modular Retrieval Framework for Time-Sensitive Question Answering20 Dec 2024
- 2024EvoWiki: Evaluating LLMs on Evolving Knowledge18 Dec 2024
- 2024Multilingual LLMs Inherently Reward In-Language Time-Sensitive Semantic Alignment for Low-Resource Languages11 Dec 2024
- 2024RAG-based Question Answering over Heterogeneous Data and Text10 Dec 2024
- 2024Neon: News Entity-Interaction Extraction for Enhanced Question Answering19 Nov 2024
- 2024Semantic Parsing with Candidate Expressions for Knowledge Base Question Answering1 Oct 2024
- 2024Enhancing Temporal Sensitivity and Reasoning for Time-Sensitive Question Answering25 Sep 2024
- 2024Temporally Consistent Factuality Probing for Large Language Models21 Sep 2024
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tables22 Jul 2024
- 2024Temporal Knowledge Graph Question Answering: A Survey20 Jun 2024
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning13 Jun 2024
- 2024Self-Improvement Programming for Temporal Knowledge Graph Question Answering2 Apr 2024
- 2024Set the Clock: Temporal Alignment of Pretrained Language Models26 Feb 2024
- 2024Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Models26 Feb 2024
- 2024Faithful Temporal Question Answering over Heterogeneous Sources23 Feb 2024
- 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answering20 Feb 2024
- 2024PAT-Questions: A Self-Updating Benchmark for Present-Anchored Temporal Question-Answering16 Feb 2024
- 2024Progressive Distillation Based on Masked Generation Feature Method for Knowledge Graph Completion19 Jan 2024
- 2024Joint Multi-Facts Reasoning Network For Complex Temporal Question Answering Over Knowledge Graph4 Jan 2024
- 2023TempTabQA: Temporal Question Answering for Semi-Structured Tables14 Nov 2023
- 2023Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answering30 Oct 2023
- 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoning23 Oct 2023
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models9 Oct 2023
- 2023GradXKG: A Universal Explain-per-use Temporal Knowledge Graph Explainer7 Oct 2023
- 2023Leveraging Pre-trained Language Models for Time Interval Prediction in Text-Enhanced Temporal Knowledge Graphs28 Sep 2023
- 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models17 Aug 2023
50 newest of 69 All 69 (JSON)
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 88
- 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Modelscited by 73
- 2023Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Modelscited by 37
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
- 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoningcited by 11
- 2022TwiRGCN: Temporally Weighted Graph Convolution for Question Answering over Temporal Knowledge Graphscited by 10
- 2024Enhancing Temporal Sensitivity and Reasoning for Time-Sensitive Question Answeringcited by 9
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tablescited by 8
- 2023Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answeringcited by 3
- 2025TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit Referencescited by 3
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrievalcited by 2
- 2024Multilingual LLMs Inherently Reward In-Language Time-Sensitive Semantic Alignment for Low-Resource Languagescited by 0
12 most cited of 13 All 13 (JSON)
- 2026Let the Agent Search: Autonomous Exploration Beats Rigid Workflows in Temporal Question Answering2 Mar 2026
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrieval9 Jan 2026
- 2025TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit References2 May 2025
- 2024Multilingual LLMs Inherently Reward In-Language Time-Sensitive Semantic Alignment for Low-Resource Languages11 Dec 2024
- 2024Enhancing Temporal Sensitivity and Reasoning for Time-Sensitive Question Answering25 Sep 2024
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tables22 Jul 2024
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning13 Jun 2024
- 2023Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answering30 Oct 2023
- 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoning23 Oct 2023
- 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models17 Aug 2023
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operation15 Jul 2023
- 2023Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Models15 Jun 2023
12 newest of 13 All 13 (JSON)
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answeringcited by 2
- 2026TimelyRAG: Semantic-Temporal Hybrid Retrieval for Time-Critical Question Answering in Overlapping-Evolving Documentscited by 1
- 2025Beyond Single Pass, Looping Through Time: KG-IRAG with Iterative Knowledge Retrievalcited by 0
- 2026TimelyRAG: Semantic-Temporal Hybrid Retrieval for Time-Critical Question Answering in Overlapping-Evolving Documents10 Sep 2026
- 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering6 Nov 2025
- 2025Beyond Single Pass, Looping Through Time: KG-IRAG with Iterative Knowledge Retrieval18 Mar 2025
- 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 126
- 2022Modern Baselines for SPARQL Semantic Parsingcited by 34
- 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunitiescited by 31
- 2023Time-aware Multiway Adaptive Fusion Network for Temporal Knowledge Graph Question Answeringcited by 27
- 2023TempTabQA: Temporal Question Answering for Semi-Structured Tablescited by 27
- 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
- 2022Improving Time Sensitivity for Question Answering over Temporal Knowledge Graphscited by 26
- 2022Conversational Question Answering on Heterogeneous Sourcescited by 26
- 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answeringcited by 25
- 2024Set the Clock: Temporal Alignment of Pretrained Language Modelscited by 25
- 2024Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Modelscited by 18
- 2025ChronoSense: Exploring Temporal Understanding in Large Language Models with Time Intervals of Eventscited by 18
12 most cited of 51 All 51 (JSON)
- 2026TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval23 Sep 2026
- 2026SCoP: Structured Constraint Parsing for Evidence-Space Control in Temporal Knowledge Graph Question Answering2 Sep 2026
- 2026SABET-QA: Temporal Knowledge Graph Question Answering20 Aug 2026
- 2026FITTER: Vocabulary-Agnostic Cross-Domain Inference on Temporal Knowledge Graphs11 Aug 2026
- 2026Poisson-Gamma Modeling of Inter-Relational Dependencies in Dynamic Knowledge Graphs3 Jul 2026
- 2026Knowledge Graphs Meet Graph Neural Networks: A Comprehensive Survey12 May 2026
- 2025Structured yet Bounded Temporal Understanding in Large Language Models19 Oct 2025
- 2025Temporal Referential Consistency: Do LLMs Favor Sequences Over Absolute Time References?17 Oct 2025
- 2025Hypothesis-Driven Feature Manifold Analysis in LLMs via Supervised Multi-Dimensional Scaling1 Oct 2025
- 2025Evaluating List Construction and Temporal Understanding capabilities of Large Language Models26 Jun 2025
- 2025A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs17 Jun 2025
- 2025It's High Time: A Survey of Temporal Question Answering26 May 2025
12 newest of 51 All 51 (JSON)