mlsanityData to 14 Oct 2026

TempTabQA: Temporal Question Answering for Semi-Structured Tables

arXiv 2311.08002 ↗First posted 14 Nov 2023cs.CL cs.AI cs.IRcited by 27

Not on the map. Why?

Abstract (arXiv)

Semi-structured data, such as Infobox tables, often include temporal information about entities, either implicitly or explicitly. Can current NLP systems reason about such information in semi-structured tables? To tackle this question, we introduce the task of temporal question answering on semi-structured tables. We present a dataset, TempTabQA, which comprises 11,454 question-answer pairs extracted from 1,208 Wikipedia Infobox tables spanning more than 90 distinct domains. Using this dataset, we evaluate several state-of-the-art models for temporal reasoning. We observe that even the top-performing LLMs lag behind human performance by more than 13.5 F1 points. Given these results, our dataset has the potential to serve as a challenging benchmark to improve the temporal reasoning capabilities of NLP models.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 44 of its 82 references that are in the map. First posted on arXiv 14 Nov 2023.

Builds on

44 of 82 references.

References · 44

  1. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  2. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
  3. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  4. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  5. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
  6. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
  7. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  8. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  9. 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 398
  10. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
  11. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
  12. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
32 more
  1. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 264
  2. 2021FeTaQA: Free-form Table Question Answeringcited by 175
  3. 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
  4. 2020Open Question Answering over Tables and Textcited by 163
  5. 2021A Dataset for Answering Time-Sensitive Questionscited by 154
  6. 2020DART: Open-Domain Structured Data Record to Text Generationcited by 145
  7. 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
  8. 2020Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsingcited by 133
  9. 2021TABBIE: Pretrained Representations of Tabular Datacited by 111
  10. 2021Question Answering Over Temporal Knowledge Graphscited by 99
  11. 2020Logical Natural Language Generation from Open-Domain Tablescited by 90
  12. 2020INFOTABS: Inference on Tables as Semi-structured Datacited by 86
  13. 2021Complex Temporal Question Answering on Knowledge Graphscited by 69
  14. 2020Understanding tables with intermediate pre-trainingcited by 68
  15. 2020TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questionscited by 65
  16. 2020On the Potential of Lexico-logical Alignments for Semantic Parsing to SQL Queriescited by 60
  17. 2019TEQUILA: Temporal Question Answering over Knowledge Basescited by 47
  18. 2021Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skillscited by 39
  19. 2021FRUIT: Faithfully Reflecting Updated Information in Textcited by 39
  20. 2019Table2Vec: Neural Word and Entity Embeddings for Table Population and Retrievalcited by 37
  21. 2021SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)cited by 35
  22. 2021Capturing Row and Column Semantics in Transformer Based Question Answering over Tablescited by 31
  23. 2021TempoQR: Temporal Question Reasoning over Knowledge Graphscited by 26
  24. 2019CogCompTime: A Tool for Understanding Time in Natural Language Textcited by 23
  25. 2021Incorporating External Knowledge to Enhance Tabular Reasoningcited by 23
  26. 2021Representations for Question Answering from Documents with Tables and Textcited by 21
  27. 2020Summarizing and Exploring Tabular Data in Conversational Searchcited by 19
  28. 2021TAPAS at SemEval-2021 Task 9: Reasoning over tables with intermediate pre-trainingcited by 14
  29. 2019Auto-completion for Data Cells in Relational Tablescited by 9
  30. 2022A Benchmark for Generalizable and Interpretable Temporal Question Answering over Knowledge Basescited by 9
  31. 2022Realistic Data Augmentation Framework for Enhancing Tabular Reasoningcited by 4
  32. 2022Targeted Extraction of Temporal Facts from Textual Resources for Improved Temporal Question Answering over Knowledge Basescited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 10; 2025: 16; 2026: 1.

27 papers.

Sort:

By area:

  1. 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 88
  2. 2024Can LLM Graph Reasoning Generalize beyond Pattern Memorization?cited by 47
  3. 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunitiescited by 31
  4. 2024DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMscited by 24
  5. 2024TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing Large Language Modelscited by 22
  6. 2024UnSeenTimeQA: Time-Sensitive Question-Answering Beyond LLMs' Memorizationcited by 17
  7. 2025It's High Time: A Survey of Temporal Question Answeringcited by 14
  8. 2024StrucText-Eval: Evaluating Large Language Model's Reasoning Ability in Structure-Rich Textcited by 13
  9. 2025ST-Raptor: LLM-Powered Semi-Structured Table Question Answeringcited by 11
  10. 2025LLMs as Repositories of Factual Knowledge: Limitations and Solutionscited by 10
  11. 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
  12. 2024SynTQA: Synergistic Table-based Question Answering via Mixture of Text-to-SQL and E2E TQAcited by 9
15 more
  1. 2025Your LLM Agents are Temporally Blind: The Misalignment Between Tool Use Decisions and Human Time Perceptioncited by 9
  2. 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tablescited by 8
  3. 2024Table Question Answering for Low-resourced Indic Languagescited by 7
  4. 2024Will LLMs Replace the Encoder-Only Models in Temporal Relation Classification?cited by 6
  5. 2025Texts or Images? A Fine-grained Analysis on the Effectiveness of Input Representations and Models for Table Question Answeringcited by 5
  6. 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluationcited by 5
  7. 2025MegaWika 2: A More Comprehensive Multilingual Collection of Articles and their Sourcescited by 3
  8. 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?cited by 3
  9. 2025Leveraging LLM For Synchronizing Information Across Multilingual Tablescited by 2
  10. 2025On the Temporal Question-Answering Capabilities of Large Language Models Over Anonymized Datacited by 2
  11. 2025MobQA: A Benchmark Dataset for Semantic Understanding of Human Mobility Data through Question Answeringcited by 1
  12. 2025NeSTR: A Neuro-Symbolic Abductive Framework for Temporal Reasoning in Large Language Modelscited by 1
  13. 2025Harnessing Temporal Databases for Systematic Evaluation of Factual Time-Sensitive Question-Answering in Large Language Modelscited by 0
  14. 2025Time to Revist Exact Matchcited by 0
  15. 2025Evidence-Guided Schema Normalization for Temporal Tabular Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025TransientTables: Evaluating LLMs' Reasoning on Temporally Evolving Semi-structured Tables
  2. 2025LLM-Symbolic Integration for Robust Temporal Tabular Reasoning
  3. 2023Unlocking Temporal Question Answering for Large Language Models with Tailor-Made Reasoning Logic
  4. 2025TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit References
  5. 2024TANQ: An open domain dataset of table answered questions
  6. 2024ComplexTempQA:A 100m Dataset for Complex Temporal Question Answering
  7. 2024PAT-Questions: A Self-Updating Benchmark for Present-Anchored Temporal Question-Answering
  8. 2024MRAG: A Modular Retrieval Framework for Time-Sensitive Question Answering