mlsanityData to 7 Oct 2026

TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questions

arXiv 2005.00242 ↗First posted 1 May 2020cs.CLcited by 65

Not on the map. Why?

Abstract (arXiv)

A critical part of reading is being able to understand the temporal relationships between events described in a passage of text, even when those relationships are not explicitly stated. However, current machine reading comprehension benchmarks have practically no questions that test temporal phenomena, so systems trained on these benchmarks have no capacity to answer questions such as "what happened before/after [some event]?" We introduce TORQUE, a new English reading comprehension benchmark built on 3.2k news snippets with 21k human-generated questions querying temporal relationships. Results show that RoBERTa-large achieves an exact-match score of 51% on the test set of TORQUE, about 30% behind human performance.

Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 16; 2022: 9; 2023: 13; 2024: 18; 2025: 9.

65 papers.

Sort:

By area:

  1. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
  2. 2021A Dataset for Answering Time-Sensitive Questionscited by 150
  3. 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 123
  4. 2024Large Language Models Can Learn Temporal Reasoningcited by 110
  5. 2021Question Answering Over Temporal Knowledge Graphscited by 99
  6. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  7. 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 75
  8. 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialogcited by 55
  9. 2023Test of Time: Instilling Video-Language Models with a Sense of Timecited by 51
  10. 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoningcited by 44
  11. 2022Faking Fake News for Real Fake News Detection: Propaganda-loaded Training Data Generationcited by 41
  12. 2021COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentencescited by 40
38 more
  1. 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
  2. 2023Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Modelscited by 37
  3. 2021ESTER: A Machine Reading Comprehension Dataset for Event Semantic Relation Reasoningcited by 30
  4. 2023TempTabQA: Temporal Question Answering for Semi-Structured Tablescited by 27
  5. 2022Improving Time Sensitivity for Question Answering over Temporal Knowledge Graphscited by 26
  6. 2021What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?cited by 23
  7. 2024Exploring and Benchmarking the Planning Capabilities of Large Language Modelscited by 19
  8. 2022Learning to Decompose: Hypothetical Question Decomposition Based on Comparable Textscited by 18
  9. 2024UnSeenTimeQA: Time-Sensitive Question-Answering Beyond LLMs' Memorizationcited by 17
  10. 2025ChronoSense: Exploring Temporal Understanding in Large Language Models with Time Intervals of Eventscited by 17
  11. 2021Extracting Temporal Event Relation with Syntax-guided Graph Transformercited by 16
  12. 2021Probing Language Models for Understanding of Temporal Expressionscited by 16
  13. 2022Go Back in Time: Generating Flashbacks in Stories with Event Temporal Promptscited by 15
  14. 2021Salience-Aware Event Chain Modeling for Narrative Understandingcited by 14
  15. 2021Extracting Event Temporal Relations via Hyperbolic Geometrycited by 13
  16. 2024Faithful Temporal Question Answering over Heterogeneous Sourcescited by 13
  17. 2023Getting Sick After Seeing a Doctor? Diagnosing and Mitigating Knowledge Conflicts in Event Temporal Reasoningcited by 12
  18. 2025It's High Time: A Survey of Temporal Question Answeringcited by 12
  19. 2022What Makes Reading Comprehension Questions Difficult?cited by 11
  20. 2022A Survey of Machine Narrative Reading Comprehension Assessmentscited by 10
  21. 2023Event Temporal Relation Extraction with Bayesian Translational Modelcited by 10
  22. 2023An Overview Of Temporal Commonsense Reasoning and Acquisitioncited by 10
  23. 2024Enhancing Temporal Sensitivity and Reasoning for Time-Sensitive Question Answeringcited by 9
  24. 2024Assessing Episodic Memory in LLMs with Sequence Order Recall Taskscited by 9
  25. 2022Synopses of Movie Narratives: a Video-Language Dataset for Story Understandingcited by 8
  26. 2024From Instructions to Constraints: Language Model Alignment with Automatic Constraint Verificationcited by 8
  27. 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tablescited by 8
  28. 2024Towards a Benchmark for Causal Business Process Reasoning with LLMscited by 7
  29. 2024A Comprehensive Evaluation of Large Language Models on Temporal Event Forecastingcited by 7
  30. 2024ComplexTempQA:A 100m Dataset for Complex Temporal Question Answeringcited by 6
  31. 2021Distantly-Supervised Evidence Retrieval Enables Question Answering without Evidence Annotationcited by 5
  32. 2022Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformationcited by 5
  33. 2023tieval: An Evaluation Framework for Temporal Information Extraction Systemscited by 5
  34. 2021Grid Search Hyperparameter Benchmarking of BERT, ALBERT, and LongFormer on DuoRCcited by 4
  35. 2021Natural Language Processing with Commonsense Knowledge: A Surveycited by 4
  36. 2024MM-Forecast: A Multimodal Approach to Temporal Event Forecasting with Large Language Modelscited by 4
  37. 2023SituatedGen: Incorporating Geographical and Temporal Contexts into Generative Commonsense Reasoningcited by 3
  38. 2024Continual Learning for Temporal-Sensitive Question Answeringcited by 3

50 most cited of 65 All 65 (JSON)