Temporal Common Sense Acquisition with Minimal Supervision
Not on the map. Why?
Abstract (arXiv)
Temporal common sense (e.g., duration and frequency of events) is crucial for understanding natural language. However, its acquisition is challenging, partly because such information is often not expressed explicitly in text, and human annotation on such concepts is costly. This work proposes a novel sequence modeling approach that exploits explicit and implicit mentions of temporal common sense, extracted from a large corpus, to build TACOLM, a temporal common sense language model. Our method is shown to give quality predictions of various dimensions of temporal common sense (on UDST and a newly collected dataset from RealNews). It also produces representations of events for relevant tasks such as duration comparison, parent-child relations, event coreference and temporal QA (on TimeBank, HiEVE and MCTACO) that are better than using the standard BERT. Thus, it will be an important component of temporal NLP.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 11; 2023: 9; 2024: 5; 2025: 1.
38 papers.
Sort:
By area:
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
- 2024Large Language Models Can Learn Temporal Reasoningcited by 110
- 2021Representing Numbers in NLP: a Survey and a Visioncited by 83
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 75
- 2022MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extractioncited by 65
- 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialogcited by 55
- 2023Test of Time: Instilling Video-Language Models with a Sense of Timecited by 51
- 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoningcited by 44
- 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
- 2021OntoED: Low-resource Event Detection with Ontology Embeddingcited by 23
26 more
- 2022There is a Time and Place for Reasoning Beyond the Imagecited by 22
- 2023Mitigating Temporal Misalignment by Discarding Outdated Factscited by 21
- 2021What do Large Language Models Learn about Scripts?cited by 19
- 2021What is Event Knowledge Graph: A Surveycited by 19
- 2022Learning to Decompose: Hypothetical Question Decomposition Based on Comparable Textscited by 18
- 2022Generic Temporal Reasoning with Differential Analysis and Explanationcited by 18
- 2024BIRD: A Trustworthy Bayesian Inference Framework for Large Language Modelscited by 18
- 2022ROCK: Causal Inference Principles for Reasoning about Commonsense Causalitycited by 16
- 2023Salient Span Masking for Temporal Understandingcited by 14
- 2021CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervisioncited by 12
- 2023Large Human Language Models: A Need and the Challengescited by 11
- 2023Traffic-Domain Video Question Answering with Automatic Captioningcited by 10
- 2023An Overview Of Temporal Commonsense Reasoning and Acquisitioncited by 10
- 2021Learning Constraints and Descriptive Segmentation for Subevent Detectioncited by 9
- 2022Zero-Shot On-the-Fly Event Schema Inductioncited by 9
- 2021Modality and Negation in Event Extractioncited by 6
- 2021Decomposing and Recomposing Event Structurecited by 5
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understandingcited by 4
- 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervisioncited by 4
- 2024Temporal Validity Change Predictioncited by 2
- 2024TacoERE: Cluster-aware Compression for Event Relation Extractioncited by 2
- 2022Cross-Lingual Speaker Identification Using Distant Supervisioncited by 0
- 2023QR-CLIP: Introducing Explicit Open-World Knowledge for Location and Time Reasoningcited by 0
- 2023Preconditioned Visual Language Inference with Weak Supervisioncited by 0
- 2024AcTED: Automatic Acquisition of Typical Event Duration for Semi-supervised Temporal Commonsense QAcited by 0
- 2025TComQA: Extracting Temporal Commonsense from Textcited by 0
- 2025TComQA: Extracting Temporal Commonsense from Text21 Aug 2025
- 2024TacoERE: Cluster-aware Compression for Event Relation Extraction11 May 2024
- 2024BIRD: A Trustworthy Bayesian Inference Framework for Large Language Models18 Apr 2024
- 2024AcTED: Automatic Acquisition of Typical Event Duration for Semi-supervised Temporal Commonsense QA27 Mar 2024
- 2024Large Language Models Can Learn Temporal Reasoning12 Jan 2024
- 2024Temporal Validity Change Prediction1 Jan 2024
- 2023Large Human Language Models: A Need and the Challenges9 Nov 2023
- 2023An Overview Of Temporal Commonsense Reasoning and Acquisition28 Jul 2023
- 2023Traffic-Domain Video Question Answering with Automatic Captioning18 Jul 2023
- 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoning26 May 2023
- 2023Mitigating Temporal Misalignment by Discarding Outdated Facts24 May 2023
- 2023Preconditioned Visual Language Inference with Weak Supervision22 May 2023
26 more
- 2023Salient Span Masking for Temporal Understanding22 Mar 2023
- 2023QR-CLIP: Introducing Explicit Open-World Knowledge for Location and Time Reasoning2 Feb 2023
- 2023Test of Time: Instilling Video-Language Models with a Sense of Time5 Jan 2023
- 2022Generic Temporal Reasoning with Differential Analysis and Explanation20 Dec 2022
- 2022MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction14 Nov 2022
- 2022Learning to Decompose: Hypothetical Question Decomposition Based on Comparable Texts30 Oct 2022
- 2022Zero-Shot On-the-Fly Event Schema Induction12 Oct 2022
- 2022Cross-Lingual Speaker Identification Using Distant Supervision11 Oct 2022
- 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervision16 Jun 2022
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understanding25 May 2022
- 2022There is a Time and Place for Reasoning Beyond the Image1 Mar 2022
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoning15 Feb 2022
- 2022ROCK: Causal Inference Principles for Reasoning about Commonsense Causality31 Jan 2022
- 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey28 Jan 2022
- 2021What is Event Knowledge Graph: A Survey31 Dec 2021
- 2021What do Large Language Models Learn about Scripts?27 Dec 2021
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Models14 Oct 2021
- 2021Modality and Negation in Event Extraction20 Sep 2021
- 2021Learning Constraints and Descriptive Segmentation for Subevent Detection13 Sep 2021
- 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QA13 Sep 2021
- 2021CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision21 Jul 2021
- 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialog8 Jun 2021
- 2021OntoED: Low-resource Event Detection with Ontology Embedding23 May 2021
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning12 Apr 2021
- 2021Representing Numbers in NLP: a Survey and a Vision24 Mar 2021
- 2021Decomposing and Recomposing Event Structure18 Mar 2021
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
- 2024Large Language Models Can Learn Temporal Reasoningcited by 110
- 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoningcited by 44
- 2022Generic Temporal Reasoning with Differential Analysis and Explanationcited by 18
- 2022ROCK: Causal Inference Principles for Reasoning about Commonsense Causalitycited by 16
- 2023Traffic-Domain Video Question Answering with Automatic Captioningcited by 10
- 2023An Overview Of Temporal Commonsense Reasoning and Acquisitioncited by 10
- 2024Large Language Models Can Learn Temporal Reasoning12 Jan 2024
- 2023An Overview Of Temporal Commonsense Reasoning and Acquisition28 Jul 2023
- 2023Traffic-Domain Video Question Answering with Automatic Captioning18 Jul 2023
- 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoning26 May 2023
- 2022Generic Temporal Reasoning with Differential Analysis and Explanation20 Dec 2022
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoning15 Feb 2022
- 2022ROCK: Causal Inference Principles for Reasoning about Commonsense Causality31 Jan 2022
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
- 2021Representing Numbers in NLP: a Survey and a Visioncited by 83
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 75
- 2022MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extractioncited by 65
- 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialogcited by 55
- 2023Test of Time: Instilling Video-Language Models with a Sense of Timecited by 51
- 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
- 2021OntoED: Low-resource Event Detection with Ontology Embeddingcited by 23
- 2022There is a Time and Place for Reasoning Beyond the Imagecited by 22
- 2023Mitigating Temporal Misalignment by Discarding Outdated Factscited by 21
- 2021What do Large Language Models Learn about Scripts?cited by 19
12 most cited of 31 All 31 (JSON)
- 2025TComQA: Extracting Temporal Commonsense from Text21 Aug 2025
- 2024TacoERE: Cluster-aware Compression for Event Relation Extraction11 May 2024
- 2024BIRD: A Trustworthy Bayesian Inference Framework for Large Language Models18 Apr 2024
- 2024AcTED: Automatic Acquisition of Typical Event Duration for Semi-supervised Temporal Commonsense QA27 Mar 2024
- 2024Temporal Validity Change Prediction1 Jan 2024
- 2023Large Human Language Models: A Need and the Challenges9 Nov 2023
- 2023Mitigating Temporal Misalignment by Discarding Outdated Facts24 May 2023
- 2023Preconditioned Visual Language Inference with Weak Supervision22 May 2023
- 2023Salient Span Masking for Temporal Understanding22 Mar 2023
- 2023QR-CLIP: Introducing Explicit Open-World Knowledge for Location and Time Reasoning2 Feb 2023
- 2023Test of Time: Instilling Video-Language Models with a Sense of Time5 Jan 2023
- 2022MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction14 Nov 2022
12 newest of 31 All 31 (JSON)