Time-Aware Datasets are Adaptive Knowledgebases for the New Normal
Not on the map. Why?
Abstract (arXiv)
Recent advances in text classification and knowledge capture in language models have relied on availability of large-scale text datasets. However, language models are trained on static snapshots of knowledge and are limited when that knowledge evolves. This is especially critical for misinformation detection, where new types of misinformation continuously appear, replacing old campaigns. We propose time-aware misinformation datasets to capture time-critical phenomena. In this paper, we first present evidence of evolving misinformation and show that incorporating even simple time-awareness significantly improves classifier accuracy. Second, we present COVID-TAD, a large-scale COVID-19 misinformation da-taset spanning 25 months. It is the first large-scale misinformation dataset that contains multiple snapshots of a datastream and is orders of magnitude bigger than related misinformation datasets. We describe the collection and labeling pro-cess, as well as preliminary experiments.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 22 Nov 2022.
Builds on
24 of 47 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
- 2017Snorkel: Rapid Training Data Creation with Weak Supervisioncited by 372
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
- 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
- 2017Advances in Pre-Training Distributed Word Representationscited by 207
- 2018To Trust Or Not To Trust A Classifiercited by 207
- 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
- 2021On Statistical Bias In Active Learning: How and When To Fix Itcited by 75
12 more
- 2019r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detectioncited by 55
- 2017On the Reliable Detection of Concept Drift from Streaming Unlabeled Datacited by 33
- 2021End-to-End Weak Supervisioncited by 33
- 2021NELA-GT-2020: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articlescited by 29
- 2021Dynamic Language Models for Continuously Evolving Contentcited by 27
- 2020Leveraging Multi-Source Weak Social Supervision for Early Detection of Fake Newscited by 24
- 2022Shoring Up the Foundations: Fusing Model Embeddings and Weak Supervisioncited by 18
- 2021Testing the Generalization of Neural Language Models for COVID-19 Misinformation Detectioncited by 10
- 2022MiDAS: Multi-integrated Domain Adaptive Supervision for Fake News Detectioncited by 7
- 2022Data-Driven Mitigation of Adversarial Text Perturbationcited by 5
- 2016Averaging Gone Wrong: Using Time-Aware Analyses to Better Understand Behaviorcited by 3
- 2022Evaluating Generalizability of Fine-Tuned Models for Fake News Detectioncited by 3
Built on by
Citing papers per year: 2023: 1.
1 paper.