COVID-VTS: Fact Extraction and Verification on Short Video Platforms
Not on the map. Why?
Abstract (arXiv)
We introduce a new benchmark, COVID-VTS, for fact-checking multi-modal information involving short-duration videos with COVID19- focused information from both the real world and machine generation. We propose, TwtrDetective, an effective model incorporating cross-media consistency checking to detect token-level malicious tampering in different modalities, and generate explanations. Due to the scarcity of training data, we also develop an efficient and scalable approach to automatically generate misleading video posts by event manipulation or adversarial matching. We investigate several state-of-the-art models and demonstrate the superiority of TwtrDetective.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 33 of its 44 references that are in the map. First posted on arXiv 15 Feb 2023.
Builds on
33 of 44 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2017Dense-Captioning Events in Videoscited by 789
- 2017Localizing Moments in Video with Natural Languagecited by 660
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 645
- 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
- 2019Defending Against Neural Fake Newscited by 553
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
- 2020Multi-modal Transformer for Video Retrievalcited by 395
- 2020HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingcited by 362
21 more
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
- 2019Attention on Attention for Image Captioningcited by 289
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
- 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 223
- 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
- 2019Use What You Have: Video Retrieval Using Representations From Collaborative Expertscited by 214
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
- 2015A Dataset for Movie Descriptioncited by 195
- 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
- 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
- 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2019A Richly Annotated Corpus for Different Tasks in Automated Fact-Checkingcited by 74
- 2019The Limitations of Stylometry for Detecting Machine-Generated Fake Newscited by 63
- 2020VIOLIN: A Large-Scale Dataset for Video-and-Language Inferencecited by 41
- 2020Detecting Cross-Modal Inconsistency to Defend Against Neural Fake Newscited by 41
- 2020A Review on Fact Extraction and Verificationcited by 29
- 2020Extracting a Knowledge Base of Mechanisms from COVID-19 Paperscited by 13
- 2019Automatic Fact-Checking Using Context and Discourse Informationcited by 11
- 2021Multi-Modal Semantic Inconsistency Detection in Social Media News Postscited by 10
- 2022Misinformation Detection in Social Media Video Postscited by 4
Built on by
Citing papers per year: 2023: 6; 2024: 5; 2025: 3; 2026: 1.
15 papers.
Sort:
By area:
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
- 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
- 2023Multimodal Automated Fact-Checking: A Surveycited by 51
- 2023Towards Generic Anomaly Detection and Understanding: Large-scale Visual-linguistic Model (GPT-4V) Takes the Leadcited by 40
- 2024FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Processcited by 25
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Surveycited by 23
- 2024On the Vulnerability of LLM/VLM-Controlled Roboticscited by 15
- 2023DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documentscited by 7
- 2026From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wildcited by 3
- 2025Multimodal Fake News Video Explanation: Dataset, Analysis and Evaluationcited by 1
- 2025FMNV: A Dataset of Media-Published News Videos for Fake News Detectioncited by 1
- 2023Anticipating Driving Behavior through Deep Learning-Based Policy Predictioncited by 0
3 more
- 2024Official-NV: An LLM-Generated News Video Dataset for Multimodal Fake News Detectioncited by 0
- 2024DAVE: Diverse Atomic Visual Elements Dataset with High Representation of Vulnerable Road Users in Complex and Unpredictable Environmentscited by 0
- 2025Multimodal Learning for Fake News Detection in Short Videos Using Linguistically Verified Data and Heterogeneous Modality Fusioncited by 0
- 2026From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild26 Mar 2026
- 2025Multimodal Learning for Fake News Detection in Short Videos Using Linguistically Verified Data and Heterogeneous Modality Fusion19 Sep 2025
- 2025FMNV: A Dataset of Media-Published News Videos for Fake News Detection10 Apr 2025
- 2025Multimodal Fake News Video Explanation: Dataset, Analysis and Evaluation15 Jan 2025
- 2024DAVE: Diverse Atomic Visual Elements Dataset with High Representation of Vulnerable Road Users in Complex and Unpredictable Environments28 Dec 2024
- 2024Official-NV: An LLM-Generated News Video Dataset for Multimodal Fake News Detection28 Jul 2024
- 2024FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Process23 Jul 2024
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey8 Jun 2024
- 2024On the Vulnerability of LLM/VLM-Controlled Robotics15 Feb 2024
- 2023Towards Generic Anomaly Detection and Understanding: Large-scale Visual-linguistic Model (GPT-4V) Takes the Lead5 Nov 2023
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models23 Oct 2023
- 2023Anticipating Driving Behavior through Deep Learning-Based Policy Prediction20 Jul 2023
3 more
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
- 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
- 2024On the Vulnerability of LLM/VLM-Controlled Roboticscited by 15
- 2023DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documentscited by 7
- 2024On the Vulnerability of LLM/VLM-Controlled Robotics15 Feb 2024
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models23 Oct 2023
- 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning26 Jun 2023
- 2023DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documents9 Jun 2023
- 2023Multimodal Automated Fact-Checking: A Surveycited by 51
- 2023Towards Generic Anomaly Detection and Understanding: Large-scale Visual-linguistic Model (GPT-4V) Takes the Leadcited by 40
- 2024FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Processcited by 25
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Surveycited by 23
- 2026From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wildcited by 3
- 2025Multimodal Fake News Video Explanation: Dataset, Analysis and Evaluationcited by 1
- 2025FMNV: A Dataset of Media-Published News Videos for Fake News Detectioncited by 1
- 2023Anticipating Driving Behavior through Deep Learning-Based Policy Predictioncited by 0
- 2024Official-NV: An LLM-Generated News Video Dataset for Multimodal Fake News Detectioncited by 0
- 2024DAVE: Diverse Atomic Visual Elements Dataset with High Representation of Vulnerable Road Users in Complex and Unpredictable Environmentscited by 0
- 2025Multimodal Learning for Fake News Detection in Short Videos Using Linguistically Verified Data and Heterogeneous Modality Fusioncited by 0
- 2026From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild26 Mar 2026
- 2025Multimodal Learning for Fake News Detection in Short Videos Using Linguistically Verified Data and Heterogeneous Modality Fusion19 Sep 2025
- 2025FMNV: A Dataset of Media-Published News Videos for Fake News Detection10 Apr 2025
- 2025Multimodal Fake News Video Explanation: Dataset, Analysis and Evaluation15 Jan 2025
- 2024DAVE: Diverse Atomic Visual Elements Dataset with High Representation of Vulnerable Road Users in Complex and Unpredictable Environments28 Dec 2024
- 2024Official-NV: An LLM-Generated News Video Dataset for Multimodal Fake News Detection28 Jul 2024
- 2024FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Process23 Jul 2024
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey8 Jun 2024
- 2023Towards Generic Anomaly Detection and Understanding: Large-scale Visual-linguistic Model (GPT-4V) Takes the Lead5 Nov 2023
- 2023Anticipating Driving Behavior through Deep Learning-Based Policy Prediction20 Jul 2023
- 2023Multimodal Automated Fact-Checking: A Survey22 May 2023