LiveFact: A Dynamic, Time-Aware Benchmark for LLM-Driven Fake News Detection
Not on the map. Why?
Abstract (arXiv)
The rapid development of Large Language Models (LLMs) has transformed fake news detection and fact-checking tasks from simple classification to complex reasoning. However, evaluation frameworks have not kept pace. Current benchmarks are static, making them vulnerable to benchmark data contamination (BDC) and ineffective at assessing reasoning under temporal uncertainty. To address this, we introduce LiveFact a continuously updated benchmark that simulates the real-world "fog of war" in misinformation detection. LiveFact uses dynamic, temporal evidence sets to evaluate models on their ability to reason with evolving, incomplete information rather than on memorized knowledge. We propose a dual-mode evaluation: Classification Mode for final verification and Inference Mode for evidence-based reasoning, along with a component to monitor BDC explicitly. Tests with 22 LLMs show that open-source Mixture-of-Experts models, such as Qwen3-235B-A22B, now match or outperform proprietary state-of-the-art systems. More importantly, our analysis finds a significant "reasoning gap." Capable models exhibit epistemic humility by recognizing unverifiable claims in early data slices-an aspect traditional static benchmarks overlook. LiveFact sets a sustainable standard for evaluating robust, temporally aware AI verification.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 35 of its 74 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
35 of 74 references.
References · 35
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2021Deduplicating Training Data Makes Language Models Bettercited by 705
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
- 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
- 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 281
- 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 242
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
- 2023Don't Make Your LLM an Evaluation Benchmark Cheatercited by 194
- 2023Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMscited by 175
23 more
- 2020Generating Fact Checking Explanationscited by 132
- 2025Preference Leakage: A Contamination Problem in LLM-as-a-judgecited by 119
- 2024GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local Refinementscited by 101
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 60
- 2025Recent Advances in Large Langauge Model Benchmarks against Data Contamination: From Static to Dynamic Evaluationcited by 38
- 2020Multi-Hop Fact Checking of Political Claimscited by 37
- 2023EX-FEVER: A Dataset for Multi-hop Explainable Fact Verificationcited by 36
- 2024Unveiling the Spectrum of Data Contamination in Language Models: A Survey from Detection to Remediationcited by 30
- 2024Exploring the Deceptive Power of LLM-Generated Fake News: A Study of Real-World Detection Challengescited by 28
- 2019NELA-GT-2018: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articlescited by 26
- 2025LLM-Generated Fake News Induces Truth Decay in News Ecosystem: A Case Study on Neural News Recommendationcited by 19
- 2024Causal Walk: Debiasing Multi-Hop Fact Verification with Front-Door Adjustmentcited by 17
- 2022Exploring Faithful Rationale for Multi-hop Fact Verification via Salience-Aware Graph Learningcited by 15
- 2024TreeEval: Benchmark-Free Evaluation of Large Language Models through Tree Planningcited by 14
- 2025The Emperor's New Clothes in Benchmarking? A Rigorous Examination of Mitigation Strategies for LLM Benchmark Data Contaminationcited by 13
- 2024Real-time Factuality Assessment from Adversarial Feedbackcited by 12
- 2024Piecing It All Together: Verifying Multi-Hop Multimodal Claimscited by 12
- 2020CHECKED: Chinese COVID-19 Fake News Datasetcited by 11
- 2025DCR: Quantifying Data Contamination in LLMs Evaluationcited by 10
- 2025MultiHoax: A Dataset of Multi-hop False-Premise Questionscited by 8
- 2022NELA-GT-2022: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articlescited by 6
- 2025From Scarcity to Capability: Empowering Fake News Detection in Low-Resource Languages with LLMscited by 3
- 2025MPPFND: A Dataset and Analysis of Detecting Fake News with Multi-Platform Propagationcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025RoE-FND: A Case-Based Reasoning Approach with Dual Verification for Fake News Detection via LLMs
- 2025RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
- 2024From Deception to Detection: The Dual Roles of Large Language Models in Fake News
- 2025FactGuard: Event-Centric and Commonsense-Guided Fake News Detection
- 2025Debunk and Infer: Multimodal Fake News Detection via Diffusion-Generated Evidence and LLM Reasoning
- 2024Re-Search for The Truth: Multi-round Retrieval-augmented Large Language Models are Strong Fake News Detectors
- 2026Self-Reflective Multi-modal Reasoning for Short-Video Fake News Detection
- 2026LLM-MRD: LLM-Guided Multi-View Reasoning Distillation for Fake News Detection