"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection
Not on the map. Why?
Abstract (arXiv)
Automatic fake news detection is a challenging problem in deception detection, and it has tremendous real-world political and social impacts. However, statistical approaches to combating fake news has been dramatically limited by the lack of labeled benchmark datasets. In this paper, we present liar: a new, publicly available dataset for fake news detection. We collected a decade-long, 12.8K manually labeled short statements in various contexts from PolitiFact.com, which provides detailed analysis report and links to source documents for each case. This dataset can be used for fact-checking research as well. Notably, this new dataset is an order of magnitude larger than previously largest public fake news datasets of similar type. Empirically, we investigate automatic fake news detection based on surface-level linguistic patterns. We have designed a novel, hybrid convolutional neural network to integrate meta-data with text. We show that this hybrid approach can improve a text-only deep learning model.
Key facts. Cited by 361 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 66; 2022: 59; 2023: 57; 2024: 61; 2025: 67; 2026: 51.
361 papers.
Sort:
By area:
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 179
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 146
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
38 more
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 138
- 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 118
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2022End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Modelscited by 105
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
- 2023Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Methodcited by 97
- 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 90
- 2021CREAK: A Dataset for Commonsense Reasoning over Entity Knowledgecited by 88
- 2021User Preference-aware Fake News Detectioncited by 76
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2022MDFEND: Multi-domain Fake News Detectioncited by 68
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
- 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
- 2025A Systematic Survey of Automatic Prompt Optimization Techniquescited by 61
- 2022MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Datasetcited by 59
- 2021Automated Fact-Checking: A Surveycited by 55
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 55
- 2023Deception Detection from Linguistic and Physiological Data Streams Using Bimodal Convolutional Neural Networkscited by 54
- 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
- 2023Towards Reliable Misinformation Mitigation: Generalization, Uncertainty, and GPT-4cited by 45
- 2021RAFT: A Real-World Few-Shot Text Classification Benchmarkcited by 44
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
- 2023Pre-Training to Learn in Contextcited by 41
- 2022CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checkingcited by 37
- 2023FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Automated Fact-Checkingcited by 37
- 2025Self-Supervised Prompt Optimizationcited by 37
- 2023EX-FEVER: A Dataset for Multi-hop Explainable Fact Verificationcited by 36
- 2021Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learningcited by 35
- 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 34
- 2023Open, Closed, or Small Language Models for Text Classification?cited by 34
- 2021Misinfo Reaction Frames: Reasoning about Readers' Reactions to News Headlinescited by 32
- 2022Evidence-aware Fake News Detection with Graph Neural Networkscited by 30
- 2022CoVERT: A Corpus of Fact-checked Biomedical COVID-19 Tweetscited by 29
- 2024JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claimscited by 29
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
- 2023PREFER: Prompt Ensemble Learning via Feedback-Reflect-Refinecited by 28
- 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievalscited by 27
50 most cited of 361 All 361 (JSON)
- 2026Rethinking Multimodal Fake News Detection in the Generative AI Era29 Sep 2026
- 2026Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agents29 Sep 2026
- 2026An Explainable Coherence Score for Detecting Temporal Inconsistencies in Political News29 Aug 2026
- 2026RCMN: Understanding Misleadingness in Influential Public Discourse27 Aug 2026
- 2026How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation26 Aug 2026
- 2026Latent Fact-Checking: Detecting Misinformation through Activation Engineering5 Aug 2026
- 2026Unequal Verdicts: Investigating Gender Bias in LLM-Based Fake News Detection4 Aug 2026
- 2026Semantics of Subterfuge: Benchmarking Legal Deception Detection Against General-domain State-of-the-Art31 Jul 2026
- 2026What Does 99% Accuracy Measure? A Reproducible Audit of Shortcut Learning in a Widely Used Fake News Corpus26 Jul 2026
- 2026GPE: Evaluating Robust Evidence Aggregation for Fact Verification under Controllable GEO-Style Poisoning22 Jul 2026
- 2026FakeSpotter: A content and strategy agnostic Viral Misinformation Detection Tool20 Jul 2026
- 2026DeLIVeR: Decomposed Learning for Information-grounded Veracity Recognition via Reinforced Knowledge Graph Exploration20 Jul 2026
38 more
- 2026Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerability11 Jul 2026
- 2026ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation26 Jun 2026
- 2026ReMMD: Realistic Multilingual Multi-Image Agentic Verification for Multimodal Misinformation Detection23 Jun 2026
- 2026Context-Aware Multimodal Claim Verification in Spoken Dialogues9 Jun 2026
- 2026Generative AI and Digital Ecosystem Resilience: A Proactive Lifecycle-Based Survey28 May 2026
- 2026CommunityFact: A Dynamic, Multilingual, Multi-domain Benchmark for Misinformation Detection in the Wild28 May 2026
- 2026SEEK: Semantic Evidence Extraction via Adaptive ChunKing for Multilingual Fact-Checking26 May 2026
- 2026Large language models reorganize representational geometry during in-context learning16 May 2026
- 2026Semantic Register Compression in Multi-Agent LLM Cascades12 May 2026
- 2026A Cognitively Grounded Bayesian Framework for Misinformation Susceptibility10 May 2026
- 2026Agentic Adversarial Rewriting Exposes Architectural Vulnerabilities in Black-Box NLP Pipelines26 Apr 2026
- 2026Small Language Model Helps Resolve Semantic Ambiguity of LLM Prompt25 Apr 2026
- 2026TRUST Agents: A Collaborative Multi-Agent Framework for Fake News Detection, Explainable Verification, and Logic-Aware Claim Reasoning14 Apr 2026
- 2026Many Ways to Be Fake: Benchmarking Fake News Detection Under Strategy-Driven AI Generation10 Apr 2026
- 2026Graph Neural Networks for Misinformation Detection: Performance-Efficiency Trade-offs9 Apr 2026
- 2026DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialects7 Apr 2026
- 2026LiveFact: A Dynamic, Time-Aware Benchmark for LLM-Driven Fake News Detection6 Apr 2026
- 2026PRISM: LLM-Guided Semantic Clustering for High-Precision Topics3 Apr 2026
- 2026Reliable News or Propagandist News? A Neurosymbolic Model Using Genre, Topic, and Persuasion Techniques to Improve Robustness in Classification2 Apr 2026
- 2026AuthorityBench: Benchmarking LLM Authority Perception for Reliable Retrieval-Augmented Generation26 Mar 2026
- 2026DariMis: Harm-Aware Modeling for Dari Misinformation Detection on YouTube24 Mar 2026
- 2026MALicious INTent Dataset and Inoculating LLMs for Enhanced Disinformation Detection15 Mar 2026
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality6 Mar 2026
- 2026JailNewsBench: Multi-Lingual and Regional Benchmark for Fake News Generation under Jailbreak Attacks1 Mar 2026
- 2026Resources for Automated Evaluation of Assistive RAG Systems that Help Readers with News Trustworthiness Assessment27 Feb 2026
- 2026Three Concrete Challenges and Two Hopes for the Safety of Unsupervised Elicitation23 Feb 2026
- 2026Contradiction to Consensus: Dual Perspective, Multi Source Retrieval Based Claim Verification with Source Level Disagreement using LLM21 Feb 2026
- 2026What do people want to fact-check?11 Feb 2026
- 2026C-MOP: Integrating Momentum and Boundary-Aware Clustering for Enhanced Prompt Evolution11 Feb 2026
- 2026SciClaimEval: Cross-modal Claim Verification in Scientific Papers7 Feb 2026
- 2026MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessment29 Jan 2026
- 2026ClaimDB: A Fact Verification Benchmark over Large Structured Data21 Jan 2026
- 2026A Scalable Entity-Based Framework for Auditing Bias in Large Language Models18 Jan 2026
- 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection16 Jan 2026
- 2026One LLM to Train Them All: Multi-Task Learning Framework for Fact-Checking16 Jan 2026
- 2026VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checking13 Jan 2026
- 2026All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection7 Jan 2026
- 2026RADAR: Retrieval-Augmented Detector with Adversarial Refinement for Adaptive LLM-Generated Fake News Detection7 Jan 2026
50 newest of 361 All 361 (JSON)
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2025Self-Supervised Prompt Optimizationcited by 37
- 2025Is LLMs Hallucination Usable? LLM-based Negative Reasoning for Fake News Detectioncited by 7
- 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detectioncited by 6
- 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tablescited by 5
- 2025Large Language Models Require Curated Context for Reliable Political Fact-Checking -- Even with Reasoning and Web Searchcited by 2
- 2026MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessmentcited by 0
- 2026TRUST Agents: A Collaborative Multi-Agent Framework for Fake News Detection, Explainable Verification, and Logic-Aware Claim Reasoningcited by 0
- 2026ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregationcited by 0
- 2026ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation26 Jun 2026
- 2026TRUST Agents: A Collaborative Multi-Agent Framework for Fake News Detection, Explainable Verification, and Logic-Aware Claim Reasoning14 Apr 2026
- 2026MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessment29 Jan 2026
- 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection16 Jan 2026
- 2025Large Language Models Require Curated Context for Reliable Political Fact-Checking -- Even with Reasoning and Web Search24 Nov 2025
- 2025Is LLMs Hallucination Usable? LLM-based Negative Reasoning for Fake News Detection12 Mar 2025
- 2025Self-Supervised Prompt Optimization7 Feb 2025
- 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tables20 Feb 2024
- 2023Fact-Checking Complex Claims with Program-Guided Reasoning22 May 2023
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing19 May 2023
- 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievalscited by 27
- 2024Retrieval Augmented Fact Verification by Synthesizing Contrastive Argumentscited by 25
- 2025Resolving Conflicting Evidence in Automated Fact-Checking: A Study on Retrieval-Augmented LLMscited by 16
- 2024Reinforcement Retrieval Leveraging Fine-grained Feedback for Fact Checking News Claims with Black-Box LLMcited by 14
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
- 2026Resources for Automated Evaluation of Assistive RAG Systems that Help Readers with News Trustworthiness Assessmentcited by 1
- 2026RADAR: Retrieval-Augmented Detector with Adversarial Refinement for Adaptive LLM-Generated Fake News Detectioncited by 0
- 2026AuthorityBench: Benchmarking LLM Authority Perception for Reliable Retrieval-Augmented Generationcited by 0
- 2026Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agentscited by 0
- 2026Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agents29 Sep 2026
- 2026AuthorityBench: Benchmarking LLM Authority Perception for Reliable Retrieval-Augmented Generation26 Mar 2026
- 2026Resources for Automated Evaluation of Assistive RAG Systems that Help Readers with News Trustworthiness Assessment27 Feb 2026
- 2026RADAR: Retrieval-Augmented Detector with Adversarial Refinement for Adaptive LLM-Generated Fake News Detection7 Jan 2026
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models5 Aug 2025
- 2025Resolving Conflicting Evidence in Automated Fact-Checking: A Study on Retrieval-Augmented LLMs23 May 2025
- 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievals22 Feb 2025
- 2024Retrieval Augmented Fact Verification by Synthesizing Contrastive Arguments14 Jun 2024
- 2024Reinforcement Retrieval Leveraging Fine-grained Feedback for Fact Checking News Claims with Black-Box LLM26 Apr 2024
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factualitycited by 10
- 2025Recon, Answer, Verify: Agents in Search of Truthcited by 2
- 2026Agentic Adversarial Rewriting Exposes Architectural Vulnerabilities in Black-Box NLP Pipelinescited by 0
- 2026Semantic Register Compression in Multi-Agent LLM Cascadescited by 0
- 2026Semantic Register Compression in Multi-Agent LLM Cascades12 May 2026
- 2026Agentic Adversarial Rewriting Exposes Architectural Vulnerabilities in Black-Box NLP Pipelines26 Apr 2026
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality6 Mar 2026
- 2025Recon, Answer, Verify: Agents in Search of Truth4 Jul 2025
- 2026JailNewsBench: Multi-Lingual and Regional Benchmark for Fake News Generation under Jailbreak Attackscited by 6
- 2024Fighting Fire with Fire: Adversarial Prompting to Generate a Misinformation Detection Datasetcited by 3
- 2026DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialectscited by 1
- 2026DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialects7 Apr 2026
- 2026JailNewsBench: Multi-Lingual and Regional Benchmark for Fake News Generation under Jailbreak Attacks1 Mar 2026
- 2024Fighting Fire with Fire: Adversarial Prompting to Generate a Misinformation Detection Dataset9 Jan 2024
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 179
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 146
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 138
12 most cited of 330 All 330 (JSON)
- 2026Rethinking Multimodal Fake News Detection in the Generative AI Era29 Sep 2026
- 2026An Explainable Coherence Score for Detecting Temporal Inconsistencies in Political News29 Aug 2026
- 2026RCMN: Understanding Misleadingness in Influential Public Discourse27 Aug 2026
- 2026How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation26 Aug 2026
- 2026Latent Fact-Checking: Detecting Misinformation through Activation Engineering5 Aug 2026
- 2026Unequal Verdicts: Investigating Gender Bias in LLM-Based Fake News Detection4 Aug 2026
- 2026Semantics of Subterfuge: Benchmarking Legal Deception Detection Against General-domain State-of-the-Art31 Jul 2026
- 2026What Does 99% Accuracy Measure? A Reproducible Audit of Shortcut Learning in a Widely Used Fake News Corpus26 Jul 2026
- 2026GPE: Evaluating Robust Evidence Aggregation for Fact Verification under Controllable GEO-Style Poisoning22 Jul 2026
- 2026FakeSpotter: A content and strategy agnostic Viral Misinformation Detection Tool20 Jul 2026
- 2026DeLIVeR: Decomposed Learning for Information-grounded Veracity Recognition via Reinforced Knowledge Graph Exploration20 Jul 2026
- 2026Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerability11 Jul 2026
12 newest of 330 All 330 (JSON)