# DeSePtion: Dual Sequence Prediction and Adversarial Examples for Improved Fact-Checking

arXiv: https://arxiv.org/abs/2004.12864 · HTML: https://mlsanity.com/paper/2004.12864/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 Apr 2020.

## Built on by (most cited first, 26 of 26)

- [COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic](https://mlsanity.com/paper/2106.03794/) (2021)
- [Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resources](https://mlsanity.com/paper/2112.00061/) (2021)
- [Towards Few-Shot Fact-Checking via Perplexity](https://mlsanity.com/paper/2103.09535/) (2021)
- [DialFact: A Benchmark for Fact-Checking in Dialogue](https://mlsanity.com/paper/2110.08222/) (2021)
- [Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills](https://mlsanity.com/paper/2107.07261/) (2021)
- [The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail](https://mlsanity.com/paper/2110.08300/) (2021)
- [Abstract, Rationale, Stance: A Joint Model for Scientific Claim Verification](https://mlsanity.com/paper/2110.15116/) (2021)
- [A Multi-Level Attention Model for Evidence-Based Fact Checking](https://mlsanity.com/paper/2106.00950/) (2021)
- [Fact-Saboteurs: A Taxonomy of Evidence Manipulation Attacks against Fact-Verification Systems](https://mlsanity.com/paper/2209.03755/) (2022)
- [Fact Checking with Insufficient Evidence](https://mlsanity.com/paper/2204.02007/) (2022)
- [Natural Logic-guided Autoregressive Multi-hop Document Retrieval for Fact Verification](https://mlsanity.com/paper/2212.05276/) (2022)
- [Attacking Misinformation Detection Using Adversarial Examples Generated by Language Models](https://mlsanity.com/paper/2410.20940/) (2024)
- [Verifying the Robustness of Automatic Credibility Assessment](https://mlsanity.com/paper/2303.08032/) (2023)
- [Implicit Temporal Reasoning for Evidence-Based Fact-Checking](https://mlsanity.com/paper/2302.12569/) (2023)
- [Knowledge-Enhanced Evidence Retrieval for Counterargument Generation](https://mlsanity.com/paper/2109.09057/) (2021)
- [Graph Reasoning with Context-Aware Linearization for Interpretable Fact Extraction and Verification](https://mlsanity.com/paper/2109.12349/) (2021)
- [Adversarial Attacks Against Automated Fact-Checking: A Survey](https://mlsanity.com/paper/2509.08463/) (2025)
- [Fact or Fiction? Improving Fact Verification with Knowledge Graphs through Simplified Subgraph Retrievals](https://mlsanity.com/paper/2408.07453/) (2024)
- [IMCI: Integrate Multi-view Contextual Information for Fact Extraction and Verification](https://mlsanity.com/paper/2208.14001/) (2022)
- [When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits](https://mlsanity.com/paper/2503.03417/) (2025)
- [PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation](https://mlsanity.com/paper/2201.02009/) (2022)
- [DECEIVE-AFC: Adversarial Claim Attacks against Search-Enabled LLM-based Fact-Checking Systems](https://mlsanity.com/paper/2602.02569/) (2026)
- [Mitigating GenAI-Powered Evidence Pollution for Out-Of-Context Misinformation Detection](https://mlsanity.com/paper/2501.14728/) (2025)
- [LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systems](https://mlsanity.com/paper/2601.16890/) (2026)
- [Robust Information Retrieval for False Claims with Distracting Entities In Fact Extraction and Verification](https://mlsanity.com/paper/2112.07618/) (2021)
- [AtomEval: Validity-Aware Atomic Evaluation of Adversarial Claim Rewriting in Fact Verification](https://mlsanity.com/paper/2604.07967/) (2026)

## Abstract (arXiv)

The increased focus on misinformation has spurred development of data and systems for detecting the veracity of a claim as well as retrieving authoritative evidence. The Fact Extraction and VERification (FEVER) dataset provides such a resource for evaluating end-to-end fact-checking, requiring retrieval of evidence from Wikipedia to validate a veracity prediction. We show that current systems for FEVER are vulnerable to three categories of realistic challenges for fact-checking -- multiple propositions, temporal reasoning, and ambiguity and lexical variation -- and introduce a resource with these types of claims. Then we present a system designed to be resilient to these "attacks" using multiple pointer networks for document selection and jointly modeling a sequence of evidence sentences and veracity relation predictions. We find that in handling these attacks we obtain state-of-the-art results on FEVER, largely due to improved evidence retrieval.
