EXPLAIN, EDIT, GENERATE: Rationale-Sensitive Counterfactual Data Augmentation for Multi-hop Fact Verification
Not on the map. Why?
Abstract (arXiv)
Automatic multi-hop fact verification task has gained significant attention in recent years. Despite impressive results, these well-designed models perform poorly on out-of-domain data. One possible solution is to augment the training data with counterfactuals, which are generated by minimally altering the causal features of the original data. However, current counterfactual data augmentation techniques fail to handle multi-hop fact verification due to their incapability to preserve the complex logical relationships within multiple correlated texts. In this paper, we overcome this limitation by developing a rationale-sensitive method to generate linguistically diverse and label-flipping counterfactuals while preserving logical relationships. In specific, the diverse and fluent counterfactuals are generated via an Explain-Edit-Generate architecture. Moreover, the checking and filtering modules are proposed to regularize the counterfactual data with logical relations and flipped labels. Experimental results show that the proposed approach outperforms the SOTA baselines and can generate linguistically diverse counterfactual data without disrupting their logical relationships.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 43 of its 64 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
43 of 64 references.
References · 43
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2018Annotation Artifacts in Natural Language Inference Datacited by 656
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
- 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 428
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
31 more
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Modelscited by 219
- 2020Explainable Automated Fact-Checking for Public Health Claimscited by 209
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
- 2020Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Biascited by 183
- 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 181
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2019Towards Debiasing Fact Verification Modelscited by 143
- 2018Breaking NLI Systems with Sentences that Require Simple Lexical Inferencescited by 134
- 2016Guided Open Vocabulary Image Captioning with Constrained Beam Searchcited by 105
- 2020Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)cited by 79
- 2020Robustness to Spurious Correlations in Text Classification via Automatically Generated Counterfactualscited by 67
- 2021Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrievalcited by 63
- 2021Fool Me Twice: Entailment from Wikipedia Gamificationcited by 50
- 2021An Investigation of the (In)effectiveness of Counterfactually Augmented Datacited by 42
- 2021Mention Memory: incorporating textual knowledge into Transformers through entity mention attentioncited by 42
- 2023Reinforcement Learning-based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformationcited by 39
- 2020Multi-Hop Fact Checking of Political Claimscited by 37
- 2021Retrieval-guided Counterfactual Generation for QAcited by 28
- 2020Generating Label Cohesive and Well-Formed Adversarial Claimscited by 27
- 2023FACTIFY-5WQA: 5W Aspect-based Fact Verification through Question Answeringcited by 24
- 2021CrossAug: A Contrastive Data Augmentation Method for Debiasing Fact Verification Modelscited by 23
- 2022CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generationcited by 23
- 2022NeuroCounterfactuals: Beyond Minimal-Edit Counterfactuals for Richer Data Augmentationcited by 23
- 2020BRENDA: Browser Extension for Fake News Detectioncited by 20
- 2021Topic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verificationcited by 16
- 2022Exploring Faithful Rationale for Multi-hop Fact Verification via Salience-Aware Graph Learningcited by 15
- 2021Let the CAT out of the bag: Contrastive Attributed explanations for Textcited by 9
- 2023Consistent Multi-Granular Rationale Extraction for Explainable Multi-hop Fact Verificationcited by 3
- 2023Neural models for Factual Inconsistency Classification with Explanationscited by 1
Built on by
Citing papers per year: 2024: 4; 2025: 3; 2026: 2.
9 papers.
- 2024Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance?cited by 34
- 2024Claim Verification in the Age of Large Language Models: A Surveycited by 23
- 2024RDRec: Rationale Distillation for LLM-based Recommendationcited by 21
- 2024Automated Justification Production for Claim Veracity in Fact Checking: A Survey on Architectures and Approachescited by 15
- 2025Reasoning-CV: Fine-tuning Powerful Reasoning LLMs for Knowledge-Assisted Claim Verificationcited by 5
- 2025Fact in Fragments: Deconstructing Complex Claims via LLM-based Atomic Fact Extraction and Verificationcited by 2
- 2025Enhancing Multi-Hop Fact Verification with Structured Knowledge-Augmented Large Language Modelscited by 0
- 2026Symbolic Augmentation Closes a Canonical-Equivalence Blind Spot in Neural Fact-Checkerscited by 0
- 2026ReflectFact: Self-Reflective Agents for Improving Comprehension and Reasoning in Multi-Hop Fact Verificationcited by 0
- 2026ReflectFact: Self-Reflective Agents for Improving Comprehension and Reasoning in Multi-Hop Fact Verification13 Aug 2026
- 2026Symbolic Augmentation Closes a Canonical-Equivalence Blind Spot in Neural Fact-Checkers19 May 2026
- 2025Fact in Fragments: Deconstructing Complex Claims via LLM-based Atomic Fact Extraction and Verification9 Jun 2025
- 2025Reasoning-CV: Fine-tuning Powerful Reasoning LLMs for Knowledge-Assisted Claim Verification18 May 2025
- 2025Enhancing Multi-Hop Fact Verification with Structured Knowledge-Augmented Large Language Models11 Mar 2025
- 2024Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance?17 Oct 2024
- 2024Claim Verification in the Age of Large Language Models: A Survey26 Aug 2024
- 2024Automated Justification Production for Claim Veracity in Fact Checking: A Survey on Architectures and Approaches9 Jul 2024
- 2024RDRec: Rationale Distillation for LLM-based Recommendation17 May 2024