Mask-to-Correct^+: Leveraging Retriever Diversity for Masking-guided Faithful Fact Correction
Not on the map. Why?
Abstract (arXiv)
The rapid spread of misinformation on social media highlights the need for robust, automated fact correction frameworks. However, existing works rely on supervised learning from manually annotated claim-evidence pairs, which are scarce and prone to biases, limiting their generalization across domains. Moreover, these methods overlook semantic faithfulness in their correction process. To address these challenges, we propose Mask-to-Correct (M2C), a training-free, inference-only Retrieval Augmented Generation (RAG) based framework that leverages diversity-aware masking to identify erroneous spans of claims and evaluate the faithfulness of corrections using retrieved evidence. However, the effectiveness of RAG heavily depends on the choice of retriever, which may vary across queries. To mitigate this, we further introduce M2C^+, an ensemble-based framework that combines corrections across multiple rankers to reduce retrieval bias and improve robustness. Extensive experiments on the benchmark datasets demonstrate that our proposed frameworks consistently outperform all baselines, achieving up to 14% improvement in SARI scores, without using gold evidence.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 81 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
52 of 81 references.
References · 52
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
38 more
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
- 2021GPT Understands, Toocited by 716
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2021MetaICL: Learning to Learn In Contextcited by 454
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
- 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
- 2020Autoregressive Entity Retrievalcited by 334
- 2017Beam Search Strategies for Neural Machine Translationcited by 232
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 225
- 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 207
- 2019Towards Debiasing Fact Verification Modelscited by 143
- 2019Fine-grained Fact Verification with Kernel Graph Attention Networkcited by 105
- 2022Re2G: Retrieve, Rerank, Generatecited by 102
- 2019GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verificationcited by 100
- 2021The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Modelscited by 81
- 2021DocNLI: A Large-scale Dataset for Document-level Natural Language Inferencecited by 75
- 2018Simple Unsupervised Keyphrase Extraction using Sentence Embeddingscited by 62
- 2021Pyserini: An Easy-to-Use Python Toolkit to Support Replicable IR Research with Sparse and Dense Representationscited by 60
- 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
- 2019BERT for Evidence Retrieval and Claim Verificationcited by 57
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 53
- 2020Evidence-based Factual Error Correctioncited by 44
- 2023Unsupervised Dense Retrieval with Relevance-Aware Contrastive Pre-Trainingcited by 35
- 2019Automatic Fact-guided Sentence Modificationcited by 28
- 2022Learning to Revise References for Faithful Summarizationcited by 28
- 2023Zero-shot Faithful Factual Error Correctioncited by 26
- 2023FLEEK: Factual Error Detection and Correction with Evidence Retrieved from External Knowledgecited by 25
- 2024Retrieval Augmented Fact Verification by Synthesizing Contrastive Argumentscited by 25
- 2024When to Retrieve: Teaching LLMs to Utilize Information Retrieval Effectivelycited by 21
- 2023From Classification to Generation: Insights into Crosslingual Retrieval Augmented ICLcited by 17
- 2022Improving Factual Consistency in Summarization with Compression-Based Post-Editingcited by 13
- 2022Converge to the Truth: Factual Error Correction via Iterative Constrained Editingcited by 9
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievals
- 2025ADMIT: Few-shot Knowledge Poisoning Attacks on RAG-based Fact Checking
- 2025Resolving Conflicting Evidence in Automated Fact-Checking: A Study on Retrieval-Augmented LLMs
- 2025SUCEA: Reasoning-Intensive Retrieval for Adversarial Fact-checking through Claim Decomposition and Editing
- 2025Fact or Facsimile? Evaluating the Factual Robustness of Modern Retrievers
- 2024AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG task
- 2026MIRAGE: Defending Long-Form RAG Against Misinformation Pollution
- 2026Reason and Verify: A Framework for Faithful Retrieval-Augmented Generation