CECOR: Correction-oriented synthetic data construction for factual error correction
On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping
Abstract (arXiv)
Factual Error Correction (FEC) aims to revise inaccurate text into statements that are factually consistent with external evidence. Although recent methods perform well on single-hop correction, they often treat claims as atomic units and struggle with multi-hop cases that require compositional reasoning across multiple evidence sources. This challenge is further amplified by limited paired data and difficulties in locating semantic errors within complex reasoning chains. We present CECoR (Compositional Error Correction via Reasoning-aware Synthesis), a reasoning-aware framework that introduces a Decomposition and Injection paradigm for compositional error correction. CECoR decomposes multi-hop claims into interpretable reasoning steps and injects controlled perturbations to synthesize high-quality training pairs. A two-stage learning strategy combining supervised fine-tuning and reinforcement learning improves factual accuracy and robustness. Comprehensive evaluations show that CECoR achieves strong performance on multi-hop benchmarks, outperforming both distantly supervised methods and few-shot LLM baselines. It also generalizes effectively to single-hop correction and remains stable under noisy evidence, demonstrating its versatility for real-world factual correction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 9 of its 18 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
9 of 18 references.
References · 9
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 201
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2020Evidence-based Factual Error Correctioncited by 44
- 2022Converge to the Truth: Factual Error Correction via Iterative Constrained Editingcited by 9
- 2023Improving Factual Error Correction by Learning to Inject Factual Errorscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processes
- 2026Think Through Uncertainty: Improving Long-Form Generation Factuality via Reasoning Calibration
- 2025MR-Align: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Models
- 2025Grokking in the Wild: Data Augmentation for Real-World Multi-Hop Reasoning with Transformers
- 2026VAA-CSEC: Vote-guided Advantage Allocation for Chinese Semantic Error Correction
- 2025Robust Knowledge Editing via Explicit Reasoning Chains for Distractor-Resilient Multi-Hop QA
- 2026Composition Collapse: Stable Factual Knowledge Does Not Imply Compositional Reasoning
- 2026AEScorer: An Agentic Evidence-Grounded Framework for Graded Factuality Verification