Co-FactChecker: A Framework for Human-AI Collaborative Claim Verification Using Large Reasoning Models
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Professional fact-checkers rely on domain knowledge and deep contextual understanding to verify claims. Large language models (LLMs) and large reasoning models (LRMs) lack such grounding and primarily reason from available evidence alone, creating a mismatch between expert-led and fully automated claim verification. To mitigate this gap, we posit human-AI collaboration as a more promising path forward, where expert feedback, grounded in real-world knowledge and domain expertise, guides the model's reasoning. However, existing LRMs are hard to calibrate to natural language feedback, particularly in a multi-turn interaction setup. We propose Co-FactChecker, a framework for human-AI collaborative claim verification. We introduce a new interaction paradigm that treats the model's thinking trace as a shared scratchpad. Co-FactChecker translates expert feedback into trace-edits that introduce targeted modifications to the trace, sidestepping the shortcomings of dialogue-based interaction. We provide theoretical results showing that trace-editing offers advantages over multi-turn dialogue, and our automatic evaluations demonstrate that Co-FactChecker outperforms existing autonomous and human-AI collaboration approaches. Human evaluations further show that Co-FactChecker is preferred over multi-turn dialogue, producing higher quality reasoning and verdicts along with relatively easier to interpret and more useful thinking traces.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 26 of its 42 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
26 of 42 references.
Closest ancestors · 1
Same direction, newest first
Other references · 25
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2020Learning to summarize from human feedbackcited by 2,588
- 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 446
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
- 2025Inference-Time Scaling for Generalist Reward Modelingcited by 239
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 124
13 more
- 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkerscited by 87
- 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaborationcited by 65
- 2025Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifierscited by 62
- 2025When Thinking Fails: The Pitfalls of Reasoning for Instruction-Following in LLMscited by 53
- 2024FIRE: Fact-checking with Iterative Retrieval and Verificationcited by 39
- 2024JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claimscited by 29
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 29
- 2025The simulation of judgment in LLMscited by 22
- 2022Human and technological infrastructures of fact-checkingcited by 16
- 2025Can LLMs Automate Fact-Checking Article Writing?cited by 7
- 2025Expert Preference-based Evaluation of Automated Related Work Generationcited by 6
- 2025ThinkPilot: Steering Reasoning Models via Automated Think-prefixes Optimizationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Leveraging LLM Parametric Knowledge for Fact Checking without Retrieval
- 2023The Perils & Promises of Fact-checking with Large Language Models
- 2025Althea: The Fact-Checking--Metalearning Tradeoff in AI-Assisted Verification
- 2025FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Models
- 2026ReflectFact: Self-Reflective Agents for Improving Comprehension and Reasoning in Multi-Hop Fact Verification
- 2025Veri-R1: Toward Precise and Faithful Claim Verification via Online Reinforcement Learning
- 2024Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debate
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models