MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucination
On the map: Retrieval-augmented generation → Hallucination detection in RAG
also in 1 more
Abstract (arXiv)
Hallucination remains a critical bottleneck for large language models (LLMs), undermining their reliability in real-world applications, especially in Retrieval-Augmented Generation (RAG) systems. While existing hallucination detection methods employ LLM-as-a-judge to verify LLM outputs against retrieved evidence, they suffer from inherent confirmation bias, where the verifier inadvertently reproduces the errors of the original generation. To address this, we introduce Multi-Agent Reinforced Self-Check for Hallucination (MARCH), a framework that enforces rigorous factual alignment by leveraging deliberate information asymmetry. MARCH orchestrates a collaborative pipeline of three specialized agents: a Solver, a Proposer, and a Checker. The Solver generates an initial RAG response, which the Proposer decomposes into claim-level verifiable atomic propositions. Crucially, the Checker validates these propositions against retrieved evidence in isolation, deprived of the Solver's original output. This well-crafted information asymmetry scheme breaks the cycle of self-confirmation bias. By training this pipeline with multi-agent reinforcement learning (MARL), we enable the agents to co-evolve and optimize factual adherence. Extensive experiments across hallucination benchmarks demonstrate that MARCH substantially reduces hallucination rates. Notably, an 8B-parameter LLM equipped with MARCH achieves performance competitive with powerful closed-source models. MARCH paves a scalable path for factual self-improvement of LLMs through co-evolution. The code is at https://github.com/Qwen-Applications/MARCH.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Hallucination detection in RAG, one of 15 directions in Retrieval-augmented generation. Builds on 67 of its 81 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
67 of 81 references.
Closest ancestors · 2
Same direction, newest first
- 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards7 May
- 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models31 Dec
Other references · 65
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
38 more
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 672
- 2018Behavioral Cloning from Observationcited by 482
- 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 431
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 343
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 338
- 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 329
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
- 2024Skywork-Reward: Bag of Tricks for Reward Modeling in LLMscited by 322
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2021Measuring Attribution in Natural Language Generation Modelscited by 253
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 251
- 2025Inference-Time Scaling for Generalist Reward Modelingcited by 233
- 2024Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?cited by 227
- 2025Why Language Models Hallucinatecited by 205
- 2025Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergycited by 204
- 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 180
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
- 2024Large Legal Fictions: Profiling Legal Hallucinations in Large Language Modelscited by 144
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Delayed Verification Destabilizes Multi-Agent LLM Belief: Instability Thresholds and Optimal Corrector Placementcited by 4
- 2026GD2PO: Mitigating Multi-Reward Conflicts via Group-Dynamic reward-Decoupled Policy Optimizationcited by 3
- 2026SEVA: Self-Evolving Verification Agent with Process Reward for Fact Attributioncited by 3
- 2026When Is a Multi-Agent Code Judge Actually Grounded? Two Label-Free Measurements, and a Judge That Declines to Guesscited by 0
- 2026MAADBench: The Refreshable Paradigm for Anomaly Detection in Multi-Agent Systemscited by 0
- 2026MAADBench: The Refreshable Paradigm for Anomaly Detection in Multi-Agent Systems29 Sep 2026
- 2026When Is a Multi-Agent Code Judge Actually Grounded? Two Label-Free Measurements, and a Judge That Declines to Guess23 Sep 2026
- 2026SEVA: Self-Evolving Verification Agent with Process Reward for Fact Attribution29 Jun 2026
- 2026Delayed Verification Destabilizes Multi-Agent LLM Belief: Instability Thresholds and Optimal Corrector Placement25 Jun 2026
- 2026GD2PO: Mitigating Multi-Reward Conflicts via Group-Dynamic reward-Decoupled Policy Optimization15 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2024Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework
- 2026Cascading Hallucination in Agentic RAG: The CHARM Framework for Detection and Mitigation
- 2026Hallucination Cascade: Analyzing Error Propagation in Multi-Agent LLM Systems
- 2026AgentHallu: Benchmarking Automated Hallucination Attribution of LLM-based Agents
- 2026Collective Hallucination in Multi-Agent LLMs:Modeling and Defense
- 2026Zero-source LLM Hallucination Detection with Human-like Criteria Probing
- 2026Token-Guard: Towards Token-Level Hallucination Control via Self-Checking Decoding
- 2026Council Mode: A Heterogeneous Multi-Agent Consensus Framework for Reducing LLM Hallucination and Bias