From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAG
On the map: LLM reasoning → Clinical and biomedical applications
also in 1 more
Abstract (arXiv)
Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering, but their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields. While Retrieval-Augmented Generation (RAG) mitigates these issues, existing methods rely on noisy token-level signals and lack the multi-round refinement required for complex reasoning. In this paper, we propose MA-RAG (Multi-Round Agentic RAG), a framework that facilitates test-time scaling for complex medical reasoning by iteratively evolving both external evidence and internal reasoning history within an agentic refinement loop. At each round, the agent transforms semantic conflict among candidate responses into actionable queries to retrieve external evidence, while optimizing history reasoning traces to mitigate long-context degradation. MA-RAG extends the self-consistency principle by leveraging the lack of consistency as a proactive signal for multi-round agentic reasoning and retrieval, and mirrors a boosting mechanism that iteratively minimizes the residual error toward a stable, high-fidelity medical consensus. Extensive evaluations across 7 medical Q&A benchmarks show that MA-RAG consistently surpasses competitive inference-time scaling and RAG baselines, delivering substantial +6.8 points on average accuracy over the backbone model. Our code is available at https://github.com/NJU-RL/MA-RAG.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 52 of its 67 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
52 of 67 references.
Closest ancestors · 5
Same direction, newest first
- 2025Baichuan-M2: Scaling Medical Capability with Large Verifier System2 Sep
- 2025An Agentic System for Rare Disease Diagnosis with Traceable Reasoning25 Jun
- 2025MedS3: Towards Medical Slow Thinking with Self-Evolved Soft Dual-sided Process Supervision21 Jan
- 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec
- 2024MedAdapter: Efficient Test-Time Adaptation of Large Language Models towards Medical Reasoning5 May
Other references · 47
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2024GPT-4o System Cardcited by 4,588
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
35 more
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
- 2025s1: Simple test-time scalingcited by 1,341
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2023Active Retrieval Augmented Generationcited by 516
- 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 485
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 331
- 2025Learning to Reason under Off-Policy Guidancecited by 281
- 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
- 2025Why Language Models Hallucinatecited by 220
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 185
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 109
- 2024UltraMedical: Building Specialized Generalists in Biomedicinecited by 67
- 2025Retrieval-Augmented Generation with Conflicting Evidencecited by 63
- 2025ExGRPO: Learning to Reason from Experiencecited by 53
- 2025Think Twice: Enhancing LLM Reasoning by Scaling Multi-round Test-time Thinkingcited by 46
- 2024MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answeringcited by 43
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 42
- 2025Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedbackcited by 41
- 2024TC-RAG:Turing-Complete RAG's Case study on Medical LLM Systemscited by 28
- 2025FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generationcited by 28
- 2025BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLPcited by 28
- 2025Diversity-Incentivized Exploration for Versatile Reasoningcited by 28
- 2025Think Just Enough: Sequence-Level Entropy as a Confidence Signal for LLM Reasoningcited by 24
- 2025MedResearcher-R1: Expert-Level Medical Deep Researcher via A Knowledge-Informed Trajectory Synthesis Frameworkcited by 22
- 2025Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Computecited by 20
- 2025From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuningcited by 12
- 2025Adaptive Termination for Multi-round Parallel Reasoning: An Universal Semantic Entropy-Guided Frameworkcited by 10
- 2025Conflict-Aware Soft Prompting for Retrieval-Augmented Generationcited by 5
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agentscited by 3
- 2026CLEAR: Cross-Source Evidence Adjudication for Large Language Models in Medicinecited by 0
- 2026Text-to-3D Policy: Fine-Grained Language-Behavior Alignment for Unseen Specification Generalizationcited by 0
- 2026MedPrune: Topology-Efficient Multimodal Multi-Agent Communication Evolution for Medical VQA Taskscited by 0
- 2026Unanimously Wrong: Certified Abstention from How Medical LLM Consensus Formscited by 0
- 2026More Reasoning Is Not Always Better: Executing Clinical Guidelines with LLMs and Rulescited by 0
- 2026Learning When to Trust Medical Knowledge: Regression-Safe Routing for Clinical Reasoningcited by 0
- 2026Learning When to Trust Medical Knowledge: Regression-Safe Routing for Clinical Reasoning14 Oct 2026
- 2026More Reasoning Is Not Always Better: Executing Clinical Guidelines with LLMs and Rules11 Oct 2026
- 2026Unanimously Wrong: Certified Abstention from How Medical LLM Consensus Forms6 Oct 2026
- 2026MedPrune: Topology-Efficient Multimodal Multi-Agent Communication Evolution for Medical VQA Tasks5 Oct 2026
- 2026Text-to-3D Policy: Fine-Grained Language-Behavior Alignment for Unseen Specification Generalization30 Sep 2026
- 2026CLEAR: Cross-Source Evidence Adjudication for Large Language Models in Medicine14 Sep 2026
- 2026TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents24 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026SEMA-RAG: A Self-Evolving Multi-Agent Retrieval-Augmented Generation Framework for Medical Reasoning
- 2025Agentic Medical Knowledge Graphs Enhance Medical Question Answering: Bridging the Gap Between LLMs and Evolving Medical Knowledge
- 2025Talk Before You Retrieve: Agent-Led Discussions for Better RAG in Medical QA
- 2026RAG-X: Systematic Diagnosis of Retrieval-Augmented Generation for Medical Question Answering
- 2025MedTrust-RAG: Evidence Verification and Trust Alignment for Biomedical Question Answering
- 2025MedicalAgentsBench for Complex Medical Reasoning: Comparing Internalized Reasoning Models versus Externalized Agent-based Frameworks
- 2026A Multi-Agent Framework for Medical AI: Leveraging Fine-Tuned GPT, LLaMA, and DeepSeek R1 for Evidence-Based and Bias-Aware Clinical Query Processing
- 2026Let LLMs Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering