mlsanityData to 14 Oct 2026

From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAG

arXiv 2603.03292 ↗First posted 6 Feb 2026cs.CL cs.AI cs.IRcited by 7

On the map: LLM reasoning → Clinical and biomedical applications

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering, but their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields. While Retrieval-Augmented Generation (RAG) mitigates these issues, existing methods rely on noisy token-level signals and lack the multi-round refinement required for complex reasoning. In this paper, we propose MA-RAG (Multi-Round Agentic RAG), a framework that facilitates test-time scaling for complex medical reasoning by iteratively evolving both external evidence and internal reasoning history within an agentic refinement loop. At each round, the agent transforms semantic conflict among candidate responses into actionable queries to retrieve external evidence, while optimizing history reasoning traces to mitigate long-context degradation. MA-RAG extends the self-consistency principle by leveraging the lack of consistency as a proactive signal for multi-round agentic reasoning and retrieval, and mirrors a boosting mechanism that iteratively minimizes the residual error toward a stable, high-fidelity medical consensus. Extensive evaluations across 7 medical Q&A benchmarks show that MA-RAG consistently surpasses competitive inference-time scaling and RAG baselines, delivering substantial +6.8 points on average accuracy over the backbone model. Our code is available at https://github.com/NJU-RL/MA-RAG.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 52 of its 67 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

52 of 67 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Baichuan-M2: Scaling Medical Capability with Large Verifier System2 Sep
  2. 2025An Agentic System for Rare Disease Diagnosis with Traceable Reasoning25 Jun
  3. 2025MedS3: Towards Medical Slow Thinking with Self-Evolved Soft Dual-sided Process Supervision21 Jan
  4. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec
  5. 2024MedAdapter: Efficient Test-Time Adaptation of Large Language Models towards Medical Reasoning5 May

Other references · 47

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  8. 2024GPT-4o System Cardcited by 4,588
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  10. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  11. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  12. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
35 more
  1. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  2. 2025s1: Simple test-time scalingcited by 1,341
  3. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  4. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  5. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  7. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  8. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  9. 2023Active Retrieval Augmented Generationcited by 516
  10. 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 485
  11. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
  12. 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 331
  13. 2025Learning to Reason under Off-Policy Guidancecited by 281
  14. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
  15. 2025Why Language Models Hallucinatecited by 220
  16. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 185
  17. 2025A Survey of Context Engineering for Large Language Modelscited by 126
  18. 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 109
  19. 2024UltraMedical: Building Specialized Generalists in Biomedicinecited by 67
  20. 2025Retrieval-Augmented Generation with Conflicting Evidencecited by 63
  21. 2025ExGRPO: Learning to Reason from Experiencecited by 53
  22. 2025Think Twice: Enhancing LLM Reasoning by Scaling Multi-round Test-time Thinkingcited by 46
  23. 2024MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answeringcited by 43
  24. 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 42
  25. 2025Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedbackcited by 41
  26. 2024TC-RAG:Turing-Complete RAG's Case study on Medical LLM Systemscited by 28
  27. 2025FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generationcited by 28
  28. 2025BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLPcited by 28
  29. 2025Diversity-Incentivized Exploration for Versatile Reasoningcited by 28
  30. 2025Think Just Enough: Sequence-Level Entropy as a Confidence Signal for LLM Reasoningcited by 24
  31. 2025MedResearcher-R1: Expert-Level Medical Deep Researcher via A Knowledge-Informed Trajectory Synthesis Frameworkcited by 22
  32. 2025Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Computecited by 20
  33. 2025From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuningcited by 12
  34. 2025Adaptive Termination for Multi-round Parallel Reasoning: An Universal Semantic Entropy-Guided Frameworkcited by 10
  35. 2025Conflict-Aware Soft Prompting for Retrieval-Augmented Generationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SEMA-RAG: A Self-Evolving Multi-Agent Retrieval-Augmented Generation Framework for Medical Reasoning
  2. 2025Agentic Medical Knowledge Graphs Enhance Medical Question Answering: Bridging the Gap Between LLMs and Evolving Medical Knowledge
  3. 2025Talk Before You Retrieve: Agent-Led Discussions for Better RAG in Medical QA
  4. 2026RAG-X: Systematic Diagnosis of Retrieval-Augmented Generation for Medical Question Answering
  5. 2025MedTrust-RAG: Evidence Verification and Trust Alignment for Biomedical Question Answering
  6. 2025MedicalAgentsBench for Complex Medical Reasoning: Comparing Internalized Reasoning Models versus Externalized Agent-based Frameworks
  7. 2026A Multi-Agent Framework for Medical AI: Leveraging Fine-Tuned GPT, LLaMA, and DeepSeek R1 for Evidence-Based and Bias-Aware Clinical Query Processing
  8. 2026Let LLMs Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering