Dialectic-Med: Mitigating Diagnostic Hallucinations via Counterfactual Adversarial Multi-Agent Debate
On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs
also in 1 more
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) in healthcare suffer from severe confirmation bias, often hallucinating visual details to support initial, potentially erroneous diagnostic hypotheses. Existing Chain-of-Thought (CoT) approaches lack intrinsic correction mechanisms, rendering them vulnerable to error propagation. To bridge this gap, we propose Dialectic-Med, a multi-agent framework that enforces diagnostic rigor through adversarial dialectics. Unlike static consensus models, Dialectic-Med orchestrates a dynamic interplay between three role-specialized agents: a proponent that formulates diagnostic hypotheses; an opponent equipped with a novel visual falsification module that actively retrieves contradictory visual evidence to challenge the Proponent; and a mediator that resolves conflicts via a weighted consensus graph. By explicitly modeling the cognitive process of falsification, our framework guarantees that diagnostic reasoning is tightly grounded in verified visual regions. Empirical evaluations on MIMIC-CXR-VQA, VQA-RAD, and PathVQA demonstrate that Dialectic-Med not only achieves state-of-the-art performance but also fundamentally enhances the trustworthiness of the reasoning process. Beyond accuracy, our approach significantly enhances explanation faithfulness and decisively mitigates hallucinations, establishing a new standard over single-agent baselines.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 39 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
18 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 17
- 2017Attention Is All You Needcited by 60,361
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
5 more
- 2020Counterfactual VQA: A Cause-Effect Look at Language Biascited by 266
- 2022Can large language models reason about medical questions?cited by 194
- 2025Medical Hallucinations in Foundation Models and Their Impact on Healthcarecited by 93
- 2024ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Datasetcited by 54
- 2025DeepGB-TB: A Risk-Balanced Cross-Attention Gradient-Boosted Convolutional Network for Rapid, Interpretable Tuberculosis Screeningcited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Med-StepBench: A Hierarchical Reasoning Framework for Evaluating Hallucinations in Medical Vision-Language Models
- 2025MedMMV: A Controllable Multimodal Multi-Agent Framework for Reliable and Verifiable Clinical Reasoning
- 2026Thinking Like a Clinician: A Cognitive AI Agent for Clinical Diagnosis via Panoramic Profiling and Adversarial Debate
- 2026Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence
- 2025EH-Benchmark Ophthalmic Hallucination Benchmark and Agent-Driven Top-Down Traceable Reasoning Workflow
- 2025MedHallTune: An Instruction-Tuning Benchmark for Mitigating Medical Hallucination in Vision-Language Models
- 2026ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning
- 2026EVADE: Evidence-Verified Agentic Diagnosis with Escape