Silence is Not Consensus: Disrupting Agreement Bias in Multi-Agent LLMs via Catfish Agent for Clinical Decision Making
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Large language models (LLMs) have demonstrated strong potential in clinical question answering, with recent multi-agent frameworks further improving diagnostic accuracy via collaborative reasoning. However, we identify a recurring issue of Silent Agreement, where agents prematurely converge on diagnoses without sufficient critical analysis, particularly in complex or ambiguous cases. We present a new concept called Catfish Agent, a role-specialized LLM designed to inject structured dissent and counter silent agreement. Inspired by the ``catfish effect'' in organizational psychology, the Catfish Agent is designed to challenge emerging consensus to stimulate deeper reasoning. We formulate two mechanisms to encourage effective and context-aware interventions: (i) a complexity-aware intervention that modulates agent engagement based on case difficulty, and (ii) a tone-calibrated intervention articulated to balance critique and collaboration. Evaluations on nine medical Q&A and three medical VQA benchmarks show that our approach consistently outperforms both single- and multi-agent LLMs frameworks, including leading commercial models such as GPT-4o and DeepSeek-R1.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 54 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
23 of 54 references.
Closest ancestors · 2
Same direction, newest first
- 2025MedicalAgentsBench for Complex Medical Reasoning: Comparing Internalized Reasoning Models versus Externalized Agent-based Frameworks10 Mar
- 2024Beyond Direct Diagnosis: LLM-based Multi-Specialist Agent Consultation for Automatic Diagnosis29 Jan
Other references · 21
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
9 more
- 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 265
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
- 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
- 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 109
- 2024MedExQA: Medical Question Answering Benchmark with Multiple Explanationscited by 60
- 2024MedCoT: Medical Chain of Thought via Hierarchical Expertcited by 46
- 2024Towards Efficient LLM Grounding for Embodied Multi-Agent Collaborationcited by 45
- 2025Baichuan-M1: Pushing the Medical Capability of Large Language Modelscited by 43
- 2025Self-Supervised Prompt Optimizationcited by 37
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026The Consistency Illusion: How Multi-Agent Debate Hides Reasoning Misalignment
- 2026Let LLMs Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering
- 2026A Multi-Agent Framework for Medical AI: Leveraging Fine-Tuned GPT, LLaMA, and DeepSeek R1 for Evidence-Based and Bias-Aware Clinical Query Processing
- 2026Do Mixed-Vendor Multi-Agent LLMs Improve Clinical Diagnosis?
- 2025MedLA: A Logic-Driven Multi-Agent Framework for Complex Medical Reasoning with Large Language Models
- 2026From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAG
- 2024Enhancing Diagnostic Accuracy through Multi-Agent Conversations: Using Large Language Models to Mitigate Cognitive Bias
- 2025Reasoning LLMs in the Medical Domain: A Literature Survey