mlsanityData to 14 Oct 2026

PACT: Learning Diverse Diagnostic Strategies via Privileged Synthesis and Branch Consensus

arXiv 2606.08938 ↗First posted 8 Jun 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Clinical diagnosis requires flexible use of multiple reasoning paradigms under incomplete patient information. Existing LLM-based medical agents show strong medical reasoning ability, but single-paradigm or naively mixed dialogue supervision makes these paradigms difficult to learn without interference. We propose PACT (Periodic Anchor Consensus Training), a framework that couples supervised multi-paradigm dialogue synthesis with consensus-based Branch training. At the data level, DPS (Doctor-Patient-Supervisor) uses complete electronic medical records (EMRs) for quality control while keeping the doctor agent restricted to patient-visible information. This produces validated dialogues under four diagnostic reasoning paradigms without leaking hidden clinical answers. At the training level, PACT trains one paradigm-specific LoRA Branch per paradigm and periodically aggregates Branches into a shared Anchor through sign consensus. We further construct a dynamic multi-turn Chinese medical diagnosis benchmark for interactive consultation. Experiments show that PACT achieves state-of-the-art performance among compared proprietary, medical-specialized, and task-adapted baselines on diagnostic outcome and consultation-process metrics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 33 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

11 of 33 references.

References · 11

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  5. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  6. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
  7. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
  8. 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
  9. 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
  10. 2024UltraMedical: Building Specialized Generalists in Biomedicinecited by 67
  11. 2020MedDG: An Entity-Centric Medical Consultation Dataset for Entity-Aware Medical Dialogue Generationcited by 45

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evidence, Logic, and Compliance: Multi-Agent Structured Graph Reasoning with Expert Arbitration for Medical Referral
  2. 2024Reasoning Like a Doctor: Improving Medical Dialogue Systems via Diagnostic Reasoning Process Alignment
  3. 2025Dialogue is Better Than Monologue: Instructing Medical LLMs via Strategical Conversations
  4. 2026MeDxAgent: Multi-Agent Consultation for Interactive Medical Diagnosis
  5. 2026Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoning
  6. 2026MedDialogRubrics: A Comprehensive Benchmark and Evaluation Framework for Multi-turn Medical Consultations in Large Language Models
  7. 2024Integrating Physician Diagnostic Logic into Large Language Models: Preference Learning from Process Feedback
  8. 2025MAM: Modular Multi-Agent Framework for Multi-Modal Medical Diagnosis via Role-Specialized Collaboration