mlsanityData to 14 Oct 2026

DiagLoop: A Counterfactual Data Flywheel with Stage-Localized Reinforcement for Diagnostic LLMs

arXiv 2608.03674 ↗First posted 4 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Causal diagnostic models must explain how conclusions follow from evidence because diagnoses guide repairs and treatments. Yet serious cases are scarce, records rarely contain reasoning paths, and data transfer poorly across configurations, complicating local deployment. We present DiagLoop, a counterfactual data flywheel that converts codified physical relations or clinical guidelines, authored once per mechanism family, into training supervision beyond recorded cases. A training-only teacher proposes counterfactual worlds by varying causes, contexts, and observations, while an independent hybrid checker admits only valid worlds. The student reasons through symptom abstraction, causal-chain construction, and root-cause attribution. Stage-specific criteria identify its earliest failure. For nonterminal failures, a bounded repair probes downstream competence, and the resulting weakness profile guides subsequent data generation. Stage-localized reinforcement learning updates only the model-generated continuation, while replay and preservation reduce forgetting. The same criteria govern admission, attribution, reward, and regeneration through checks separate from the proposer. Using only synthesized scenarios and no case-level expert reasoning annotations, the resulting 8B model improves strict path correctness over the strongest conventional baseline. Gains are 11.6 points across eight industrial systems and 5.5 points across ten disease categories. Gains over a deranged-routing control are 3.9 and 2.3 points, respectively. The model also exceeds the evaluated proprietary references in both domains, even when they receive few-shot examples or the specification in context.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

17 of 33 references.

References · 17

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2023Let's Verify Step by Stepcited by 3,789
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  6. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  7. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  8. 2018Experience Replay for Continual Learningcited by 1,095
  9. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
  10. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  11. 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 439
  12. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
5 more
  1. 2024Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoningcited by 279
  2. 2022DDXPlus: A New Dataset For Automatic Medical Diagnosiscited by 88
  3. 2025Overcoming catastrophic forgetting in neural networkscited by 55
  4. 2026Mock Worlds, Real Skills: Building Small Agentic Language Models with Synthetic Tasks, Simulated Environments, and Rubric-Based Rewardscited by 10
  5. 2026AgenticQwen: Training Small Agentic Language Models with Dual Data Flywheels for Industrial-Scale Tool Usecited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MedEinst: Benchmarking the Einstellung Effect in Medical LLMs through Counterfactual Differential Diagnosis
  2. 2026Improving Clinical Diagnosis with Counterfactual Multi-Agent Reasoning
  3. 2026CLExEval: A Human-in-the-Loop Framework for Qualitative Evaluation of LLM Clinical Reasoning
  4. 2026Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Models
  5. 2026EviDx: Evidence-Aware Active Diagnosis with Scaffolded LLM Agents
  6. 2026Counterfactual Evaluation Reveals Hidden Capability Profiles in Clinical LLMs and Agents
  7. 2026Joint Optimization of Reasoning and Dual-Memory for Self-Learning Diagnostic Agent
  8. 2026GuideSkill: Evolving Executable LLM Agent Skills for Guideline-Grounded Clinical Reasoning