RareDx: Controlled Knowledge Integration and Graph-Grounded Policy Optimization for Rare-Disease Diagnosis
Not on the map. Why?
Abstract (arXiv)
Rare-disease diagnosis is a long-tail reasoning problem: phenotypes are incomplete, individual disorders are sparsely documented, and relevant evidence is distributed across ontologies, gene annotations, and biomedical text. Language models consequently favor common conditions, miss rare candidates, or produce plausible but invalid names. We introduce RareDx, which couples controlled evidence use with knowledge-graph-grounded policy optimization. RareDx-Harness normalizes heterogeneous records into one ranked-diagnosis task and compares direct inference, static retrieval, adaptive tools, and structured phenotype-gene-disease reasoning over a shared knowledge layer. The training pipeline combines Top-10 post-training with RareDx-KGPO, our knowledge-graph-grounded policy optimization method. Its reward projects predictions into a canonical disease graph and integrates curated graded relevance, ontology proximity, biomedical similarity, and phenotype consistency. Vocabulary and output-budget constraints prevent dense partial credit from rewarding fabricated or overlong differentials. Across eight benchmarks, the complete RareDx system centered on Qwen3.5-9B reaches 38.34 macro Hit@10, 1.60 points above GPT-5.5 under the archived protocol; a disjoint validation-selection audit retains a 6.80-point routing gain over Direct on held-out cases. The 27B system reaches 23.53/36.56/40.76 at Hit@1/5/10. Controlled ablations show that retrieval is not uniformly helpful and that controlled routing is central to the gain. These results indicate that structured medical knowledge can turn a compact model into a competitive diagnostic ranker across heterogeneous long-tail settings in clinical practice.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 37 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
13 of 37 references.
References · 13
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
- 2025An Agentic System for Rare Disease Diagnosis with Traceable Reasoningcited by 50
- 2024RareBench: Can LLMs Serve as Rare Diseases Specialists?cited by 45
- 2025Accelerating Scientific Discovery with Autonomous Goal-evolving Agentscited by 16
- 2024Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Researchcited by 8
- 2025TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilotscited by 5
- 2026Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-workcited by 3
1 more
Built on by
Not cited yet.