Dense Clinical Contrasts Enhance Medical Knowledge Updating in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Medical knowledge changes continually, making large language models vulnerable to relying on outdated yet clinically plausible information. We study whether the format of supervision affects medical knowledge updating under a matched training-budget setting. We introduce SEER-Bench, a temporally anchored oncology-staging benchmark curated from the latest versioned SEER Research Data release, and render identical medical update events from NCCN oncology guidelines into four supervision formats: EMQ, MSQ, FITB, and SAQ. Across SEER-Bench and HealthBench Professional, EMQ gives the most stable external transfer and retention among same-budget SFT variants. With EMQ supervision, the updated 4B model produces competitive results on temporally anchored oncology staging, reaching 64.8% answer accuracy and 59.6% rationale accuracy on SEER-Bench. Diagnostic analyses suggest that EMQ exposes denser clinical contrast signals while preserving discriminative representations with smaller movement from the base model. These results show that medical knowledge updating depends not only on the update algorithm, but also on how knowledge is structured as supervision.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 55 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
25 of 55 references.
References · 25
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025Qwen3 Technical Reportcited by 8,820
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
13 more
- 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 408
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 318
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
- 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
- 2022TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Modelscited by 119
- 2026HealthBench Professional: Evaluating Large Language Models on Real Clinician Chatscited by 26
- 2024DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMscited by 24
- 2024Time Sensitive Knowledge Editing through Efficient Finetuningcited by 14
- 2026LiveMedBench: A Contamination-Free Medical Benchmark for LLMs with Automated Rubric Evaluationcited by 12
- 2023Generating multiple-choice questions for medical question answering with distractors and cue-maskingcited by 3
- 2026ProMedical: Hierarchical Fine-Grained Criteria Modeling for Medical LLM Alignment via Explicit Injectioncited by 2
- 2026A Blind Spot in Alignment: Quantifying Biosecurity Risks in Large Language Modelscited by 2
Built on by
Not cited yet.