mlsanityData to 7 Oct 2026

From Exposure to Internalization: Dual-Stream Calibration for In-context Clinical Reasoning

arXiv 2604.06262 ↗First posted 7 Apr 2026q-bio.QM cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Contextual clinical reasoning demands robust inference grounded in complex, heterogeneous clinical records. While state-of-the-art fine-tuning, in-context learning (ICL), and retrieval-augmented generation (RAG) enable knowledge exposure, they often fall short of genuine contextual internalization: dynamically adjusting a model's internal representations to the subtle nuances of individual cases at inference time. To address this, we propose Dual-Stream Calibration (DSC), a test-time training framework that transcends superficial knowledge exposure to achieve deep internalization during inference. DSC facilitates input internalization by synergistically aligning two calibration streams. Unlike passive context exposure, the Semantic Calibration Stream enforces a deliberative reflection on core evidence, internalizing semantic anchors by minimizing entropy to stabilize generative trajectories. Simultaneously, the Structural Calibration Stream assimilates latent inferential dependencies through an iterative meta-learning objective. By training on specialized support sets at test-time, this stream enables the model to bridge the gap between external evidence and internal logic, synthesizing fragmented data into a coherent response. Our approach shifts the reasoning paradigm from passive attention-based matching to an active refinement of the latent inferential space. Validated against thirteen clinical datasets, DSC demonstrates superiority across three distinct task paradigms, consistently outstripping state-of-the-art baselines ranging from training-dependent models to test-time learning frameworks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 65 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

54 of 65 references.

References · 54

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  5. 2024Qwen2.5 Technical Reportcited by 4,713
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  7. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  8. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  9. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  10. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
  11. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  12. 2021MetaICL: Learning to Learn In Contextcited by 450
38 more
  1. 2023A Survey on Large Language Models for Recommendationcited by 378
  2. 2024The Faiss librarycited by 370
  3. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
  4. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  5. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
  6. 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 222
  7. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
  8. 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 211
  9. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
  10. 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 162
  11. 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
  12. 2024A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directionscited by 115
  13. 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 106
  14. 2024The Surprising Effectiveness of Test-Time Training for Few-Shot Learningcited by 88
  15. 2022Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrationscited by 70
  16. 2024MedExQA: Medical Question Answering Benchmark with Multiple Explanationscited by 58
  17. 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
  18. 2024Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up Questionscited by 54
  19. 2021Paragraph-level Simplification of Medical Textscited by 52
  20. 2025Test-Time Learning for Large Language Modelscited by 46
  21. 2024Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMscited by 39
  22. 2024BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrieverscited by 38
  23. 2025MedicalAgentsBench for Complex Medical Reasoning: Comparing Internalized Reasoning Models versus Externalized Agent-based Frameworkscited by 38
  24. 2025MedAgentBoard: Benchmarking Multi-Agent Collaboration with Conventional Methods for Diverse Medical Taskscited by 29
  25. 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
  26. 2024Large Language Models for Anomaly and Out-of-Distribution Detection: A Surveycited by 24
  27. 2024ColaCare: Enhancing Electronic Health Record Modeling through Large Language Model-Driven Multi-Agent Collaborationcited by 23
  28. 2024Uncertainty-Calibrated Test-Time Model Adaptation without Forgettingcited by 20
  29. 2025DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Modelscited by 19
  30. 2024Large Language Models are In-Context Molecule Learnerscited by 18
  31. 2025SLOT: Sample-specific Language Model Optimization at Test-timecited by 17
  32. 2024Dual Test-time Training for Out-of-distribution Recommender Systemcited by 16
  33. 2024Assessing and Enhancing Large Language Models in Rare Disease Question-answeringcited by 16
  34. 2024A Survey to Recent Progress Towards Understanding In-Context Learningcited by 12
  35. 2025End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoningcited by 10
  36. 2025Revisiting Test-Time Scaling: A Survey and a Diversity-Aware Method for Efficient Reasoningcited by 8
  37. 2024Minimum Entropy Coupling with Bottleneckcited by 5
  38. 2025Unveiling Discrete Clues: Superior Healthcare Predictions for Rare Diseasescited by 5

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Knowledge-Reasoning Dissociation: Fundamental Limitations of LLMs in Clinical Natural Language Inference
  2. 2026Position, Not Provenance: Separating Reasoning Mediation from Sycophancy in Medical Vision-Language Models
  3. 2025Compartmentalised Agentic Reasoning for Clinical NLI
  4. 2026Generated Context versus Governed State: Functional Conditions for Accountable Longitudinal Clinical Reasoning
  5. 2025Dissecting Clinical Reasoning in Language Models: A Comparative Study of Prompts and Model Adaptation Strategies
  6. 2025O1 Replication Journey -- Part 3: Inference-time Scaling for Medical Reasoning
  7. 2025AdaThink-Med: Optimizing Inference-Time Compute for Medical Reasoning via Uncertainty Quantification
  8. 2025Towards Efficient Medical Reasoning with Minimal Fine-Tuning Data