mlsanityData to 7 Oct 2026

GLoC-EHR: Evidence-Cited Clinical Reasoning over Global Context and Local EHR Events

arXiv 2610.01076 ↗First posted 1 Oct 2026cs.LGcited by 0

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Structured electronic health records (EHRs) contain a patient's clinical trajectory as a sequence of clinical codes. Answering clinical questions from such records requires both the context of the whole trajectory and the specific events that support the answer. We introduce GLoC-EHR, a multimodal language model that reads a contextual encoding of the record through a fixed-size global memory of the trajectory and a local memory of selected events. The model learns to generate hospital-course summaries from the global memory and descriptions of masked concepts from the local memory, aligning both with clinical text. It is then trained to cite evidence before answering, through rationale fine-tuning followed by group relative policy optimization (GRPO) with rewards for correct answers and record-supported evidence. On three MIMIC-IV outcome tasks, GLoC-EHR attains the highest macro AUROC among the compared models when it answers directly, whereas zero-shot LLMs reading the serialized record fall far behind. With evidence-cited reasoning, it stays close to its direct multi-task counterpart in macro AUROC, and the evidence terms of the objective reduce unsupported evidence at a similar macro AUROC. The local memory adds distinct supported findings, particularly under strict matching, without a detectable change in macro AUROC. Without retraining, GLoC-EHR transfers to EHRSHOT on par with EHR-BERT and answers two unseen laboratory questions better than zero-shot prompting of its own backbone.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 53 of its 71 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

53 of 71 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025EHR-R1: A Reasoning-Enhanced Foundational Language Model for Electronic Health Record Analysis29 Oct
  2. 2025Training LLMs for EHR-Based Reasoning Tasks via Reinforcement Learning30 May
  3. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec

Other references · 50

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  9. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  10. 2017On Calibration of Modern Neural Networkscited by 4,860
  11. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  12. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
38 more
  1. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  2. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  3. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  4. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  5. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
  6. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  7. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
  8. 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 590
  9. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  10. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 523
  11. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
  12. 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 396
  13. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
  14. 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
  15. 2016Rationalizing Neural Predictionscited by 281
  16. 2018Scalable and accurate deep learning for electronic health recordscited by 275
  17. 2022TabLLM: Few-shot Classification of Tabular Data with Large Language Modelscited by 273
  18. 2019BEHRT: Transformer for Electronic Health Recordscited by 258
  19. 2021Measuring Attribution in Natural Language Generation Modelscited by 253
  20. 2017All-but-the-Top: Simple and Effective Postprocessing for Word Representationscited by 205
  21. 2021Whitening Sentence Representations for Better Semantics and Faster Retrievalcited by 198
  22. 2020Learning to Faithfully Rationalize by Constructioncited by 113
  23. 2023Faithfulness Tests for Natural Language Explanationscited by 107
  24. 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 101
  25. 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 85
  26. 2021CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction taskscited by 75
  27. 2023MOTOR: A Time-To-Event Foundation Model For Structured Medical Recordscited by 75
  28. 2024Zero Shot Health Trajectory Prediction Using Transformercited by 74
  29. 2021WhiteningBERT: An Easy Unsupervised Sentence Embedding Approachcited by 68
  30. 2024Cross-modal Information Flow in Multimodal Large Language Modelscited by 65
  31. 2023Multimodal LLMs for health grounded in individual-specific datacited by 48
  32. 2023CPLLM: Clinical Prediction with Large Language Modelscited by 34
  33. 2024ClinicalBench: Can LLMs Beat Traditional ML Models in Clinical Prediction?cited by 31
  34. 2025Large Language Models are Powerful Electronic Health Record Encoderscited by 25
  35. 2024Prompting Large Language Models for Zero-Shot Clinical Prediction with Structured Longitudinal Electronic Health Record Datacited by 22
  36. 2024A dataset and benchmark for hospital course summarization with adapted large language modelscited by 10
  37. 2025MoMA: A Mixture-of-Multimodal-Agents Architecture for Enhancing Clinical Prediction Modellingcited by 7
  38. 2025MedRep: Medical Concept Representation for General Electronic Health Record Foundation Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ChatHealthAI: Aligning Electronic Health Record Representations with Large Language Models for Grounded Clinical Reasoning
  2. 2026EHR-RAG: Bridging Long-Horizon Structured Electronic Health Records and Large Language Models via Enhanced Retrieval-Augmented Generation
  3. 2026GraphWalker: Patient Analogy Meets Information Gain for Clinical Reasoning with Large Language Models
  4. 2026MedRLM: Recursive Multimodal Health Intelligence for Long-Context Clinical Reasoning, Sensor-Guided Screening, Evidence-Grounded Decision Support, and Community-to-Tertiary Referral Optimization
  5. 2025Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Prediction
  6. 2025EHRStruct: A Comprehensive Benchmark Framework for Evaluating Large Language Models on Structured Electronic Health Record Tasks
  7. 2025Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention Guidance
  8. 2026Inhibitory Attention for Clinical Long-Context Reasoning: Characterizing and Mitigating Lost-in-the-Middle Effects in EHR Processing