mlsanityData to 14 Oct 2026

CliniCIRCA: A Modular LLM Framework for Constructing Longitudinal Mental Health Patient Journeys from Raw EHR Narratives

arXiv 2609.19585 ↗First posted 17 Sep 2026cs.CL cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

In mental health care, reasoning over patient journeys is a key task for clinicians. Yet these journeys, encompassing a longitudinal progression of biological, psychological, and social events, are often spread across disparate unstructured text narratives, making temporal recovery challenging. We present CliniCIRCA, a multi-stage LLM framework for Calendar-anchored, Imprecision-aware Reconstruction of Clinical Annals. To our knowledge, CliniCIRCA is the first to temporally classify clinical events across unstructured discharge summaries without event-level timestamps. From 14,882 MIMIC-III mental health admissions, we first construct a benchmark of 52 discharge summaries on which CliniCIRCA produces 15,891 temporally tagged events. After correcting 629 errors based on a clinician-in-the-loop evaluation, we produce verified gold-standard labels. Finally, the corrected timelines drive a temporally grounded summarization stage that compresses each source 1.52 times into a date-grouped chronological record. We then scale the framework to generate 1,000 silver-standard timelines and evaluate them as training data. Compared with zero- and few-shot prompting, instruction tuning generally improves five open-weight models on event extraction, temporal tagging, and summarization across silver and clinician-verified evaluations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 73 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

20 of 73 references.

References · 20

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  4. 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
  5. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 246
  6. 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 243
  7. 2020With Little Power Comes Great Responsibilitycited by 142
  8. 2023ACI-BENCH: a Novel Ambient Clinical Intelligence Dataset for Benchmarking Automatic Visit Note Generationcited by 118
  9. 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
  10. 2025TIMER: Temporal Instruction Modeling and Evaluation for Longitudinal Clinical Recordscited by 34
  11. 2022Summarizing Patients Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Modelscited by 30
  12. 2024Lived Experience Not Found: LLMs Struggle to Align with Experts on Addressing Adverse Drug Reactions from Psychiatric Medication Usecited by 17
8 more
  1. 2025Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Predictioncited by 12
  2. 2025Feel the Difference? A Comparative Analysis of Emotional Arcs in Real and LLM-Generated CBT Sessionscited by 11
  3. 2025A Large-Language Model Framework for Relative Timeline Extraction from PubMed Case Reportscited by 10
  4. 2025Linguistic Nepotism: Trading-off Quality for Language Preference in Multilingual RAGcited by 7
  5. 2025REGen: A Reliable Evaluation Framework for Generative Event Argument Extractioncited by 4
  6. 2025Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approachcited by 4
  7. 2026Text Knows What, Tables Know When: Clinical Timeline Reconstruction via Retrieval-Augmented Multimodal Alignmentcited by 2
  8. 2025ClinStructor: AI-Powered Structuring of Unstructured Clinical Textscited by 1

Built on by

Not cited yet.