mlsanityData to 7 Oct 2026

FlatASCEND: Autoregressive Clinical Sequence Generation with Continuous Time Prediction and Association-Based Pharmacological Testing

arXiv 2605.04071 ↗First posted 13 Apr 2026cs.LG cs.AI q-bio.QMcited by 0

Not on the map. Why?

Abstract (arXiv)

Autoregressive models can predict clinical events, but generating patient-conditioned multi-step trajectories that respond to intervention tokens and testing whether those responses preserve known pharmacological associations has received limited attention. We present FlatASCEND, a 14.5M-parameter autoregressive clinical sequence model using flat composite tokens and a zero-inflated log-normal time head. Standard distributional metrics (Jaccard 0.889-0.954) do not distinguish FlatASCEND from trivial baselines; the model's value lies in conditional generation from patient-specific prefixes. A prompt-shuffle ablation shows patient-specific conditioning amplifies mechanistic pharmacological effects (2.0-2.2x for steroid to glucose, diuretic to potassium) while leaving confounding-driven associations unchanged (0.9x for insulin to glucose). An incident-user framework assesses directional consistency against prior pharmacological knowledge on MIMIC-IV (N=500 per comparison): 4/10 recover correct mechanistic directions, 2 reproduce treatment-context associations, 4 are incorrect (9/10 significant, Wilcoxon p<0.05). This pattern - partial recovery under residual confounding - is consistent with learned observational associations without causal distinction. Direct preference optimisation with surrogate reward destroys all correct associations (3/3 to 0/3), illustrating reward exploitation when reward and evaluation share an outcome domain. Generative evidence is strongest for short-horizon ICU data; outpatient temporal fidelity is weaker (median 10 vs 154 days on INSPECT), and zero-shot cross-site transfer degrades without adaptation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 20 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

7 of 20 references.

References · 7

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,085
  3. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
  4. 2019BEHRT: Transformer for Electronic Health Recordscited by 258
  5. 2023MOTOR: A Time-To-Event Foundation Model For Structured Medical Recordscited by 75
  6. 2025Building the EHR Foundation Model via Next Event Predictioncited by 5
  7. 2026Scaling Recurrence-aware Foundation Models for Clinical Records via Next-Visit Predictioncited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Interventional Flow Matching: Prospective Dose-Response Forecasting with Velocity-Field Jacobian Regularization
  2. 2026KMGen: A Skill-based Approach for Synthetic Individual Patient Data Generation
  3. 2026Learning Continuous Patient Trajectories from Electronic Health Records
  4. 2026From Static Risk to Dynamic Trajectories: Toward World-Model-Inspired Clinical Prediction
  5. 2026Simulating clinical interventions with a generative multimodal model of human physiology
  6. 2026Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Models
  7. 2026Represent, Then Generate: Multimodal-Conditioned Time-Series Generation under Irregular Missingness
  8. 2026ChronoMedicalWorld: A Medical World Model for Learning Patient Trajectories from Longitudinal Care Data