# INTERVenE: Temporal-Abstraction-Interval Based Transformers for Short-Horizon Medical Event Prediction

arXiv: https://arxiv.org/abs/2608.29901 · HTML: https://mlsanity.com/paper/2608.29901/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 4 of its 11 references that are in the map.
- First posted on arXiv 30 Aug 2026.

## Builds on (most cited first, 4 of 4)

- [Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoders](https://mlsanity.com/paper/2407.14435/) (2024)
- [BEHRT: Transformer for Electronic Health Records](https://mlsanity.com/paper/1907.09538/) (2019)
- [Time2Vec: Learning a Vector Representation of Time](https://mlsanity.com/paper/1907.05321/) (2019)
- [Self-Supervised Transformer for Sparse and Irregularly Sampled Multivariate Clinical Time-Series](https://mlsanity.com/paper/2107.14293/) (2021)

## Abstract (arXiv)

Electronic Health Record (EHR) prediction models in the intensive care unit must learn from sparse and irregular measurements while preserving the clinical meaning of time and supporting transparent decision-making. We present INTERVenE, a family of Transformer architectures whose input is an interval-based, knowledge-based temporal abstraction (KBTA), a token stream of named clinical concepts (states, trends, events, contexts) drawn from a curated medical ontology, rather than an unnamed bin index or a raw measurement triplet. This naming layer is what we ask KBTA to do: it makes the model's per-token attributions resolve to clinical concepts by construction. INTERVenE offers two complementary variants: an auto-regressive decoder that generates future abstraction trajectories with a per-step risk readout (localizing when and after which events risk rises), and a bidirectional encoder for single-pass joint risk and time-to-event prediction. On 57,078 MIMIC-IV admissions, INTERVenE-Enc outperformed GRU-D, STraTS, and KarmaLego, reaching a support-weighted AUPRC of 0.672 (+0.046 over the strongest neural baseline, with non-overlapping 95% bootstrap CIs), AUROC of 0.901, and length-of-stay MAE of 44.4,h. INTERVenE-Ar complements these predictions with generated abstraction trajectories and evolving risk scores, achieving AUROC of 0.854 and AUPRC of 0.588 under the harder generative readout. An alternative-discretization ablation preserved predictive performance, supporting KBTA's role as a clinically named attribution substrate rather than a prerequisite for accuracy.