mlsanityData to 14 Oct 2026

HEPA: A Self-Supervised Horizon-Conditioned Event Predictive Architecture for Time Series

arXiv 2605.11130 ↗First posted 11 May 2026cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Critical events in multivariate time series, from turbine failures to cardiac arrhythmias, demand accurate prediction, yet labeled data is scarce because such events are rare and costly to annotate. We introduce HEPA (Horizon-conditioned Event Predictive Architecture), built on two key principles. First, a causal Transformer encoder is pretrained via a Joint-Embedding Predictive Architecture (JEPA): a horizon-conditioned predictor learns to forecast future representations rather than future values, forcing the encoder to capture predictable temporal dynamics from unlabeled data alone. Second, we freeze the encoder and finetune only the predictor toward the target event, producing a monotonic survival cumulative distribution function (CDF) over horizons. With fixed architecture and optimiser hyperparameters across all benchmarks, HEPA handles water contamination, cyberattack detection, volatility regimes, and eight further event types across 11 domains, exceeding leading time-series architectures including PatchTST, iTransformer, MAE, and Chronos-2 on at least 10 of 14 benchmarks, with an order of magnitude fewer tuned parameters and, on lifecycle datasets, an order of magnitude less labeled data.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

27 of 40 references.

References · 27

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  4. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  5. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  6. 2024Chronos: Learning the Language of Time Seriescited by 759
  7. 2023A decoder-only foundation model for time-series forecastingcited by 692
  8. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  9. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  10. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  11. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  12. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 471
15 more
  1. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
  2. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  3. 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 224
  4. 2022TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Datacited by 214
  5. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
  6. 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 144
  7. 2023SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modelingcited by 115
  8. 2023DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detectioncited by 103
  9. 2021Towards a Rigorous Evaluation of Time-series Anomaly Detectioncited by 97
  10. 2018A Scalable Discrete-Time Survival Model for Neural Networkscited by 72
  11. 2023TimesURL: Self-supervised Contrastive Learning for Universal Time Series Representation Learningcited by 52
  12. 2025Joint Embeddings Go Temporalcited by 14
  13. 2026SC-JEPA: Stabilizing Latent Predictive Learning for Time-Series Anomaly Predictioncited by 4
  14. 2026FactoryNet: A Large-Scale Dataset toward Industrial Time-Series Foundation Modelscited by 3
  15. 2026FactoryBench: Evaluating Industrial Machine Understandingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.