mlsanityData to 7 Oct 2026

TimEE: End-to-end Time Series Classification via In-Context Learning

arXiv 2607.07500 ↗First posted 8 Jul 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Time series classification (TSC) is dominated by a two-stage paradigm: train a feature encoder -- either from scratch on the target dataset or via pretraining on large corpora -- and then fit a task-specific classifier on top. While effective, this decoupling optimizes representation learning independently of the classification objective, requires per-dataset training, and prevents the model from exploiting label information during inference. We introduce TimEE, a 4.5M-parameter foundation model for end-to-end TSC via in-context learning. Given a labeled support set and a query time series, TimEE directly outputs a predicted class distribution in a single forward pass with no per-dataset training required. Following the prior-data fitted network (PFN) framework, TimEE is meta-trained exclusively on synthetic TSC tasks, where each task contains time series with distinct class identities arising from structured distributional shifts in the generative process. Despite seeing no real time series during pre-training, TimEE ranks first in ROC AUC (and third on accuracy) on the UCR benchmark among all compared methods, which include both foundation models and supervised deep learning baselines. To our knowledge, TimEE is the first purely synthetic-pretrained model to reach state-of-the-art performance on the UCR benchmark. These results establish end-to-end ICL with synthetic priors as a compelling, largely unexplored direction for TSC, with scaling, prior design, and richer generation mechanisms as natural avenues for improvement. Code is publicly available at http://github.com/automl/timee.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

21 of 34 references.

References · 21

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  2. 2024Chronos: Learning the Language of Time Seriescited by 712
  3. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
  4. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  5. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 386
  6. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
  7. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
  8. 2020MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classificationcited by 186
  9. 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
  10. 2026TabICLv2: A better, faster, scalable, and open tabular foundation modelcited by 112
  11. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
  12. 2019catch22: CAnonical Time-series CHaracteristicscited by 103
9 more
  1. 2022HYDRA: Competing convolutional kernels for fast and accurate time series classificationcited by 53
  2. 2024aeon: a Python toolkit for learning from time seriescited by 46
  3. 2023The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learningcited by 27
  4. 2023NuTime: Numerically Multi-Scaled Embedding for Large-Scale Time-Series Pretrainingcited by 20
  5. 2026MantisV2: Closing the Zero-Shot Gap in Time Series Classification with Synthetic Data and Test-Time Strategiescited by 10
  6. 2025Pre-trained Forecasting Models: Strong Zero-Shot Feature Extractors for Time Series Classificationcited by 9
  7. 2025TiCT: A Synthetically Pre-Trained Foundation Model for Time Series Classificationcited by 3
  8. 2026Rethinking Zero-Shot Time Series Classification: From Task-specific Classifiers to In-Context Inferencecited by 3
  9. 2025Structural Classification of Locally Stationary Time Series Based on Second-order Characteristicscited by 2

Built on by

Not cited yet.