mlsanityData to 7 Oct 2026

A Foundation Model for Instruction-Conditioned In-Context Time Series Tasks

arXiv 2603.22586 ↗First posted 23 Mar 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

In-context learning (ICL) enables task adaptation at inference time by conditioning on demonstrations rather than updating model parameters. Although recent time-series foundation models incorporate contextual conditioning, retrieval, or example-based prompting, they typically rely on implicit positional structure or task-specific objectives rather than explicit instruction-conditioned input-output demonstrations. We introduce iAmTime, a time-series foundation model trained with instruction-conditioned amortized meta-learning to infer tasks directly from example demonstrations. iAmTime represents each episode as a structured prompt over historical context and future-known variables using specialized semantic tokens that attend to designated time-series regions, exchange information across demonstrations, and inject task information into the query representation. The model combines a Hierarchical Multi-Scope Transformer Encoder, which captures temporal and covariate dynamics while inferring latent task structure from demonstrated input-output mappings, with a Task-Conditioned Patch Decoder, which adapts decoding through expert-based routing. We train iAmTime on large-scale real and synthetic corpora using supervised and self-supervised instruction-conditioned tasks, including forecasting, imputation, reconstruction, classification, anomaly detection, and source de-mixing. Across diverse domains, frequencies, and horizons, iAmTime improves zero-shot adaptation over strong time-series foundation baselines on probabilistic and point forecasting benchmarks, while achieving competitive or superior performance on four non-forecasting tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 62 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

42 of 62 references.

References · 42

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  10. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  11. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  12. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
30 more
  1. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  2. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  3. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
  4. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  5. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  6. 2024Chronos: Learning the Language of Time Seriescited by 712
  7. 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
  8. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  9. 2023A decoder-only foundation model for time-series forecastingcited by 650
  10. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  11. 2021MetaICL: Learning to Learn In Contextcited by 450
  12. 2018The UCR Time Series Archivecited by 421
  13. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
  14. 2018The UEA multivariate time series classification archive, 2018cited by 330
  15. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
  16. 2021Surface Form Competition: Why the Highest Probability Answer Isn't Always Rightcited by 256
  17. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
  18. 2020MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classificationcited by 186
  19. 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
  20. 2022Transformer Language Models without Positional Encodings Still Learn Positional Informationcited by 148
  21. 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
  22. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
  23. 2020When Do Curricula Work?cited by 105
  24. 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
  25. 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 52
  26. 2024In-Context Fine-Tuning for Time-Series Foundation Modelscited by 31
  27. 2024In-context Time Series Predictorcited by 21
  28. 2020Deep learning for time series classificationcited by 14
  29. 2022Seeded Hierarchical Clustering for Expert-Crafted Taxonomiescited by 1
  30. 2024A Comprehensive Forecasting Framework based on Multi-Stage Hierarchical Forecasting Reconciliation and Adjustmentcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.