A Foundation Model for Instruction-Conditioned In-Context Time Series Tasks
Not on the map. Why?
Abstract (arXiv)
In-context learning (ICL) enables task adaptation at inference time by conditioning on demonstrations rather than updating model parameters. Although recent time-series foundation models incorporate contextual conditioning, retrieval, or example-based prompting, they typically rely on implicit positional structure or task-specific objectives rather than explicit instruction-conditioned input-output demonstrations. We introduce iAmTime, a time-series foundation model trained with instruction-conditioned amortized meta-learning to infer tasks directly from example demonstrations. iAmTime represents each episode as a structured prompt over historical context and future-known variables using specialized semantic tokens that attend to designated time-series regions, exchange information across demonstrations, and inject task information into the query representation. The model combines a Hierarchical Multi-Scope Transformer Encoder, which captures temporal and covariate dynamics while inferring latent task structure from demonstrated input-output mappings, with a Task-Conditioned Patch Decoder, which adapts decoding through expert-based routing. We train iAmTime on large-scale real and synthetic corpora using supervised and self-supervised instruction-conditioned tasks, including forecasting, imputation, reconstruction, classification, anomaly detection, and source de-mixing. Across diverse domains, frequencies, and horizons, iAmTime improves zero-shot adaptation over strong time-series foundation baselines on probabilistic and point forecasting benchmarks, while achieving competitive or superior performance on four non-forecasting tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 62 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
42 of 62 references.
References · 42
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
30 more
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2018The UCR Time Series Archivecited by 421
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
- 2021Surface Form Competition: Why the Highest Probability Answer Isn't Always Rightcited by 256
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
- 2020MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classificationcited by 186
- 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
- 2022Transformer Language Models without Positional Encodings Still Learn Positional Informationcited by 148
- 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
- 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
- 2020When Do Curricula Work?cited by 105
- 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
- 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 52
- 2024In-Context Fine-Tuning for Time-Series Foundation Modelscited by 31
- 2024In-context Time Series Predictorcited by 21
- 2020Deep learning for time series classificationcited by 14
- 2022Seeded Hierarchical Clustering for Expert-Crafted Taxonomiescited by 1
- 2024A Comprehensive Forecasting Framework based on Multi-Stage Hierarchical Forecasting Reconciliation and Adjustmentcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.