EIDOS: Latent-Space Predictive Learning for Time Series Foundation Models
Not on the map. Why?
Abstract (arXiv)
Most time series foundation models are pretrained by directly predicting future observations, which often yields weakly structured latent representations that capture surface noise rather than coherent and predictable temporal dynamics. In this work, we introduce EIDOS, a foundation model family that shifts pretraining from future value prediction to latent-space predictive learning. We train a causal Transformer to predict the evolution of latent representations, encouraging the emergence of structured and temporally coherent latent states. To ensure stable targets for latent-space learning, we design a lightweight aggregation branch to construct target representations. EIDOS is optimized via a joint objective that integrates latent-space alignment, observational grounding to anchor representations to the input signal, and direct forecasting supervision. On the GIFT-Eval benchmark, EIDOS mitigates structural fragmentation in the representation space and achieves state-of-the-art performance. These results demonstrate that constraining models to learn predictable latent dynamics is a principled step toward more robust and reliable time series foundation models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 45 references that are in the map. First posted on arXiv 15 Feb 2026.
Builds on
38 of 45 references.
References · 38
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023A decoder-only foundation model for time-series forecastingcited by 650
26 more
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2022Efficiently Scaling Transformer Inferencecited by 529
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 168
- 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
- 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
- 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
- 2025Moirai 2.0: When Less Is More for Time Series Forecastingcited by 59
- 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 52
- 2025LLM-JEPA: Large Language Models Meet Joint Embedding Predictive Architecturescited by 35
- 2024Towards Neural Scaling Laws for Time Series Foundation Modelscited by 30
- 2025Output Scaling: YingLong-Delayed Chain of Thought in a Large Pretrained Time Series Forecasting Modelcited by 21
- 2025Next-Embedding Prediction Makes Strong Vision Learnerscited by 21
- 2025Comprehensive Review of Neural Differential Equations for Time Series Analysiscited by 20
- 2024Exploring Representations and Interventions in Time Series Foundation Modelscited by 19
- 2025TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecastingcited by 16
- 2025VisionTS++: Cross-Modal Time Series Foundation Model with Continual Pre-trained Vision Backbonescited by 11
- 2025Joint Embeddings Go Temporalcited by 8
- 2024LaT-PFN: A Joint Embedding Predictive Architecture for In-context Time-series Forecastingcited by 6
- 2024UniCL: A Universal Contrastive Learning Framework for Large Time Series Modelscited by 5
- 2022Understanding Sinusoidal Neural Networkscited by 4
- 2025JEPA as a Neural Tokenizer: Learning Robust Speech Representations with Density Adaptive Attentioncited by 3
Built on by
Not cited yet.