mlsanityData to 14 Oct 2026

Trio: Learning Time-Series Forecasting with Temporal-Spatial-Sample Attention and Structural Causal Priors

arXiv 2606.07291 ↗First posted 5 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multivariate time-series forecasting requires models to reason over temporal dynamics, cross-variable dependencies, and historical input-output correspondences. Recent Prior-Data Fitted Networks (PFNs) suggest that synthetic tasks can be useful for learning transferable inference behavior. However, directly transferring this paradigm to time-series forecasting remains difficult, since temporal order, dynamic lags, and recurring historical patterns are not naturally captured by ordinary tabular priors. Motivated by this observation, we propose Trio, a sample-aware time-series forecasting architecture based on Temporal-Spatial-Sample attention. Temporal attention captures within-window dynamics, spatial attention models inter-variable dependencies, and sample attention retrieves relevant historical lookback-future pairs to guide the current prediction. Rather than claiming a fully general PFN-style forecaster, our goal is to study how historical input-output examples can be explicitly organized and reused within a forecasting model. We further introduce a Time-Series Structural Causal Model (TS-SCM) generator to create structured synthetic forecasting tasks with dynamic lags, cross-variable interactions, noise, feedback, and distributional drift. Experiments on synthetic, industrial, and public benchmarks show that the proposed architecture improves forecasting performance. Exploratory zero-shot experiments further suggest that TS-SCM-generated tasks may provide useful structural priors, while fully general PFN-style time-series forecasting remains an open problem.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 29 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

11 of 29 references.

References · 11

  1. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  2. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
  3. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 120
  4. 2025TimeFilter: Patch-Specific Spatial-Temporal Graph Filtration for Time Series Forecastingcited by 64
  5. 2025From Tables to Time: Extending TabPFN-v2 to Time Series Forecastingcited by 60
  6. 2024Retrieval Augmented Time Series Forecastingcited by 46
  7. 2024In-context Time Series Predictorcited by 23
  8. 2024KAN-AD: Time Series Anomaly Detection with Kolmogorov-Arnold Networkscited by 23
  9. 2026TabPFN-3: Technical Reportcited by 17
  10. 2025CausalDynamics: A large-scale benchmark for structural discovery of dynamical causal modelscited by 8
  11. 2026Enhancing Multivariate Time Series Forecasting with Global Temporal Retrievalcited by 5

Built on by

Not cited yet.