FlowTSFM: Turning Encoder Depth into Quantile Transport
Not on the map. Why?
Abstract (arXiv)
Encoder-based time series foundation models (TSFMs) typically rely on deep stacks of independently parameterized Transformer layers, where only the final forecast is supervised and intermediate representations have no explicit predictive role. We introduce FlowTSFM, an encoder architecture that interprets depth as a recurrent transport process: a single Transformer block is iteratively applied with shared parameters, while a quantile-flow objective supervises intermediate states along a prescribed trajectory from a prior distribution toward the final forecast. The objective combines pinball forecasting loss with path-level position matching. With only 38.8M parameters, FlowTSFM achieves competitive performance on GIFT-Eval and TIME, remaining within 1.8-4.6% MASE of stronger baselines while using approximately 3× fewer parameters than a 12-layer Chronos-2 model (119.5M). Beyond accuracy, we introduce CosMean, a scale-free diagnostic measuring whether recurrent updates consistently align toward the final prediction. Under a matched intermediate-state probing protocol, FlowTSFM achieves a CosMean score of 0.919 compared with 0.350 for Chronos-2, suggesting that recurrent parameter sharing combined with path supervision is associated with substantially more structured predictive trajectories at a favorable accuracy-efficiency trade-off.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 25 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
21 of 25 references.
References · 21
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 273
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
- 2025Chronos-2: From Univariate to Universal Forecastingcited by 194
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
9 more
- 2025Moirai 2.0: When Less Is More for Time Series Forecastingcited by 69
- 2019GluonTS: Probabilistic Time Series Models in Pythoncited by 46
- 2026It's TIME: Towards the Next Generation of Time Series Forecasting Benchmarkscited by 33
- 2026One-Step Generative Modeling via Wasserstein Gradient Flowscited by 24
- 2023A Comprehensive Survey of Deep Transfer Learning for Anomaly Detection in Industrial Time Series: Methods, Applications, and Directionscited by 22
- 2026TiRex-2: Generalizing TiRex to Multivariate Data and Streamingcited by 13
- 2026Revisiting the Generic Transformer: Deconstructing a Strong Baseline for Time Series Foundation Modelscited by 12
- 2023How Does It Function? Characterizing Long-term Trends in Production Serverless Workloadscited by 10
- 2026Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Modelscited by 3
Built on by
Not cited yet.