mlsanityData to 7 Oct 2026

BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Models

arXiv 2505.17871 ↗First posted 23 May 2025cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

The advent of universal time series forecasting models has revolutionized zero-shot forecasting across diverse domains, yet the critical role of data diversity in training these models remains underexplored. Existing large-scale time series datasets often suffer from inherent biases and imbalanced distributions, leading to suboptimal model performance and generalization. To address this gap, we introduce BLAST, a novel pre-training corpus designed to enhance data diversity through a balanced sampling strategy. First, BLAST incorporates 321 billion observations from publicly available datasets and employs a comprehensive suite of statistical metrics to characterize time series patterns. Then, to facilitate pattern-oriented sampling, the data is implicitly clustered using grid-based partitioning. Furthermore, by integrating grid sampling and grid mixup techniques, BLAST ensures a balanced and representative coverage of diverse patterns. Experimental results demonstrate that models pre-trained on BLAST achieve state-of-the-art performance with a fraction of the computational resources and training tokens required by existing methods. Our findings highlight the pivotal role of data diversity in improving both training efficiency and model performance for the universal forecasting task.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

21 of 44 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  7. 2024Chronos: Learning the Language of Time Seriescited by 712
  8. 2023A decoder-only foundation model for time-series forecastingcited by 650
  9. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  10. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
  11. 2021Monash Time Series Forecasting Archivecited by 256
  12. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
9 more
  1. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
  2. 2024TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignmentcited by 97
  3. 2024ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Datacited by 92
  4. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 88
  5. 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
  6. 2024Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfercited by 31
  7. 2024Balanced Data Sampling for Language Model Training with Clusteringcited by 22
  8. 2025Efficient Multivariate Time Series Forecasting via Calibrated Language Models with Privileged Knowledge Distillationcited by 20
  9. 2024Parsimony or Capability? Decomposition Delivers Both in Long-term Time Series Forecastingcited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 8.

16 papers.

Sort:

  1. 2025TimeMosaic: Temporal Heterogeneity Guided Time Series Forecasting via Adaptive Granularity Patch and Segment-wise Decodingcited by 12
  2. 2026Distilling Time Series Foundation Models for Efficient Forecastingcited by 11
  3. 2025ARROW: An Adaptive Rollout and Routing Method for Global Weather Forecastingcited by 8
  4. 2025Selective Learning for Deep Time Series Forecastingcited by 8
  5. 2026TimeRFT: Stimulating Generalizable Time Series Forecasting for TSFMs via Reinforcement Finetuningcited by 3
  6. 2026Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Modelscited by 2
  7. 2026CPiRi: Channel Permutation-Invariant Relational Interaction for Multivariate Time Series Forecastingcited by 2
  8. 2026Zeus: Towards Tuning-Free Foundation Model for Time Series Analysiscited by 2
  9. 2025ARIES: Relation Assessment and Model Recommendation for Deep Time Series Forecastingcited by 1
  10. 2026Tabby: An Open Pretraining Recipe for Time Series Foundation Modelscited by 1
  11. 2025Integrating Time Series into LLMs via Multi-layer Steerable Embedding Fusion for Enhanced Forecastingcited by 0
  12. 2025KAIROS: Unified Training for Universal Non-Autoregressive Time Series Forecastingcited by 0
4 more
  1. 2025Invariant Representation Learning for Source-Free Time Series Forecasting with LLM-Centric Proxy Denoisingcited by 0
  2. 2025APT: Affine Prototype-Timestamp For Time Series Forecasting Under Distribution Shiftcited by 0
  3. 2026Learning from Complexity: Exploring Dynamic Sample Pruning of Spatio-Temporal Trainingcited by 0
  4. 2026QUALS: Corpus Equilibrium for Universal Forecasting via Pattern Quantization and Learnability Synchronizationcited by 0