mlsanityData to 14 Oct 2026

WindFM: An Open-Source Foundation Model for Zero-Shot Wind Power Forecasting

arXiv 2509.06311 ↗First posted 8 Sep 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

High-quality wind power forecasting is crucial for the operation of modern power grids. However, prevailing data-driven paradigms either train a site-specific model which cannot generalize to other locations or rely on fine-tuning of general-purpose time series foundation models which are difficult to incorporate domain-specific data in the energy sector. This paper introduces WindFM, a lightweight and generative Foundation Model designed specifically for probabilistic wind power forecasting. WindFM employs a discretize-and-generate framework. A specialized time-series tokenizer first converts continuous multivariate observations into discrete, hierarchical tokens. Subsequently, a decoder-only Transformer learns a universal representation of wind generation dynamics by autoregressively pre-training on these token sequences. Using the comprehensive WIND Toolkit dataset comprising approximately 150 billion time steps from more than 126,000 sites, WindFM develops a foundational understanding of the complex interplay between atmospheric conditions and power output. Extensive experiments demonstrate that our compact 8.1M parameter model achieves state-of-the-art zero-shot performance on both deterministic and probabilistic tasks, outperforming specialized models and larger foundation models without any fine-tuning. In particular, WindFM exhibits strong adaptiveness under out-of-distribution data from a different continent, demonstrating the robustness and transferability of its learned representations. Our pre-trained model is publicly available at https://github.com/shiyu-coder/WindFM.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 40 references that are in the map. First posted on arXiv 8 Sep 2025.

Builds on

21 of 40 references.

References · 21

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2019Root Mean Square Layer Normalizationcited by 1,480
  4. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  5. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  6. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  7. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  8. 2024Chronos: Learning the Language of Time Seriescited by 759
  9. 2023A decoder-only foundation model for time-series forecastingcited by 692
  10. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  11. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  12. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
9 more
  1. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  2. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  3. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  4. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
  5. 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 112
  6. 2024Exploring the Capabilities and Limitations of Large Language Models in the Electric Energy Sectorcited by 30
  7. 2025Kronos: A Foundation Model for the Language of Financial Marketscited by 26
  8. 2022Continuous and Distribution-free Probabilistic Wind Power Forecasting: A Conditional Normalizing Flow Approachcited by 7
  9. 2025PriceFM: Foundation Model for Probabilistic Electricity Price Forecastingcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.