WindFM: An Open-Source Foundation Model for Zero-Shot Wind Power Forecasting
Not on the map. Why?
Abstract (arXiv)
High-quality wind power forecasting is crucial for the operation of modern power grids. However, prevailing data-driven paradigms either train a site-specific model which cannot generalize to other locations or rely on fine-tuning of general-purpose time series foundation models which are difficult to incorporate domain-specific data in the energy sector. This paper introduces WindFM, a lightweight and generative Foundation Model designed specifically for probabilistic wind power forecasting. WindFM employs a discretize-and-generate framework. A specialized time-series tokenizer first converts continuous multivariate observations into discrete, hierarchical tokens. Subsequently, a decoder-only Transformer learns a universal representation of wind generation dynamics by autoregressively pre-training on these token sequences. Using the comprehensive WIND Toolkit dataset comprising approximately 150 billion time steps from more than 126,000 sites, WindFM develops a foundational understanding of the complex interplay between atmospheric conditions and power output. Extensive experiments demonstrate that our compact 8.1M parameter model achieves state-of-the-art zero-shot performance on both deterministic and probabilistic tasks, outperforming specialized models and larger foundation models without any fine-tuning. In particular, WindFM exhibits strong adaptiveness under out-of-distribution data from a different continent, demonstrating the robustness and transferability of its learned representations. Our pre-trained model is publicly available at https://github.com/shiyu-coder/WindFM.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 40 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
21 of 40 references.
References · 21
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
9 more
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
- 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 112
- 2024Exploring the Capabilities and Limitations of Large Language Models in the Electric Energy Sectorcited by 30
- 2025Kronos: A Foundation Model for the Language of Financial Marketscited by 26
- 2022Continuous and Distribution-free Probabilistic Wind Power Forecasting: A Conditional Normalizing Flow Approachcited by 7
- 2025PriceFM: Foundation Model for Probabilistic Electricity Price Forecastingcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.