Spectral-Aware Text-to-Time Series Generation with Billion-Scale Multimodal Meteorological Data
Not on the map. Why?
Abstract (arXiv)
Text-to-time-series generation is particularly important in meteorology, where natural language offers intuitive control over complex, multi-scale atmospheric dynamics. Existing approaches are constrained by the lack of large-scale, physically grounded multimodal datasets and by architectures that overlook the spectral-temporal structure of weather signals. We address these challenges with a unified framework for text-guided meteorological time-series generation. First, we introduce MeteoCap-3B, a billion-scale weather dataset paired with expert-level captions constructed via a Multi-agent Collaborative Captioning (MACC) pipeline, yielding information-dense and physically consistent annotations. Building on this dataset, we propose MTransformer, a diffusion-based model that enables precise semantic control by mapping textual descriptions into multi-band spectral priors through a Spectral Prompt Generator, which guides generation via frequency-aware attention. Extensive experiments on real-world benchmarks demonstrate state-of-the-art generation quality, accurate cross-modal alignment, strong semantic controllability, and substantial gains in downstream forecasting under data-sparse and zero-shot settings. Additional results on general time-series benchmarks indicate that the proposed framework generalizes beyond meteorology.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 36 references that are in the map. First posted on arXiv 28 Mar 2026.
Builds on
32 of 36 references.
References · 32
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2017Neural Discrete Representation Learningcited by 4,712
- 2024GPT-4o System Cardcited by 4,588
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 324
- 2022A Survey on Generative Diffusion Modelcited by 240
20 more
- 2024Diffusion-TS: Interpretable Diffusion for General Time Series Generationcited by 184
- 2021TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generationcited by 142
- 2021Time Series Prediction using Deep Learning Methods in Healthcarecited by 74
- 2024Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysiscited by 74
- 2023Diffusion Models for Time Series Applications: A Surveycited by 72
- 2024Towards Lifelong Learning of Large Language Models: A Surveycited by 64
- 2024FilterNet: Harnessing Frequency Filters for Time Series Forecastingcited by 47
- 2023Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Datacited by 40
- 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Modelscited by 40
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 34
- 2022Uncertainty-DTW for Time Series and Sequencescited by 21
- 2025T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Modelscited by 20
- 2025BRIDGE: Bootstrapping Text to Control Time-Series Generation via Multi-Agent Iterative Optimization and Diffusion Modelingcited by 19
- 2025Time-IMM: A Dataset and Benchmark for Irregular Multimodal Multivariate Time Seriescited by 19
- 2023Federated Prompt Learning for Weather Foundation Models on Devicescited by 17
- 2024Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Modelscited by 15
- 2024AudioEditor: A Training-Free Diffusion-Based Audio Editing Frameworkcited by 13
- 2024Federated Foundation Models on Heterogeneous Time Seriescited by 13
- 2023TempEE: Temporal-Spatial Parallel Transformer for Radar Echo Extrapolation Beyond Auto-Regressioncited by 12
- 2025FeDaL: Federated Dataset Learning for General Time Series Foundation Modelscited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.