FM-LLM: A frequency-enhanced mixture-of-experts framework for adapting LLMs to time series forecasting
On the map: Mixture-of-experts → MoE for time series and graphs
Abstract (arXiv)
Recent advances in Large Language Models (LLMs) have spurred cross-modal solutions for time-series forecasting. However, existing methods rely heavily on textual prompts for modality alignment-introducing nontrivial computational overhead and failing to leverage the rich spectral dynamics inherent in time-series data. To enable prompt-free, frequency-aware adaptation of frozen LLMs, we propose FM-LLM (Frequency-Enhanced Mixture-of-Experts for adapting LLMs to Time Series Forecasting), an autoregressive framework grounded in constrained asymmetric coupling. A Fourier Analysis Network (FAN)-based spectral token aligner injects structured harmonic representations directly into the frozen LLM with numerical compatibility. An asymmetric Mixture-of-Experts (MoE) decoder enforces role separation: shared experts with lightweight FAN layers reconstruct the global periodic backbone, while routed experts-restricted to standard FFNs-specialize in modeling non-periodic residual dynamics. A time-frequency hybrid loss function jointly optimizes temporal accuracy and spectral consistency, mitigating error accumulation during long-horizon autoregressive rollouts. Evaluated across eleven public benchmarks, FM-LLM achieves state-of-the-art performance on 59 out of 78 evaluation metrics. Compared to the strongest autoregressive LLM-based baseline, it delivers average improvements of 5.3% in MSE and 5.6% in MAE, with maximum gains reaching 8.0% for MSE and 8.4% for MAE. FM-LLM also demonstrates robust transferability, maintaining superior performance in 10% few-shot and zero-shot forecasting scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 5 of its 51 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
5 of 51 references.
References · 5
- 2024Mixtral of Expertscited by 1,823
- 2020Reformer: The Efficient Transformercited by 1,668
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2024FAN: Fourier Analysis Networkscited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MoFE-Time: Mixture of Frequency Domain Experts for Time-Series Forecasting Models
- 2025Small but Mighty: Enhancing Time Series Forecasting with Lightweight LLMs
- 2025Adapting LLMs to Time Series Forecasting via Temporal Heterogeneity Modeling and Representation Alignment
- 2026Rethinking the Role of LLMs in Time Series Forecasting
- 2025Enhancing LLMs for Time Series Forecasting via Structure-Guided Cross-Modal Alignment
- 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Models
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Models
- 2026LLM Pretraining Shapes a Generalizable Manifold: Insights into Cross-Modal Transfer to Time Series