Discrete Prototypical Memories for Federated Time Series Foundation Models
Not on the map. Why?
Abstract (arXiv)
Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data. However, the semantic misalignment between time-series data and the text-centric latent space of existing LLMs often leads to degraded performance. Meanwhile, the parameter-sharing mechanism in existing FL methods model heterogeneous cross-domain time-series data into a unified continuous latent space, which contradicts the fact that time-series semantics frequently manifest as discrete and recurring regimes. To address these limitations, we propose textscFeDPM, a federated framework for time-series foundation models based on discrete prototypical memories. Specifically, we learn local prototypical memory priors for intra-domain time-series data. We then align cross-domain memories to promote a unified discrete latent space and introduce a domain-specific memory update mechanism to balance shared and personalized prototypical knowledge. Extensive experiments demonstrate the efficiency and effectiveness of textscFeDPM. The code is publicly available at https://anonymous.4open.science/r/FedUnit-64D1.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 61 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
44 of 61 references.
References · 44
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2017Neural Discrete Representation Learningcited by 4,650
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2015Fast R-CNNcited by 2,930
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
32 more
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2020Concept Bottleneck Modelscited by 1,022
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
- 2025Kimi-VL Technical Reportcited by 381
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
- 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
- 2023TimeGPT-1cited by 149
- 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 139
- 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
- 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
- 2022AirFormer: Predicting Nationwide Air Quality in China with Transformerscited by 73
- 2025Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecastingcited by 59
- 2024TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysiscited by 37
- 2024Scaling Law for Time Series Forecastingcited by 31
- 2024Towards Neural Scaling Laws for Time Series Foundation Modelscited by 30
- 2024Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecastingcited by 26
- 2023Federated Prompt Learning for Weather Foundation Models on Devicescited by 17
- 2024Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Modelscited by 15
- 2024Federated Adaptation for Foundation Model-based Recommendationscited by 14
- 2024Federated Foundation Models on Heterogeneous Time Seriescited by 13
- 2023Federated Recommendation with Additive Personalizationcited by 9
- 2024Personalized Federated Learning for Spatio-Temporal Forecasting: A Dual Semantic Alignment-Based Contrastive Approachcited by 8
- 2024A federated large language model for long-term time series forecastingcited by 4
- 2025Unveiling Uncertainty-Aware Autonomous Cooperative Learning Based Planning Strategycited by 1
- 2025Deep learning for pedestrians: backpropagation in Transformerscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.