mlsanityData to 7 Oct 2026

Discrete Prototypical Memories for Federated Time Series Foundation Models

arXiv 2604.04475 ↗First posted 6 Apr 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data. However, the semantic misalignment between time-series data and the text-centric latent space of existing LLMs often leads to degraded performance. Meanwhile, the parameter-sharing mechanism in existing FL methods model heterogeneous cross-domain time-series data into a unified continuous latent space, which contradicts the fact that time-series semantics frequently manifest as discrete and recurring regimes. To address these limitations, we propose textscFeDPM, a federated framework for time-series foundation models based on discrete prototypical memories. Specifically, we learn local prototypical memory priors for intra-domain time-series data. We then align cross-domain memories to promote a unified discrete latent space and introduce a domain-specific memory update mechanism to balance shared and personalized prototypical knowledge. Extensive experiments demonstrate the efficiency and effectiveness of textscFeDPM. The code is publicly available at https://anonymous.4open.science/r/FedUnit-64D1.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 61 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

44 of 61 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  6. 2020Scaling Laws for Neural Language Modelscited by 6,411
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  10. 2015Fast R-CNNcited by 2,930
  11. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  12. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
32 more
  1. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  2. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  3. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  4. 2020Concept Bottleneck Modelscited by 1,022
  5. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  6. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  7. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  8. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  9. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  10. 2025Kimi-VL Technical Reportcited by 381
  11. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
  12. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
  13. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
  14. 2023TimeGPT-1cited by 149
  15. 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 139
  16. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
  17. 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
  18. 2022AirFormer: Predicting Nationwide Air Quality in China with Transformerscited by 73
  19. 2025Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecastingcited by 59
  20. 2024TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysiscited by 37
  21. 2024Scaling Law for Time Series Forecastingcited by 31
  22. 2024Towards Neural Scaling Laws for Time Series Foundation Modelscited by 30
  23. 2024Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecastingcited by 26
  24. 2023Federated Prompt Learning for Weather Foundation Models on Devicescited by 17
  25. 2024Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Modelscited by 15
  26. 2024Federated Adaptation for Foundation Model-based Recommendationscited by 14
  27. 2024Federated Foundation Models on Heterogeneous Time Seriescited by 13
  28. 2023Federated Recommendation with Additive Personalizationcited by 9
  29. 2024Personalized Federated Learning for Spatio-Temporal Forecasting: A Dual Semantic Alignment-Based Contrastive Approachcited by 8
  30. 2024A federated large language model for long-term time series forecastingcited by 4
  31. 2025Unveiling Uncertainty-Aware Autonomous Cooperative Learning Based Planning Strategycited by 1
  32. 2025Deep learning for pedestrians: backpropagation in Transformerscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.