mlsanityData to 14 Oct 2026

Tackling Data Heterogeneity in Federated Time Series Forecasting

arXiv 2411.15716 ↗First posted 24 Nov 2024cs.LG cs.CR cs.IRcited by 3

Not on the map. Why?

Abstract (arXiv)

Time series forecasting plays a critical role in various real-world applications, including energy consumption prediction, disease transmission monitoring, and weather forecasting. Although substantial progress has been made in time series forecasting, most existing methods rely on a centralized training paradigm, where large amounts of data are collected from distributed devices (e.g., sensors, wearables) to a central cloud server. However, this paradigm has overloaded communication networks and raised privacy concerns. Federated learning, a popular privacy-preserving technique, enables collaborative model training across distributed data sources. However, directly applying federated learning to time series forecasting often yields suboptimal results, as time series data generated by different devices are inherently heterogeneous. In this paper, we propose a novel framework, Fed-TREND, to address data heterogeneity by generating informative synthetic data as auxiliary knowledge carriers. Specifically, Fed-TREND generates two types of synthetic data. The first type of synthetic data captures the representative distribution information from clients' uploaded model updates and enhances clients' local training consensus. The second kind of synthetic data extracts long-term influence insights from global model update trajectories and is used to refine the global model after aggregation. Fed-TREND is compatible with most time series forecasting models and can be seamlessly integrated into existing federated learning frameworks to improve prediction performance. Extensive experiments on eight datasets, using several federated learning baselines and four popular time series forecasting models, demonstrate the effectiveness and generalizability of Fed-TREND.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 52 of its 76 references that are in the map. First posted on arXiv 24 Nov 2024.

Builds on

52 of 76 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  7. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  8. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  9. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  10. 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 682
  11. 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
  12. 2021Federated Learning Based on Dynamic Regularizationcited by 562
38 more
  1. 2021Exploiting Shared Representations for Personalized Federated Learningcited by 541
  2. 2020Dataset Condensation with Gradient Matchingcited by 516
  3. 2015An Introduction to Convolutional Neural Networkscited by 514
  4. 2022Transformers in Time Series: A Surveycited by 497
  5. 2022Dataset Distillation by Matching Training Trajectoriescited by 442
  6. 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 420
  7. 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 287
  8. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  9. 2020FedBE: Making Bayesian Model Ensemble Applicable to Federated Learningcited by 176
  10. 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 161
  11. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
  12. 2022Minimizing the Accumulated Trajectory Error to Improve Dataset Distillationcited by 142
  13. 2023Dataset Distillation: A Comprehensive Reviewcited by 127
  14. 2018Temporal Pattern Attention for Multivariate Time Series Forecastingcited by 125
  15. 2020Deep Learning for Time Series Forecasting: Tutorial and Literature Surveycited by 117
  16. 2020Distilled One-Shot Federated Learningcited by 109
  17. 2021FedMix: Approximation of Mixup under Mean Augmented Federated Learningcited by 108
  18. 2021DENSE: Data-Free One-Shot Federated Learningcited by 100
  19. 2022Multivariate Time Series Forecasting with Dynamic Graph Neural ODEscited by 72
  20. 2022FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learningcited by 66
  21. 2020Federated Learning via Synthetic Datacited by 54
  22. 2023A Survey on Time-Series Pre-Trained Modelscited by 52
  23. 2022Federated Unlearning for On-Device Recommendationcited by 43
  24. 2023Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Datacited by 40
  25. 2024An Aggregation-Free Federated Learning for Tackling Data Heterogeneitycited by 33
  26. 2022FedSynth: Gradient Compression via Synthetic Data in Federated Learningcited by 31
  27. 2024Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversitycited by 30
  28. 2022Dataset Distillation Using Parameter Pruningcited by 27
  29. 2024Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boostingcited by 27
  30. 2022Meta Knowledge Condensation for Federated Learningcited by 26
  31. 2024Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecastingcited by 26
  32. 2024Graph Condensation: A Surveycited by 23
  33. 2020Overcoming Data Sparsity in Group Recommendationcited by 22
  34. 2022DYNAFED: Tackling Client Data Heterogeneity with Global Dynamicscited by 22
  35. 2021A Multi-view Multi-task Learning Framework for Multi-variate Time Series Forecastingcited by 21
  36. 2022Comprehensive Privacy Analysis on Federated Recommender System against Attribute Inference Attackscited by 21
  37. 2023HeteFedRec: Federated Recommender Systems with Model Heterogeneitycited by 20
  38. 2023Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distributioncited by 15

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.