Tackling Data Heterogeneity in Federated Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Time series forecasting plays a critical role in various real-world applications, including energy consumption prediction, disease transmission monitoring, and weather forecasting. Although substantial progress has been made in time series forecasting, most existing methods rely on a centralized training paradigm, where large amounts of data are collected from distributed devices (e.g., sensors, wearables) to a central cloud server. However, this paradigm has overloaded communication networks and raised privacy concerns. Federated learning, a popular privacy-preserving technique, enables collaborative model training across distributed data sources. However, directly applying federated learning to time series forecasting often yields suboptimal results, as time series data generated by different devices are inherently heterogeneous. In this paper, we propose a novel framework, Fed-TREND, to address data heterogeneity by generating informative synthetic data as auxiliary knowledge carriers. Specifically, Fed-TREND generates two types of synthetic data. The first type of synthetic data captures the representative distribution information from clients' uploaded model updates and enhances clients' local training consensus. The second kind of synthetic data extracts long-term influence insights from global model update trajectories and is used to refine the global model after aggregation. Fed-TREND is compatible with most time series forecasting models and can be seamlessly integrated into existing federated learning frameworks to improve prediction performance. Extensive experiments on eight datasets, using several federated learning baselines and four popular time series forecasting models, demonstrate the effectiveness and generalizability of Fed-TREND.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 52 of its 76 references that are in the map. First posted on arXiv 24 Nov 2024.
Builds on
52 of 76 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 682
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
- 2021Federated Learning Based on Dynamic Regularizationcited by 562
38 more
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 541
- 2020Dataset Condensation with Gradient Matchingcited by 516
- 2015An Introduction to Convolutional Neural Networkscited by 514
- 2022Transformers in Time Series: A Surveycited by 497
- 2022Dataset Distillation by Matching Training Trajectoriescited by 442
- 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 420
- 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 287
- 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
- 2020FedBE: Making Bayesian Model Ensemble Applicable to Federated Learningcited by 176
- 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 161
- 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
- 2022Minimizing the Accumulated Trajectory Error to Improve Dataset Distillationcited by 142
- 2023Dataset Distillation: A Comprehensive Reviewcited by 127
- 2018Temporal Pattern Attention for Multivariate Time Series Forecastingcited by 125
- 2020Deep Learning for Time Series Forecasting: Tutorial and Literature Surveycited by 117
- 2020Distilled One-Shot Federated Learningcited by 109
- 2021FedMix: Approximation of Mixup under Mean Augmented Federated Learningcited by 108
- 2021DENSE: Data-Free One-Shot Federated Learningcited by 100
- 2022Multivariate Time Series Forecasting with Dynamic Graph Neural ODEscited by 72
- 2022FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learningcited by 66
- 2020Federated Learning via Synthetic Datacited by 54
- 2023A Survey on Time-Series Pre-Trained Modelscited by 52
- 2022Federated Unlearning for On-Device Recommendationcited by 43
- 2023Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Datacited by 40
- 2024An Aggregation-Free Federated Learning for Tackling Data Heterogeneitycited by 33
- 2022FedSynth: Gradient Compression via Synthetic Data in Federated Learningcited by 31
- 2024Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversitycited by 30
- 2022Dataset Distillation Using Parameter Pruningcited by 27
- 2024Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boostingcited by 27
- 2022Meta Knowledge Condensation for Federated Learningcited by 26
- 2024Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecastingcited by 26
- 2024Graph Condensation: A Surveycited by 23
- 2020Overcoming Data Sparsity in Group Recommendationcited by 22
- 2022DYNAFED: Tackling Client Data Heterogeneity with Global Dynamicscited by 22
- 2021A Multi-view Multi-task Learning Framework for Multi-variate Time Series Forecastingcited by 21
- 2022Comprehensive Privacy Analysis on Federated Recommender System against Attribute Inference Attackscited by 21
- 2023HeteFedRec: Federated Recommender Systems with Model Heterogeneitycited by 20
- 2023Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distributioncited by 15
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025TriP-LLM: A Tri-Branch Patch-wise Large Language Model Framework for Time-Series Anomaly Detectioncited by 1
- 2025Benchmarking Catastrophic Forgetting Mitigation Methods in Federated Time Series Forecastingcited by 1
- 2026CTIA-ODE: Continuous-Time Inter-Variable Attention for Long-Term Time Series Forecastingcited by 0
- 2026CTIA-ODE: Continuous-Time Inter-Variable Attention for Long-Term Time Series Forecasting14 Oct 2026
- 2025Benchmarking Catastrophic Forgetting Mitigation Methods in Federated Time Series Forecasting24 Oct 2025
- 2025TriP-LLM: A Tri-Branch Patch-wise Large Language Model Framework for Time-Series Anomaly Detection31 Jul 2025