PiXTime: A Model for Federated Time Series Forecasting with Heterogeneous Data across Nodes
Not on the map. Why?
Abstract (arXiv)
While collaborative forecasting on distributed time series is highly desirable, directly pooling localized datasets is often impractical due to data sharing constraints. Federated learning offers a promising alternative, yet conventional federated learning algorithms require homogeneous model architectures, which are incompatible with the structural discrepancies, such as unaligned temporal resolutions and mismatched variable channels, commonly observed across decentralized nodes. To bridge this gap, we introduce PiXTime, a novel Transformer-based framework designed to natively accommodate and leverage structurally heterogeneous temporal data. At its core, PiXTime adopts a parameter-decoupling architecture, strategically partitioning the model into localized personalized modules and a globally aggregated shared backbone. Specifically, node-specific local modules act as dimensional adapters, projecting raw sequences of diverse lengths into a unified representation space. Concurrently, a globally synchronized VE Table injects consistent categorical identities into the feature space, allowing the shared backbone to collaboratively learn and generalize representations across inconsistent variable distributions. Comprehensive evaluations on multiple benchmarks demonstrate that PiXTime achieves state-of-the-art performance in heterogeneous federated environments, while maintaining robust superiority in standard homogeneous and centralized forecasting settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 9 Jan 2026.
Builds on
18 of 33 references.
References · 18
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2020Personalized Federated Learning with Moreau Envelopescited by 612
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 537
- 2020Think Locally, Act Globally: Federated Learning with Local and Global Representationscited by 322
- 2020Personalized Cross-Silo Federated Learning on Non-IID Datacited by 282
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 241
- 2021FedBABU: Towards Enhanced Representation for Federated Image Classificationcited by 180
- 2013Distributed optimization over time-varying directed graphscited by 77
6 more
- 2024Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Modelscited by 15
- 2024Decoupling General and Personalized Knowledge in Federated Learning via Additive and Low-Rank Decompositioncited by 15
- 2025HyperIMTS: Hypergraph Neural Network for Irregular Multivariate Time Series Forecastingcited by 14
- 2025FeDaL: Federated Dataset Learning for General Time Series Foundation Modelscited by 10
- 2024Adaptive Weighting Push-SUM for Decentralized Optimization with Statistical Diversitycited by 2
- 2025Optimal Look-back Horizon for Time Series Forecasting in Federated Learningcited by 2
Built on by
Not cited yet.