On the Tradeoffs of On-Device Generative Models in Federated Predictive Maintenance Systems
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Federated Learning (FL) has emerged as a promising paradigm for preserving client data ownership and control over distributed Internet of Things (IoT) environments. While discriminative models dominate most FL use cases, recent advances in generative models -- such as Variational Autoencoders (VAE), Generative Adversarial Networks (GAN), and Diffusion Models (DM) -- offer new opportunities for unsupervised anomaly detection in time series analysis, with relevant applications in predictive maintenance (PdM) in critical industrial infrastructures. In this work, we present a comprehensive analysis of VAEs, GANs, and DMs in the context of federated PdM. We analyze their performance and communication overhead under both full and partial federation setups, where only subsets of model components are shared. Building on this analysis, the paper proposes a novel taxonomy for federated generative models that formalizes partial component sharing as a principled mechanism for model personalization. Our experiments over a real-world time series dataset reveal distinct trade-offs in model utility, stability, and scalability, especially in heterogeneous and bandwidth-constrained FL settings. For the evaluated GAN-based configurations, full federation improves training stability relative to independent local training, although the model remains less robust than the VAE- and DDPM-based alternatives. For DMs, however, partial federation -- especially decoder sharing -- can outperform full federation in bandwidth-constrained, non-IID settings.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 31 of its 57 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
31 of 57 references.
Closest ancestors · 1
Same direction, newest first
Other references · 30
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2022Generative Adversarial Networkscited by 5,627
- 2016Improved Techniques for Training GANscited by 2,970
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2018A Tutorial on Bayesian Optimizationcited by 744
- 2017Wasserstein GANcited by 639
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
- 2019Federated Learning with Personalization Layerscited by 541
18 more
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 541
- 2020Think Locally, Act Globally: Federated Learning with Local and Global Representationscited by 325
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2017A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-based Variational Autoencodercited by 209
- 2019MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networkscited by 176
- 2019U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Stagingcited by 88
- 2020TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networkscited by 55
- 2021Anomaly Detection of Time Series with Smoothness-Inducing Sequential Variational Auto-Encodercited by 39
- 2020TAnoGAN: Time Series Anomaly Detection with Generative Adversarial Networkscited by 29
- 2019A Survey of Predictive Maintenance: Systems, Purposes and Approachescited by 21
- 2020Federated Generative Adversarial Learningcited by 19
- 2022LSTM-Autoencoder based Anomaly Detection for Indoor Air Quality Time Series Datacited by 19
- 2025Deep Learning Advancements in Anomaly Detection: A Comprehensive Surveycited by 17
- 2024Federated Foundation Models on Heterogeneous Time Seriescited by 13
- 2021Federated Variational Learning for Anomaly Detection in Multivariate Time Seriescited by 12
- 2025FeDaL: Federated Dataset Learning for General Time Series Foundation Modelscited by 10
- 2022Straggler-Resilient Personalized Federated Learningcited by 9
- 2025FL-PLAS: Federated Learning with Partial Layer Aggregation for Backdoor Defense Against High-Ratio Malicious Clientscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Applied Federated Model Personalisation in the Industrial Domain: A Comparative Study
- 2022FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers
- 2025Data-Free Continual Learning of Server Models in Model-Heterogeneous Cloud-Device Collaboration
- 2026Generative AI and Federated Learning for Intrusion Detection Systems: A Survey
- 2025FedBKD: Distilled Federated Learning to Embrace Gerneralization and Personalization on Non-IID Data
- 2026Quantization Impact on the Accuracy and Communication Efficiency Trade-off in Federated Learning for Aerospace Predictive Maintenance
- 2025OvA-LP: A Simple and Efficient Framework for Federated Learning on Non-IID Data
- 2022FedDTG:Federated Data-Free Knowledge Distillation via Three-Player Generative Adversarial Networks