Thermo-FL: Thermal-Aware Robust Federated Fine-Tuning of Large Language Models for Edge AI
Not on the map. Why?
Abstract (arXiv)
Federated fine-tuning enables large language models to adapt on edge devices without centralizing private data, but practical deployments must address hardware instability and adversarial update corruption together. Thermally constrained clients may throttle, slow local training, or delay synchronous aggregation, while Byzantine clients and communication-layer adversaries can corrupt the updates used to form the global model. To address these challenges, we present Thermo-FL, a thermal-aware federated LoRA fine-tuning framework that uses device temperature as an active control signal for local adapter training and sparse update transmission. On the client side, Thermo-FL adjusts the active LoRA-layer fraction and transmitted update density as devices heat or cool, reducing workload under thermal stress. On the server side, Thermo-FL introduces TERRA, a robust aggregation pipeline for dynamically sparse LoRA updates that combines norm filtering, mask-aware directional validation, adaptive active-coordinate clipping, and mask-aware aggregation. We evaluate Thermo-FL using both a large-scale emulator and a Jetson-based physical testbed. In the emulator, Thermo-FL improves robustness under adversarial sparse aggregation and achieves the strongest BoolQ accuracy across clean and attack settings while remaining competitive on GSM8K. In the physical prototype, Thermo-FL stabilizes device temperature, reduces compressed upload size through bitmap sparse encoding, and preserves GSM8K utility under sign-flip/scale and MITM perturbations. These results show that secure edge LLM adaptation should jointly consider hardware behavior, workload regulation, sparse communication, and aggregation robustness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
33 of 47 references.
References · 33
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
- 2018How To Backdoor Federated Learningcited by 765
- 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 711
21 more
- 2018Federated Learning for Mobile Keyboard Predictioncited by 572
- 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 493
- 2018Analyzing Federated Learning through an Adversarial Lenscited by 351
- 2018The Hidden Vulnerability of Distributed Learning in Byzantiumcited by 329
- 2019A Little Is Enough: Circumventing Defenses For Distributed Learningcited by 288
- 2019Differentially Private Learning with Adaptive Clippingcited by 220
- 2019On the Convergence of Local Descent Methods in Federated Learningcited by 153
- 2020Survey of Personalization Techniques for Federated Learningcited by 145
- 2024On-Device Language Models: A Comprehensive Reviewcited by 104
- 2024LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameterscited by 76
- 2021Byzantine-robust Federated Learning through Collaborative Malicious Gradient Filteringcited by 30
- 2024Federated LoRA with Sparse Communicationcited by 26
- 2025A Survey on Federated Fine-tuning of Large Language Modelscited by 24
- 2022On-device Training: A First Overview on Existing Systemscited by 19
- 2024Training Machine Learning models at the Edge: A Surveycited by 11
- 2025FedSRD: Sparsify-Reconstruct-Decompose for Communication-Efficient Federated Large Language Models Fine-Tuningcited by 6
- 2025EcoLoRA: Communication-Efficient Federated Fine-Tuning of Large Language Modelscited by 4
- 2025DP-FedLoRA: Privacy-Enhanced Federated Fine-Tuning for On-Device Large Language Modelscited by 4
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directionscited by 2
- 2025A Survey: Towards Privacy and Security in Mobile Large Language Modelscited by 1
- 2026Byzantine Machine Learning: MultiKrum and an optimal notion of robustnesscited by 1
Built on by
Not cited yet.