RELIEF: Turning Missing Modalities into Training Acceleration for Federated Learning on Heterogeneous IoT Edge
Not on the map. Why?
Abstract (arXiv)
Federated learning (FL) over heterogeneous IoT edge devices faces coupled system-modality-data heterogeneity: the lower-cost device carries both fewer sensors and less computational power, so the slowest device (straggler) produces the most incomplete gradient signals. Naively averaging their updates dilutes rare-modality information and wastes computation on absent-sensor parameters, whereas existing methods handle the triple heterogeneity (system, modality, data) in isolation and none addresses their coupling. To resolve this issue, we propose RELIEF, a framework that partitions the fusion-layer Low-Rank Adaptation (LoRA) projection matrix into modality-aligned column blocks and uses this partition as a unified interface for aggregation, elastic training, and communication. Each block is aggregated only within the cohort of devices possessing that modality, which eliminates cross-modal gradient interference; the server then allocates personalized training budgets by prioritizing blocks with the highest cohort-internal divergence, so that resource-constrained devices train fewer but more impactful parameters. We prove that cohort-wise aggregation removes interference from the convergence bound and that the divergence-guided allocation achieves sublinear regret. Experiments on two IoT sensor datasets (PAMAP2, MHEALTH) under both full-parameter (CNN) and parameter-efficient (LoRA) training show that RELIEF achieves up to 9.41x speedup and 37% energy reduction over FedAvg with up to 15.3 pp rare-modality F1 gains, and real-device validation on a two-Jetson AGX Orin testbed confirms these results.
Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). First posted on arXiv 5 Apr 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Forget to Improve: On-Device LLM-Agent Continual Learning via Budget-Curated Memorycited by 8
- 2026Lifecycle-Aware Federated Continual Learning in Mobile Autonomous Systemscited by 7
- 2026EASE: Federated Multimodal Unlearning via Entanglement-Aware Anchor Closurecited by 5
- 2026CrystalMem: Elastic Memory for Self-Evolving LLM Agents via Knowledge Crystallizationcited by 2
- 2026ERRAND: Budgeted Maintenance of Agent Memorycited by 1
- 2026When Unlearning Fails: Reliable Data Deletion under Post-Training in Agent Networkscited by 0
- 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agentscited by 0
- 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents1 Oct 2026
- 2026ERRAND: Budgeted Maintenance of Agent Memory2 Sep 2026
- 2026CrystalMem: Elastic Memory for Self-Evolving LLM Agents via Knowledge Crystallization31 Jul 2026
- 2026When Unlearning Fails: Reliable Data Deletion under Post-Training in Agent Networks30 Jul 2026
- 2026Forget to Improve: On-Device LLM-Agent Continual Learning via Budget-Curated Memory23 Jun 2026
- 2026EASE: Federated Multimodal Unlearning via Entanglement-Aware Anchor Closure1 May 2026
- 2026Lifecycle-Aware Federated Continual Learning in Mobile Autonomous Systems22 Apr 2026