mlsanityData to 14 Oct 2026

Decentralized Rank Scheduling for Energy-Constrained Multi-Task Federated Fine-Tuning in Edge-Assisted IoV Networks

arXiv 2508.09532 ↗First posted 13 Aug 2025cs.LG cs.AI cs.NIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large-scale Internet of Vehicles (IoV) deployments increasingly demand the on-device adaptation of foundation models to support diverse, mission-critical perception tasks. While federated fine-tuning offers a promising solution for efficient model specialization, existing approaches often struggle to reconcile the inherent conflict between stringent global energy budgets, heterogeneous task demands, and the high volatility of vehicular network connectivity. In this work, we introduce a hierarchical, adaptive framework that decouples multi-task fine-tuning into two interdependent optimization phases. First, we implement a feedback-loop mechanism at the infrastructure level that dynamically redistributes global energy budgets across concurrent tasks based on real-time convergence dynamics and resource utilization. Second, at the vehicle level, we formulate intra-task rank selection as an energy-constrained online learning problem, solved via a novel primal-dual bandit algorithm, UCB-DUAL, which provides theoretical guarantees on sublinear regret. Our approach effectively internalizes global energy constraints into local decision-making, allowing vehicles to autonomously navigate the complex trade-off between model accuracy, latency, and power consumption. Empirical evaluations using a large-scale IoV simulator, driven by real-world trajectory data, confirm that our proposed method significantly outperforms current federated fine-tuning baselines, offering a robust and scalable solution for resource-constrained vehicular intelligence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 13 Aug 2025.

Builds on

25 of 56 references.

References · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  7. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  8. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  9. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  10. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
  11. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
  12. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
13 more
  1. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  2. 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
  3. 2019Federated Learning with Personalization Layerscited by 541
  4. 2024Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Modelscited by 116
  5. 2020Upper Confidence Primal-Dual Reinforcement Learning for CMDP with Adversarial Losscited by 46
  6. 2023FedRA: A Random Allocation Strategy for Federated Tuning to Unleash the Power of Heterogeneous Clientscited by 19
  7. 2025A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learningcited by 17
  8. 2023DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Datasetcited by 14
  9. 2024FedLPS: Heterogeneous Federated Learning for Multiple Tasks with Local Parameter Sharingcited by 8
  10. 2024FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clientscited by 3
  11. 2021Green Internet of Vehicles (IoV) in the 6G Era: Toward Sustainable Vehicular Communications and Networkingcited by 2
  12. 2023FedDD: Toward Communication-efficient Federated Learning with Differential Parameter Dropoutcited by 2
  13. 2025Online Location Planning for AI-Defined Vehicles: Optimizing Joint Tasks of Order Serving and Spatio-Temporal Heterogeneous Model Fine-Tuningcited by 1

Built on by

Not cited yet.