mlsanityData to 7 Oct 2026

FedOPAL: One-Shot Federated Learning via Analytic Visual Prompt Tuning

arXiv 2607.08368 ↗First posted 9 Jul 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

With the widespread deployment of basic models in edge intelligence, communication bandwidth has become a core bottleneck restricting the scalability of federated learning. Although one-shot federated learning alleviates this problem by minimizing communication rounds, existing iterative fine-tuning or knowledge distillation methods still face challenges such as high server-side computational costs and hyperparameter sensitivity. Analytical federated learning achieves efficient gradientfree aggregation using least-squares closed-form solutions, but in environments with non-independent and identically distributed data, its static feature assumptions fail, leading to feature manifold misalignment and severely impairing model performance. To address this contradiction, this paper proposes the FedOPAL framework. This framework adapts the visual prompts as feature rectifiers, actively correcting the feature distribution of heterogeneous data to a linearly separable space by applying local proximal constraints, thereby satisfying the theoretical assumptions of analytical federated learning. Experimental results show that FedOPAL not only significantly outperforms the original analytical methods on several benchmarks, but also achieves accuracy comparable to state-of-the-art iterative methods while maintaining zero server-side training costs, providing a new engineering paradigm for efficient collaboration of large models on the edge.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 31 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

20 of 31 references.

References · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  4. 2022Visual Prompt Tuningcited by 1,674
  5. 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 380
  6. 2022PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models -- Federated Learning in Age of Foundation Modelcited by 133
  7. 2021DENSE: Data-Free One-Shot Federated Learningcited by 100
  8. 2020XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learningcited by 58
  9. 2021Federated Learning for Internet of Things: Applications, Challenges, and Opportunitiescited by 49
  10. 2022Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environmentscited by 49
  11. 2024Global and Local Prompts Cooperation via Optimal Transport for Federated Learningcited by 45
  12. 2024Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boostingcited by 27
8 more
  1. 2024Parametric Feature Transfer: One-shot Federated Learning with Foundation Modelscited by 13
  2. 2024One-shot Federated Learning via Synthetic Distiller-Distillate Communicationcited by 12
  3. 2024AFL: A Single-Round Analytic Approach for Federated Learning with Pre-trained Modelscited by 11
  4. 2024Navigating Heterogeneity and Privacy in One-Shot Federated Learning with Diffusion Modelscited by 7
  5. 2024Efficient Partitioning Vision Transformer on Edge Devices for Distributed Inferencecited by 6
  6. 2025Capture Global Feature Statistics for One-Shot Federated Learningcited by 6
  7. 2025Federated Learning for Cyber Physical Systems: A Comprehensive Surveycited by 6
  8. 2026DeepAFL: Deep Analytic Federated Learningcited by 1

Built on by

Not cited yet.