mlsanityData to 14 Oct 2026

Geometric Prior-Guided Federated Prompt Calibration

arXiv 2512.07208 ↗First posted 8 Dec 2025cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Federated Prompt Learning (FPL) offers a parameter-efficient solution for collaboratively training large models, but its performance is severely hindered by data heterogeneity, which causes locally trained prompts to become biased. Existing methods, focusing on aggregation or regularization, fail to address this root cause of local training bias. To this end, we propose Geometry-Guided Text Prompt Calibration (GGTPC), a novel framework that directly corrects this bias by providing clients with a global geometric prior. This prior, representing the shape of the global data distribution derived from the covariance matrix, is reconstructed on the server in a privacy-preserving manner. Clients then use a novel Geometry-Prior Calibration Layer (GPCL) to align their local feature distributions with this global prior during training. Extensive experiments show GGTPC's effectiveness. On the label-skewed CIFAR-100 dataset (β=0.1), it outperforms the state-of-the-art by 2.15%. Under extreme skew (β=0.01), it improves upon the baseline by 9.17%. Furthermore, as a plug-and-play module on the domain-skewed Office-Home dataset, it boosts FedAvg's performance by 4.60%. These results demonstrate that GGTPC effectively mitigates data heterogeneity by correcting the fundamental local training bias, serving as a versatile module to enhance various FL algorithms.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 72 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

48 of 72 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  5. 2019Advances and Open Problems in Federated Learningcited by 3,046
  6. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  7. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  8. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  9. 2022Visual Prompt Tuningcited by 1,681
  10. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
  11. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  12. 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,188
36 more
  1. 2018Federated Learning with Non-IID Datacited by 1,108
  2. 2020Adaptive Federated Optimizationcited by 1,046
  3. 2017Deeper, Broader and Artier Domain Generalizationcited by 986
  4. 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 906
  5. 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
  6. 2019Towards Federated Learning at Scale: System Designcited by 832
  7. 2021Model-Contrastive Federated Learningcited by 766
  8. 2022MaPLe: Multi-modal Prompt Learningcited by 687
  9. 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
  10. 2021Federated Learning Based on Dynamic Regularizationcited by 562
  11. 2019A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protectioncited by 374
  12. 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 352
  13. 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimizationcited by 308
  14. 2022FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correctioncited by 181
  15. 2019SCAFFOLD: Stochastic Controlled Averaging for Federated Learningcited by 175
  16. 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 161
  17. 2022Unified Vision and Language Prompt Learningcited by 148
  18. 2022PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models -- Federated Learning in Age of Foundation Modelcited by 134
  19. 2022Federated Learning with Label Distribution Skew via Logits Calibrationcited by 109
  20. 2021FedMix: Approximation of Mixup under Mean Augmented Federated Learningcited by 108
  21. 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 99
  22. 2021Preservation of the Global Knowledge by Not-True Distillation in Federated Learningcited by 87
  23. 2023FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learningcited by 70
  24. 2022LASP: Text-to-Text Optimization for Language-Aware Soft Prompting of Vision & Language Modelscited by 59
  25. 2023DePT: Decoupled Prompt Tuningcited by 58
  26. 2023Learning Federated Visual Prompt in Null Space for MRI Reconstructioncited by 40
  27. 2023Cross-Silo Prototypical Calibration for Federated Learning with Non-IID Datacited by 35
  28. 2023Efficient Multimodal Fusion via Interactive Promptingcited by 32
  29. 2024Unleashing the Power of Continual Learning on Non-Centralized Devices: A Surveycited by 23
  30. 2022FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregationcited by 21
  31. 2023Is Aggregation the Only Choice? Federated Learning via Layer-wise Model Recombinationcited by 13
  32. 2024Advances in Robust Federated Learning: A Survey with Heterogeneity Considerationscited by 12
  33. 2025Geometric Knowledge-Guided Localized Global Distribution Alignment for Federated Learningcited by 12
  34. 2025A Systematic Survey on Federated Sequential Recommendationcited by 4
  35. 2025Federated Out-of-Distribution Generalization: A Causal Augmentation Viewcited by 4
  36. 2025Global Intervention and Distillation for Federated Out-of-Distribution Generalizationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.