Geometric Prior-Guided Federated Prompt Calibration
Not on the map. Why?
Abstract (arXiv)
Federated Prompt Learning (FPL) offers a parameter-efficient solution for collaboratively training large models, but its performance is severely hindered by data heterogeneity, which causes locally trained prompts to become biased. Existing methods, focusing on aggregation or regularization, fail to address this root cause of local training bias. To this end, we propose Geometry-Guided Text Prompt Calibration (GGTPC), a novel framework that directly corrects this bias by providing clients with a global geometric prior. This prior, representing the shape of the global data distribution derived from the covariance matrix, is reconstructed on the server in a privacy-preserving manner. Clients then use a novel Geometry-Prior Calibration Layer (GPCL) to align their local feature distributions with this global prior during training. Extensive experiments show GGTPC's effectiveness. On the label-skewed CIFAR-100 dataset (β=0.1), it outperforms the state-of-the-art by 2.15%. Under extreme skew (β=0.01), it improves upon the baseline by 9.17%. Furthermore, as a plug-and-play module on the domain-skewed Office-Home dataset, it boosts FedAvg's performance by 4.60%. These results demonstrate that GGTPC effectively mitigates data heterogeneity by correcting the fundamental local training bias, serving as a versatile module to enhance various FL algorithms.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 72 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
48 of 72 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2022Visual Prompt Tuningcited by 1,681
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,188
36 more
- 2018Federated Learning with Non-IID Datacited by 1,108
- 2020Adaptive Federated Optimizationcited by 1,046
- 2017Deeper, Broader and Artier Domain Generalizationcited by 986
- 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 906
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
- 2019Towards Federated Learning at Scale: System Designcited by 832
- 2021Model-Contrastive Federated Learningcited by 766
- 2022MaPLe: Multi-modal Prompt Learningcited by 687
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
- 2021Federated Learning Based on Dynamic Regularizationcited by 562
- 2019A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protectioncited by 374
- 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 352
- 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimizationcited by 308
- 2022FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correctioncited by 181
- 2019SCAFFOLD: Stochastic Controlled Averaging for Federated Learningcited by 175
- 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 161
- 2022Unified Vision and Language Prompt Learningcited by 148
- 2022PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models -- Federated Learning in Age of Foundation Modelcited by 134
- 2022Federated Learning with Label Distribution Skew via Logits Calibrationcited by 109
- 2021FedMix: Approximation of Mixup under Mean Augmented Federated Learningcited by 108
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 99
- 2021Preservation of the Global Knowledge by Not-True Distillation in Federated Learningcited by 87
- 2023FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learningcited by 70
- 2022LASP: Text-to-Text Optimization for Language-Aware Soft Prompting of Vision & Language Modelscited by 59
- 2023DePT: Decoupled Prompt Tuningcited by 58
- 2023Learning Federated Visual Prompt in Null Space for MRI Reconstructioncited by 40
- 2023Cross-Silo Prototypical Calibration for Federated Learning with Non-IID Datacited by 35
- 2023Efficient Multimodal Fusion via Interactive Promptingcited by 32
- 2024Unleashing the Power of Continual Learning on Non-Centralized Devices: A Surveycited by 23
- 2022FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregationcited by 21
- 2023Is Aggregation the Only Choice? Federated Learning via Layer-wise Model Recombinationcited by 13
- 2024Advances in Robust Federated Learning: A Survey with Heterogeneity Considerationscited by 12
- 2025Geometric Knowledge-Guided Localized Global Distribution Alignment for Federated Learningcited by 12
- 2025A Systematic Survey on Federated Sequential Recommendationcited by 4
- 2025Federated Out-of-Distribution Generalization: A Causal Augmentation Viewcited by 4
- 2025Global Intervention and Distillation for Federated Out-of-Distribution Generalizationcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.