Silent Failures in Federated Personalization of Foundation Models
Not on the map. Why?
Abstract (arXiv)
Foundation models are increasingly personalized on decentralized private data through federated learning and are now deployed at scale under growing regulatory requirements for post-market monitoring. We argue that this convergence creates a distinct and under-recognized class of trustworthiness failures, which we term "Silent Failures." These include amplified bias, fairness collapse, and alignment erosion that may remain difficult to detect because federated learning's privacy constraints limit visibility into model behavior. A landscape analysis of existing benchmarks reveals a structural divide. Federated benchmarks evaluate system performance but provide limited insight into model behavior, whereas centralized trustworthiness benchmarks assess behavior but require model access incompatible with federated privacy. We introduce a taxonomy of six silent failure modes arising from the interaction of foundation model personalization, dataset shift, and core federated constraints. Our analysis shows that privacy-preserving training alone is insufficient for trustworthy deployment. We conclude with a research agenda for privacy-preserving behavioral evaluation and propose that silent failures become a standard diagnostic category for trustworthy federated artificial intelligence.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 73 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
44 of 73 references.
References · 44
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2023A Survey of Large Language Modelscited by 2,576
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
32 more
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2022Red Teaming Language Models with Language Modelscited by 1,026
- 2018LEAF: A Benchmark for Federated Settingscited by 792
- 2020Federated Learning with Matched Averagingcited by 564
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
- 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
- 2020Learning under Concept Drift: A Reviewcited by 477
- 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2021Do Prompt-Based Models Really Understand the Meaning of their Prompts?cited by 326
- 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
- 2022Predictability and Surprise in Large Generative Modelscited by 210
- 2021FedScale: Benchmarking Model and System Performance of Federated Learning at Scalecited by 136
- 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 128
- 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 125
- 2024Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Modelscited by 116
- 2023Task Contamination: Language Models May Not Be Few-Shot Anymorecited by 99
- 2022From Concept Drift to Model Degradation: An Overview on Performance-Aware Drift Detectorscited by 83
- 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 83
- 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Biascited by 55
- 2024Dual-Personalizing Adapter for Federated Foundation Modelscited by 55
- 2024Advances and Open Challenges in Federated Foundation Modelscited by 36
- 2024FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Modelscited by 30
- 2025Ten Challenging Problems in Federated Foundation Modelscited by 20
- 2023PFLlib: A Beginner-Friendly and Comprehensive Personalized Federated Learning Library and Benchmarkcited by 17
- 2024FOOGD: Federated Collaboration for Both Out-of-distribution Generalization and Detectioncited by 14
- 2025FlowerTune: A Cross-Domain Benchmark for Federated Fine-Tuning of Large Language Modelscited by 11
- 2025You Can't Eat Your Cake and Have It Too: The Performance Degradation of LLMs with Jailbreak Defensecited by 10
- 2024Confidence-Aware Multi-Field Model Calibrationcited by 4
- 2025Multi-View Contrastive Learning for Robust Domain Adaptation in Medical Time Series Analysiscited by 4
- 2025A Survey on Foundation Models for Personalized Federated Intelligencecited by 3
- 2025Continuum Dropout for Neural Differential Equationscited by 1
Built on by
Not cited yet.