mlsanityData to 14 Oct 2026

Silent Failures in Federated Personalization of Foundation Models

arXiv 2606.00947 ↗First posted 31 May 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Foundation models are increasingly personalized on decentralized private data through federated learning and are now deployed at scale under growing regulatory requirements for post-market monitoring. We argue that this convergence creates a distinct and under-recognized class of trustworthiness failures, which we term "Silent Failures." These include amplified bias, fairness collapse, and alignment erosion that may remain difficult to detect because federated learning's privacy constraints limit visibility into model behavior. A landscape analysis of existing benchmarks reveals a structural divide. Federated benchmarks evaluate system performance but provide limited insight into model behavior, whereas centralized trustworthiness benchmarks assess behavior but require model access incompatible with federated privacy. We introduce a taxonomy of six silent failure modes arising from the interaction of foundation model personalization, dataset shift, and core federated constraints. Our analysis shows that privacy-preserving training alone is insufficient for trustworthy deployment. We conclude with a research agenda for privacy-preserving behavioral evaluation and propose that silent failures become a standard diagnostic category for trustworthy federated artificial intelligence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 73 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

44 of 73 references.

References · 44

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2017On Calibration of Modern Neural Networkscited by 4,960
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  4. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  5. 2019Advances and Open Problems in Federated Learningcited by 3,046
  6. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  7. 2023A Survey of Large Language Modelscited by 2,576
  8. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  9. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  10. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
  11. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  12. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
32 more
  1. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
  2. 2022Red Teaming Language Models with Language Modelscited by 1,026
  3. 2018LEAF: A Benchmark for Federated Settingscited by 792
  4. 2020Federated Learning with Matched Averagingcited by 564
  5. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
  6. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
  7. 2020Learning under Concept Drift: A Reviewcited by 477
  8. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  9. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
  10. 2021Do Prompt-Based Models Really Understand the Meaning of their Prompts?cited by 326
  11. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
  12. 2022Predictability and Surprise in Large Generative Modelscited by 210
  13. 2021FedScale: Benchmarking Model and System Performance of Federated Learning at Scalecited by 136
  14. 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 128
  15. 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 125
  16. 2024Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Modelscited by 116
  17. 2023Task Contamination: Language Models May Not Be Few-Shot Anymorecited by 99
  18. 2022From Concept Drift to Model Degradation: An Overview on Performance-Aware Drift Detectorscited by 83
  19. 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 83
  20. 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Biascited by 55
  21. 2024Dual-Personalizing Adapter for Federated Foundation Modelscited by 55
  22. 2024Advances and Open Challenges in Federated Foundation Modelscited by 36
  23. 2024FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Modelscited by 30
  24. 2025Ten Challenging Problems in Federated Foundation Modelscited by 20
  25. 2023PFLlib: A Beginner-Friendly and Comprehensive Personalized Federated Learning Library and Benchmarkcited by 17
  26. 2024FOOGD: Federated Collaboration for Both Out-of-distribution Generalization and Detectioncited by 14
  27. 2025FlowerTune: A Cross-Domain Benchmark for Federated Fine-Tuning of Large Language Modelscited by 11
  28. 2025You Can't Eat Your Cake and Have It Too: The Performance Degradation of LLMs with Jailbreak Defensecited by 10
  29. 2024Confidence-Aware Multi-Field Model Calibrationcited by 4
  30. 2025Multi-View Contrastive Learning for Robust Domain Adaptation in Medical Time Series Analysiscited by 4
  31. 2025A Survey on Foundation Models for Personalized Federated Intelligencecited by 3
  32. 2025Continuum Dropout for Neural Differential Equationscited by 1

Built on by

Not cited yet.