mlsanityData to 14 Oct 2026

Safe-FCL: Continual Risk Awareness and Fine-Grained Safety Aggregation for Federated Continual Learning of LLMs

arXiv 2610.19968 ↗First posted 14 Oct 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Federated fine-tuning enables large language models (LLMs) to learn collaboratively from distributed client data, but malicious client updates can compromise global model safety. As federated tasks evolve, changing malicious update patterns challenge the ability of existing defenses to maintain reliable risk detection over time. To address this challenge, we propose Safe-FCL, a framework integrating continual risk awareness with fine-grained safety aggregation for federated continual learning of LLMs. Specifically, the Continual Risk Awareness (CRA) mechanism learns emerging risk patterns across sequential tasks and constrains detector updates using a protective subspace derived from historical features, mitigating forgetting of previously learned malicious patterns while adapting to new risks. To translate risk awareness into aggregation-level safety control, the Fine-Grained Safety Aggregation (FGSA) mechanism combines client-level risk assessments from CRA with module-level deviations from historical update behavior to adaptively regulate aggregation contributions, suppressing potentially malicious updates while minimizing unnecessary restrictions on benign updates. Extensive experiments demonstrate that Safe-FCL outperforms current SOTA methods, improving global-model Rule and MD-Judge scores in federated continual learning by 0.41% and 0.64%, respectively, while increasing average risk recognition accuracy by 2.01%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 55 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

29 of 55 references.

References · 29

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  3. 2016Learning without Forgettingcited by 2,496
  4. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  5. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  6. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
  7. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  8. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
  9. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  10. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
  11. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
  12. 2019Orthogonal Gradient Descent for Continual Learningcited by 369
17 more
  1. 2021Gradient Projection Memory for Continual Learningcited by 348
  2. 2020FLTrust: Byzantine-robust Federated Learning via Trust Bootstrappingcited by 346
  3. 2024PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preferencecited by 261
  4. 2023Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignmentcited by 223
  5. 2020Federated Continual Learning with Weighted Inter-client Transfercited by 161
  6. 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrailscited by 132
  7. 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 128
  8. 2025FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoningcited by 58
  9. 2020PolicyQA: A Reading Comprehension Dataset for Privacy Policiescited by 34
  10. 2024HarmAug: Effective Data Augmentation for Knowledge Distillation of Safety Guard Modelscited by 19
  11. 2024Achieving Byzantine-Resilient Federated Learning via Layer-Adaptive Sparsified Model Aggregationcited by 15
  12. 2026TAME: A Trustworthy Test-Time Evolution of Agent Memory with Systematic Benchmarkingcited by 10
  13. 2024Handling Spatial-Temporal Data Heterogeneity for Federated Continual Learning via Tail Anchorcited by 9
  14. 2025SAIDO: Generalizable Detection of AI-Generated Images via Scene-Aware and Importance-Guided Dynamic Optimization in Continual Learningcited by 5
  15. 2026Face-D(^2)CL: Multi-Domain Synergistic Representation with Dual Continual Learning for Facial DeepFake Detectioncited by 1
  16. 2026Adversarial Arena: Crowdsourcing Data Generation through Interactive Competitioncited by 1
  17. 2026SafeCoEvo: Co-Evolving Safety Harnesses and Guards for LLM Agents at Test-Timecited by 1

Built on by

Not cited yet.